Dec 06 06:54:52 user nova-compute[75021]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75021) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 06 06:54:52 user nova-compute[75021]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75021) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 06 06:54:52 user nova-compute[75021]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75021) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 06 06:54:52 user nova-compute[75021]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:54:53 user nova-compute[75021]: INFO nova.virt.driver [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] Loading compute driver 'libvirt.LibvirtDriver'
Dec 06 06:54:53 user nova-compute[75021]: INFO nova.compute.provider_config [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] Acquiring lock "singleton_lock" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] Acquired lock "singleton_lock" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] Releasing lock "singleton_lock" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] Full set of CONF: {{(pid=75021) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ******************************************************************************** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] Configuration options gathered from: {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ================================================================================ {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] allow_resize_to_same_host      = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] arq_binding_timeout            = 300 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] backdoor_port                  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] backdoor_socket                = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] block_device_allocate_retries  = 300 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] block_device_allocate_retries_interval = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cert                           = self.pem {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] compute_monitors               = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] config_dir                     = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] config_drive_format            = iso9660 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] config_source                  = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] console_host                   = user {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] control_exchange               = nova {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cpu_allocation_ratio           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] daemon                         = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] debug                          = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] default_access_ip_network_name = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] default_availability_zone      = nova {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] default_ephemeral_format       = ext4 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] default_green_pool_size        = 1000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] default_schedule_zone          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] disk_allocation_ratio          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] enable_new_services            = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] enabled_apis                   = ['osapi_compute'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] enabled_ssl_apis               = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] flat_injected                  = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] force_config_drive             = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] force_raw_images               = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] graceful_shutdown_timeout      = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] heal_instance_info_cache_interval = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] host                           = user {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] instance_build_timeout         = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] instance_delete_interval       = 300 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] instance_format                = [instance: %(uuid)s]  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] instance_name_template         = instance-%08x {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] instance_usage_audit           = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] instance_usage_audit_period    = month {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] internal_service_availability_zone = internal {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] key                            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] live_migration_retry_count     = 30 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] log_config_append              = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] log_dir                        = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] log_file                       = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] log_options                    = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] log_rotate_interval            = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] log_rotate_interval_type       = days {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] log_rotation_type              = none {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] long_rpc_timeout               = 1800 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] max_concurrent_builds          = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] max_concurrent_live_migrations = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] max_concurrent_snapshots       = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] max_local_block_devices        = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] max_logfile_count              = 30 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] max_logfile_size_mb            = 200 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] maximum_instance_delete_attempts = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] metadata_listen                = 0.0.0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] metadata_listen_port           = 8775 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] metadata_workers               = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] migrate_max_retries            = -1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] mkisofs_cmd                    = genisoimage {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] my_ip                          = 10.0.0.210 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] network_allocate_retries       = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] osapi_compute_listen_port      = 8774 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] osapi_compute_unique_server_name_scope =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] osapi_compute_workers          = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] password_length                = 12 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] periodic_enable                = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] periodic_fuzzy_delay           = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] pointer_model                  = ps2mouse {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] preallocate_images             = none {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] publish_errors                 = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] pybasedir                      = /opt/stack/nova {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ram_allocation_ratio           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] rate_limit_burst               = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] rate_limit_except_level        = CRITICAL {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] rate_limit_interval            = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] reboot_timeout                 = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] reclaim_instance_interval      = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] record                         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] reimage_timeout_per_gb         = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] report_interval                = 120 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] rescue_timeout                 = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] reserved_host_cpus             = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] reserved_host_disk_mb          = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] reserved_host_memory_mb        = 512 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] reserved_huge_pages            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] resize_confirm_window          = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] resize_fs_using_block_device   = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] resume_guests_state_on_host_boot = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] rpc_response_timeout           = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] run_external_periodic_tasks    = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] running_deleted_instance_action = reap {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] running_deleted_instance_poll_interval = 1800 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] running_deleted_instance_timeout = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] scheduler_instance_sync_interval = 120 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] service_down_time              = 720 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] servicegroup_driver            = db {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] shelved_offload_time           = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] shelved_poll_interval          = 3600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] shutdown_timeout               = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] source_is_ipv6                 = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ssl_only                       = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] state_path                     = /opt/stack/data/nova {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] sync_power_state_interval      = 600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] sync_power_state_pool_size     = 1000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] syslog_log_facility            = LOG_USER {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] tempdir                        = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] timeout_nbd                    = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] transport_url                  = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] update_resources_interval      = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] use_cow_images                 = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] use_eventlog                   = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] use_journal                    = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] use_json                       = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] use_rootwrap_daemon            = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] use_stderr                     = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] use_syslog                     = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vcpu_pin_set                   = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vif_plugging_is_fatal          = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vif_plugging_timeout           = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] virt_mkfs                      = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] volume_usage_poll_interval     = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] watch_log_file                 = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] web                            = /usr/share/spice-html5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_concurrency.disable_process_locking = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.auth_strategy              = keystone {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.compute_link_prefix        = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.dhcp_domain                = novalocal {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.enable_instance_password   = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.glance_link_prefix         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.instance_list_per_project_cells = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.list_records_by_skipping_down_cells = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.local_metadata_per_cell    = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.max_limit                  = 1000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.metadata_cache_expiration  = 15 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.neutron_default_tenant_id  = default {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.use_forwarded_for          = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.use_neutron_default_nets   = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.vendordata_dynamic_targets = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.vendordata_jsonfile_path   = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.backend                  = dogpile.cache.memcached {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.backend_argument         = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.config_prefix            = cache.oslo {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.dead_timeout             = 60.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.debug_cache_backend      = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.enable_retry_client      = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.enable_socket_keepalive  = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.enabled                  = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.expiration_time          = 600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.hashclient_retry_attempts = 2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.memcache_dead_retry      = 300 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.memcache_password        =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.memcache_pool_maxsize    = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.memcache_sasl_enabled    = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.memcache_username        =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.proxies                  = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.retry_attempts           = 2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.retry_delay              = 0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.socket_keepalive_count   = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.socket_keepalive_idle    = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.socket_keepalive_interval = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.tls_allowed_ciphers      = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.tls_cafile               = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.tls_certfile             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.tls_enabled              = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cache.tls_keyfile              = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cinder.auth_section            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cinder.auth_type               = password {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cinder.cafile                  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cinder.certfile                = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cinder.collect_timing          = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cinder.cross_az_attach         = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cinder.debug                   = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cinder.endpoint_template       = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cinder.http_retries            = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cinder.insecure                = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cinder.keyfile                 = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cinder.os_region_name          = RegionOne {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cinder.split_loggers           = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cinder.timeout                 = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] compute.cpu_dedicated_set      = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] compute.cpu_shared_set         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] compute.image_type_exclude_list = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] compute.max_concurrent_disk_ops = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] compute.max_disk_devices_to_attach = -1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] compute.resource_provider_association_refresh = 300 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] compute.shutdown_retry_interval = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] conductor.workers              = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] console.allowed_origins        = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] console.ssl_ciphers            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] console.ssl_minimum_version    = default {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] consoleauth.token_ttl          = 600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.cafile                  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.certfile                = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.collect_timing          = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.connect_retries         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.connect_retry_delay     = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.endpoint_override       = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.insecure                = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.keyfile                 = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.max_version             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.min_version             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.region_name             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.service_name            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.service_type            = accelerator {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.split_loggers           = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.status_code_retries     = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.status_code_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.timeout                 = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] cyborg.version                 = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.backend               = sqlalchemy {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.connection            = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.connection_debug      = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.connection_parameters =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.connection_recycle_time = 3600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.connection_trace      = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.db_inc_retry_interval = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.db_max_retries        = 20 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.db_max_retry_interval = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.db_retry_interval     = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.max_overflow          = 50 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.max_pool_size         = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.max_retries           = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.mysql_wsrep_sync_wait = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.pool_timeout          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.retry_interval        = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.slave_connection      = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] database.sqlite_synchronous    = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.backend           = sqlalchemy {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.connection        = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.connection_debug  = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.connection_parameters =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.connection_recycle_time = 3600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.connection_trace  = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.db_inc_retry_interval = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.db_max_retries    = 20 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.db_max_retry_interval = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.db_retry_interval = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.max_overflow      = 50 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.max_pool_size     = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.max_retries       = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.pool_timeout      = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.retry_interval    = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.slave_connection  = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] api_database.sqlite_synchronous = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] devices.enabled_mdev_types     = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ephemeral_storage_encryption.enabled = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.api_servers             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.cafile                  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.certfile                = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.collect_timing          = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.connect_retries         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.connect_retry_delay     = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.debug                   = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.default_trusted_certificate_ids = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.enable_certificate_validation = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.enable_rbd_download     = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.endpoint_override       = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.insecure                = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.keyfile                 = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.max_version             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.min_version             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.num_retries             = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.rbd_ceph_conf           =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.rbd_connect_timeout     = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.rbd_pool                =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.rbd_user                =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.region_name             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.service_name            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.service_type            = image {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.split_loggers           = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.status_code_retries     = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.status_code_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.timeout                 = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.verify_glance_signatures = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] glance.version                 = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] guestfs.debug                  = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.config_drive_cdrom      = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.config_drive_inject_password = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.enable_instance_metrics_collection = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.enable_remotefx         = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.instances_path_share    =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.iscsi_initiator_list    = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.limit_cpu_features      = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.power_state_check_timeframe = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.use_multipath_io        = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.volume_attach_retry_count = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.vswitch_name            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] mks.enabled                    = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] image_cache.manager_interval   = 2400 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] image_cache.precache_concurrency = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] image_cache.remove_unused_base_images = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] image_cache.subdirectory_name  = _base {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.api_max_retries         = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.api_retry_interval      = 2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.auth_section            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.auth_type               = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.cafile                  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.certfile                = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.collect_timing          = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.conductor_group         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.connect_retries         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.connect_retry_delay     = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.endpoint_override       = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.insecure                = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.keyfile                 = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.max_version             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.min_version             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.peer_list               = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.region_name             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.serial_console_state_timeout = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.service_name            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.service_type            = baremetal {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.split_loggers           = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.status_code_retries     = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.status_code_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.timeout                 = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ironic.version                 = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] key_manager.fixed_key          = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.barbican_api_version  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.barbican_endpoint     = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.barbican_endpoint_type = public {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.barbican_region_name  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.cafile                = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.certfile              = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.collect_timing        = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.insecure              = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.keyfile               = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.number_of_retries     = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.retry_delay           = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.send_service_user_token = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.split_loggers         = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.timeout               = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.verify_ssl            = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican.verify_ssl_path       = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican_service_user.auth_section = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican_service_user.auth_type = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican_service_user.cafile   = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican_service_user.certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican_service_user.collect_timing = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican_service_user.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican_service_user.keyfile  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican_service_user.split_loggers = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] barbican_service_user.timeout  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.approle_role_id          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.approle_secret_id        = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.cafile                   = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.certfile                 = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.collect_timing           = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.insecure                 = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.keyfile                  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.kv_mountpoint            = secret {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.kv_path                  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.kv_version               = 2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.namespace                = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.root_token_id            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.split_loggers            = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.ssl_ca_crt_file          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.timeout                  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.use_ssl                  = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.auth_section          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.auth_type             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.cafile                = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.certfile              = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.collect_timing        = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.connect_retries       = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.connect_retry_delay   = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.endpoint_override     = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.insecure              = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.keyfile               = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.max_version           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.min_version           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.region_name           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.service_name          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.service_type          = identity {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.split_loggers         = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.status_code_retries   = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.status_code_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.timeout               = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] keystone.version               = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.connection_uri         =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.cpu_mode               = custom {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: WARNING oslo_config.cfg [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.cpu_power_governor_high = performance {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.cpu_power_governor_low = powersave {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.cpu_power_management   = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.device_detach_attempts = 8 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.device_detach_timeout  = 20 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.disk_cachemodes        = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.disk_prefix            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.enabled_perf_events    = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.file_backed_memory     = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.gid_maps               = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.hw_disk_discard        = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.hw_machine_type        = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.images_rbd_glance_store_name =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.images_rbd_pool        = rbd {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.images_type            = default {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.images_volume_group    = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.inject_key             = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.inject_partition       = -2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.inject_password        = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.iscsi_iface            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.iser_use_multipath     = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.live_migration_bandwidth = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.live_migration_downtime = 500 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.live_migration_inbound_addr = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.live_migration_permit_post_copy = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.live_migration_scheme  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.live_migration_timeout_action = abort {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.live_migration_tunnelled = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: WARNING oslo_config.cfg [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Dec 06 06:54:53 user nova-compute[75021]: live_migration_uri is deprecated for removal in favor of two other options that
Dec 06 06:54:53 user nova-compute[75021]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Dec 06 06:54:53 user nova-compute[75021]: and ``live_migration_inbound_addr`` respectively.
Dec 06 06:54:53 user nova-compute[75021]: ).  Its value may be silently ignored in the future.
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.live_migration_with_native_tls = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.max_queues             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.migration_inbound_addr = 10.0.0.210 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.nfs_mount_options      = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.num_memory_encrypted_guests = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.num_pcie_ports         = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.pmem_namespaces        = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.quobyte_client_cfg     = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.rbd_secret_uuid        = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.rbd_user               = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.remote_filesystem_transport = ssh {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.rescue_image_id        = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.rescue_kernel_id       = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.rescue_ramdisk_id      = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.rx_queue_size          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.smbfs_mount_options    =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.snapshot_compression   = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.snapshot_image_format  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.sparse_logical_volumes = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.swtpm_enabled          = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.swtpm_group            = tss {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.swtpm_user             = tss {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.sysinfo_serial         = unique {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.tb_cache_size          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.tx_queue_size          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.uid_maps               = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.use_virtio_for_bridges = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.virt_type              = kvm {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.volume_clear           = zero {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.volume_clear_size      = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.volume_use_multipath   = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.vzstorage_cache_path   = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.vzstorage_mount_user   = stack {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.auth_section           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.auth_type              = password {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.cafile                 = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.certfile               = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.collect_timing         = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.connect_retries        = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.connect_retry_delay    = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.default_floating_pool  = public {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.endpoint_override      = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.extension_sync_interval = 600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.http_retries           = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.insecure               = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.keyfile                = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.max_version            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.min_version            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.ovs_bridge             = br-int {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.physnets               = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.region_name            = RegionOne {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.service_metadata_proxy = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.service_name           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.service_type           = network {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.split_loggers          = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.status_code_retries    = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.status_code_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.timeout                = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] neutron.version                = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] notifications.bdms_in_notifications = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] notifications.default_level    = INFO {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] notifications.notification_format = unversioned {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] notifications.notify_on_state_change = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] pci.alias                      = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] pci.device_spec                = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] pci.report_in_placement        = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.auth_section         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.auth_type            = password {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.cafile               = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.certfile             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.collect_timing       = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.connect_retries      = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.connect_retry_delay  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.default_domain_id    = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.default_domain_name  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.domain_id            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.domain_name          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.endpoint_override    = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.insecure             = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.keyfile              = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.max_version          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.min_version          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.password             = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.project_domain_id    = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.project_domain_name  = Default {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.project_id           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.project_name         = service {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.region_name          = RegionOne {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.service_name         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.service_type         = placement {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.split_loggers        = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.status_code_retries  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.status_code_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.system_scope         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.timeout              = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.trust_id             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.user_domain_id       = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.user_domain_name     = Default {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.user_id              = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.username             = placement {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] placement.version              = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] quota.cores                    = 20 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] quota.count_usage_from_placement = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] quota.injected_file_content_bytes = 10240 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] quota.injected_file_path_length = 255 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] quota.injected_files           = 5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] quota.instances                = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] quota.key_pairs                = 100 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] quota.metadata_items           = 128 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] quota.ram                      = 51200 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] quota.recheck_quota            = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] quota.server_group_members     = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] quota.server_groups            = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] rdp.enabled                    = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] scheduler.image_metadata_prefilter = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] scheduler.max_attempts         = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] scheduler.max_placement_results = 1000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] scheduler.query_placement_for_image_type_support = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] scheduler.workers              = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.host_subset_size = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.isolated_hosts = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.isolated_images = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.pci_in_placement = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.track_instance_changes = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] metrics.required               = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] metrics.weight_multiplier      = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] metrics.weight_setting         = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] serial_console.enabled         = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] serial_console.port_range      = 10000:20000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] serial_console.serialproxy_port = 6083 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] service_user.auth_section      = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] service_user.auth_type         = password {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] service_user.cafile            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] service_user.certfile          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] service_user.collect_timing    = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] service_user.insecure          = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] service_user.keyfile           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] service_user.send_service_user_token = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] service_user.split_loggers     = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] service_user.timeout           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] spice.agent_enabled            = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] spice.enabled                  = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] spice.html5proxy_port          = 6082 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] spice.image_compression        = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] spice.jpeg_compression         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] spice.playback_compression     = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] spice.server_listen            = 127.0.0.1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] spice.streaming_mode           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] spice.zlib_compression         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] upgrade_levels.baseapi         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] upgrade_levels.compute         = auto {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] upgrade_levels.conductor       = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] upgrade_levels.scheduler       = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vendordata_dynamic_auth.auth_section = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vendordata_dynamic_auth.auth_type = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vendordata_dynamic_auth.cafile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vendordata_dynamic_auth.certfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vendordata_dynamic_auth.insecure = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vendordata_dynamic_auth.keyfile = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vendordata_dynamic_auth.timeout = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.api_retry_count         = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.ca_file                 = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.cache_prefix            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.cluster_name            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.connection_pool_size    = 10 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.console_delay_seconds   = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.datastore_regex         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.host_ip                 = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.host_password           = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.host_port               = 443 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.host_username           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.insecure                = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.integration_bridge      = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.maximum_objects         = 100 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.pbm_default_policy      = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.pbm_enabled             = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.pbm_wsdl_location       = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.serial_port_proxy_uri   = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.serial_port_service_uri = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.task_poll_interval      = 0.5 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.use_linked_clone        = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.vnc_keymap              = en-us {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.vnc_port                = 5900 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vmware.vnc_port_total          = 10000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vnc.auth_schemes               = ['none'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vnc.enabled                    = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vnc.novncproxy_port            = 6080 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vnc.server_listen              = 0.0.0.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vnc.vencrypt_ca_certs          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vnc.vencrypt_client_cert       = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vnc.vencrypt_client_key        = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.disable_rootwrap   = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.enable_numa_live_migration = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.libvirt_disable_apic = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] wsgi.client_socket_timeout     = 900 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] wsgi.default_pool_size         = 1000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] wsgi.keep_alive                = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] wsgi.max_header_line           = 16384 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] wsgi.ssl_ca_file               = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] wsgi.ssl_cert_file             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] wsgi.ssl_key_file              = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] wsgi.tcp_keepidle              = 600 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] zvm.ca_file                    = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] zvm.cloud_connector_url        = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] zvm.reachable_timeout          = 300 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_policy.enforce_new_defaults = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_policy.enforce_scope      = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_policy.policy_default_rule = default {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_policy.policy_file        = policy.yaml {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] profiler.connection_string     = messaging:// {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] profiler.enabled               = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] profiler.es_doc_type           = notification {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] profiler.es_scroll_size        = 10000 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] profiler.es_scroll_time        = 2m {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] profiler.filter_error_trace    = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] profiler.hmac_keys             = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] profiler.sentinel_service_name = mymaster {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] profiler.socket_timeout        = 0.1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] profiler.trace_requests        = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] profiler.trace_sqlalchemy      = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] profiler_jaeger.process_tags   = {} {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] profiler_jaeger.service_name_prefix = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] profiler_otlp.service_name_prefix = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] remote_debug.host              = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] remote_debug.port              = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.ssl      = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_notifications.retry = -1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.auth_section        = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.auth_type           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.cafile              = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.certfile            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.collect_timing      = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.connect_retries     = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.connect_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.endpoint_id         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.endpoint_override   = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.insecure            = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.keyfile             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.max_version         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.min_version         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.region_name         = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.service_name        = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.service_type        = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.split_loggers       = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.status_code_retries = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.status_code_retry_delay = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.timeout             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.valid_interfaces    = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_limit.version             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_reports.file_event_handler = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] oslo_reports.log_dir           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vif_plug_ovs_privileged.group  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] vif_plug_ovs_privileged.user   = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_vif_linux_bridge.flat_interface = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_vif_ovs.isolate_vif         = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_vif_ovs.per_port_bridge     = False {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] os_brick.lock_path             = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] privsep_osbrick.capabilities   = [21] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] privsep_osbrick.group          = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] privsep_osbrick.helper_command = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] privsep_osbrick.user           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] nova_sys_admin.group           = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] nova_sys_admin.helper_command  = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] nova_sys_admin.user            = None {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG oslo_service.service [None req-8aa49b23-250e-44b1-8c6a-fb1198f9fc1a None None] ******************************************************************************** {{(pid=75021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Dec 06 06:54:53 user nova-compute[75021]: INFO nova.service [-] Starting compute node (version 0.0.0)
Dec 06 06:54:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Connecting to libvirt: qemu:///system {{(pid=75021) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f89f9216530> {{(pid=75021) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Dec 06 06:54:53 user nova-compute[75021]: libvirt:  error : internal error: could not initialize domain event timer
Dec 06 06:54:53 user nova-compute[75021]: WARNING nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Dec 06 06:54:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f89f9216530> {{(pid=75021) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Starting native event thread {{(pid=75021) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Starting green dispatch thread {{(pid=75021) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Dec 06 06:54:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Starting connection event dispatch thread {{(pid=75021) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Dec 06 06:54:53 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Connection event '1' reason 'None'
Dec 06 06:54:53 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 06 06:54:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.mount [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Initialising _HostMountState generation 0 {{(pid=75021) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Dec 06 06:55:00 user nova-compute[75021]: INFO nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Libvirt host capabilities <capabilities>
Dec 06 06:55:00 user nova-compute[75021]:   <host>
Dec 06 06:55:00 user nova-compute[75021]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Dec 06 06:55:00 user nova-compute[75021]:     <cpu>
Dec 06 06:55:00 user nova-compute[75021]:       <arch>x86_64</arch>
Dec 06 06:55:00 user nova-compute[75021]:       <model>IvyBridge-IBRS</model>
Dec 06 06:55:00 user nova-compute[75021]:       <vendor>Intel</vendor>
Dec 06 06:55:00 user nova-compute[75021]:       <microcode version='1070'/>
Dec 06 06:55:00 user nova-compute[75021]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Dec 06 06:55:00 user nova-compute[75021]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Dec 06 06:55:00 user nova-compute[75021]:       <feature name='ss'/>
Dec 06 06:55:00 user nova-compute[75021]:       <feature name='vmx'/>
Dec 06 06:55:00 user nova-compute[75021]:       <feature name='pcid'/>
Dec 06 06:55:00 user nova-compute[75021]:       <feature name='osxsave'/>
Dec 06 06:55:00 user nova-compute[75021]:       <feature name='hypervisor'/>
Dec 06 06:55:00 user nova-compute[75021]:       <feature name='arat'/>
Dec 06 06:55:00 user nova-compute[75021]:       <feature name='tsc_adjust'/>
Dec 06 06:55:00 user nova-compute[75021]:       <feature name='md-clear'/>
Dec 06 06:55:00 user nova-compute[75021]:       <feature name='stibp'/>
Dec 06 06:55:00 user nova-compute[75021]:       <feature name='arch-capabilities'/>
Dec 06 06:55:00 user nova-compute[75021]:       <feature name='ssbd'/>
Dec 06 06:55:00 user nova-compute[75021]:       <feature name='invtsc'/>
Dec 06 06:55:00 user nova-compute[75021]:       <feature name='rsba'/>
Dec 06 06:55:00 user nova-compute[75021]:       <feature name='skip-l1dfl-vmentry'/>
Dec 06 06:55:00 user nova-compute[75021]:       <pages unit='KiB' size='4'/>
Dec 06 06:55:00 user nova-compute[75021]:       <pages unit='KiB' size='2048'/>
Dec 06 06:55:00 user nova-compute[75021]:     </cpu>
Dec 06 06:55:00 user nova-compute[75021]:     <power_management>
Dec 06 06:55:00 user nova-compute[75021]:       <suspend_mem/>
Dec 06 06:55:00 user nova-compute[75021]:       <suspend_disk/>
Dec 06 06:55:00 user nova-compute[75021]:       <suspend_hybrid/>
Dec 06 06:55:00 user nova-compute[75021]:     </power_management>
Dec 06 06:55:00 user nova-compute[75021]:     <iommu support='no'/>
Dec 06 06:55:00 user nova-compute[75021]:     <migration_features>
Dec 06 06:55:00 user nova-compute[75021]:       <live/>
Dec 06 06:55:00 user nova-compute[75021]:       <uri_transports>
Dec 06 06:55:00 user nova-compute[75021]:         <uri_transport>tcp</uri_transport>
Dec 06 06:55:00 user nova-compute[75021]:         <uri_transport>rdma</uri_transport>
Dec 06 06:55:00 user nova-compute[75021]:       </uri_transports>
Dec 06 06:55:00 user nova-compute[75021]:     </migration_features>
Dec 06 06:55:00 user nova-compute[75021]:     <topology>
Dec 06 06:55:00 user nova-compute[75021]:       <cells num='2'>
Dec 06 06:55:00 user nova-compute[75021]:         <cell id='0'>
Dec 06 06:55:00 user nova-compute[75021]:           <memory unit='KiB'>8140616</memory>
Dec 06 06:55:00 user nova-compute[75021]:           <pages unit='KiB' size='4'>2035154</pages>
Dec 06 06:55:00 user nova-compute[75021]:           <pages unit='KiB' size='2048'>0</pages>
Dec 06 06:55:00 user nova-compute[75021]:           <distances>
Dec 06 06:55:00 user nova-compute[75021]:             <sibling id='0' value='10'/>
Dec 06 06:55:00 user nova-compute[75021]:             <sibling id='1' value='20'/>
Dec 06 06:55:00 user nova-compute[75021]:           </distances>
Dec 06 06:55:00 user nova-compute[75021]:           <cpus num='6'>
Dec 06 06:55:00 user nova-compute[75021]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Dec 06 06:55:00 user nova-compute[75021]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Dec 06 06:55:00 user nova-compute[75021]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Dec 06 06:55:00 user nova-compute[75021]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Dec 06 06:55:00 user nova-compute[75021]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Dec 06 06:55:00 user nova-compute[75021]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Dec 06 06:55:00 user nova-compute[75021]:           </cpus>
Dec 06 06:55:00 user nova-compute[75021]:         </cell>
Dec 06 06:55:00 user nova-compute[75021]:         <cell id='1'>
Dec 06 06:55:00 user nova-compute[75021]:           <memory unit='KiB'>8255068</memory>
Dec 06 06:55:00 user nova-compute[75021]:           <pages unit='KiB' size='4'>2063767</pages>
Dec 06 06:55:00 user nova-compute[75021]:           <pages unit='KiB' size='2048'>0</pages>
Dec 06 06:55:00 user nova-compute[75021]:           <distances>
Dec 06 06:55:00 user nova-compute[75021]:             <sibling id='0' value='20'/>
Dec 06 06:55:00 user nova-compute[75021]:             <sibling id='1' value='10'/>
Dec 06 06:55:00 user nova-compute[75021]:           </distances>
Dec 06 06:55:00 user nova-compute[75021]:           <cpus num='6'>
Dec 06 06:55:00 user nova-compute[75021]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Dec 06 06:55:00 user nova-compute[75021]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Dec 06 06:55:00 user nova-compute[75021]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Dec 06 06:55:00 user nova-compute[75021]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Dec 06 06:55:00 user nova-compute[75021]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Dec 06 06:55:00 user nova-compute[75021]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Dec 06 06:55:00 user nova-compute[75021]:           </cpus>
Dec 06 06:55:00 user nova-compute[75021]:         </cell>
Dec 06 06:55:00 user nova-compute[75021]:       </cells>
Dec 06 06:55:00 user nova-compute[75021]:     </topology>
Dec 06 06:55:00 user nova-compute[75021]:     <cache>
Dec 06 06:55:00 user nova-compute[75021]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Dec 06 06:55:00 user nova-compute[75021]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Dec 06 06:55:00 user nova-compute[75021]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Dec 06 06:55:00 user nova-compute[75021]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Dec 06 06:55:00 user nova-compute[75021]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Dec 06 06:55:00 user nova-compute[75021]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Dec 06 06:55:00 user nova-compute[75021]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Dec 06 06:55:00 user nova-compute[75021]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Dec 06 06:55:00 user nova-compute[75021]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Dec 06 06:55:00 user nova-compute[75021]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Dec 06 06:55:00 user nova-compute[75021]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Dec 06 06:55:00 user nova-compute[75021]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Dec 06 06:55:00 user nova-compute[75021]:     </cache>
Dec 06 06:55:00 user nova-compute[75021]:     <secmodel>
Dec 06 06:55:00 user nova-compute[75021]:       <model>apparmor</model>
Dec 06 06:55:00 user nova-compute[75021]:       <doi>0</doi>
Dec 06 06:55:00 user nova-compute[75021]:     </secmodel>
Dec 06 06:55:00 user nova-compute[75021]:     <secmodel>
Dec 06 06:55:00 user nova-compute[75021]:       <model>dac</model>
Dec 06 06:55:00 user nova-compute[75021]:       <doi>0</doi>
Dec 06 06:55:00 user nova-compute[75021]:       <baselabel type='kvm'>+64055:+108</baselabel>
Dec 06 06:55:00 user nova-compute[75021]:       <baselabel type='qemu'>+64055:+108</baselabel>
Dec 06 06:55:00 user nova-compute[75021]:     </secmodel>
Dec 06 06:55:00 user nova-compute[75021]:   </host>
Dec 06 06:55:00 user nova-compute[75021]:   <guest>
Dec 06 06:55:00 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:00 user nova-compute[75021]:     <arch name='alpha'>
Dec 06 06:55:00 user nova-compute[75021]:       <wordsize>64</wordsize>
Dec 06 06:55:00 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>clipper</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:00 user nova-compute[75021]:     </arch>
Dec 06 06:55:00 user nova-compute[75021]:     <features>
Dec 06 06:55:00 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:00 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:00 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:00 user nova-compute[75021]:     </features>
Dec 06 06:55:00 user nova-compute[75021]:   </guest>
Dec 06 06:55:00 user nova-compute[75021]:   <guest>
Dec 06 06:55:00 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:00 user nova-compute[75021]:     <arch name='armv6l'>
Dec 06 06:55:00 user nova-compute[75021]:       <wordsize>32</wordsize>
Dec 06 06:55:00 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>integratorcp</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>borzoi</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>spitz</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>nuri</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>musca-b1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>versatileab</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>kzm</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>musca-a</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>smdkc210</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>sx1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>z2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>tosa</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>sabrelite</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>realview-eb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>n810</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>n800</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>versatilepb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>terrier</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mainstone</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>midway</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>musicpal</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>microbit</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>cubieboard</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>verdex</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>netduino2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>raspi2b</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>cheetah</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>highbank</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>akita</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>connex</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>collie</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>raspi0</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:00 user nova-compute[75021]:     </arch>
Dec 06 06:55:00 user nova-compute[75021]:     <features>
Dec 06 06:55:00 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:00 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:00 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:00 user nova-compute[75021]:     </features>
Dec 06 06:55:00 user nova-compute[75021]:   </guest>
Dec 06 06:55:00 user nova-compute[75021]:   <guest>
Dec 06 06:55:00 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:00 user nova-compute[75021]:     <arch name='armv7l'>
Dec 06 06:55:00 user nova-compute[75021]:       <wordsize>32</wordsize>
Dec 06 06:55:00 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>integratorcp</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>borzoi</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>spitz</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>nuri</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>musca-b1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>versatileab</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>kzm</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>musca-a</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>smdkc210</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>sx1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>z2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>tosa</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>sabrelite</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>realview-eb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>n810</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>n800</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>versatilepb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>terrier</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mainstone</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>midway</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>musicpal</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>microbit</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>cubieboard</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>verdex</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>netduino2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>raspi2b</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>cheetah</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>highbank</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>akita</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>connex</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>collie</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>raspi0</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:00 user nova-compute[75021]:     </arch>
Dec 06 06:55:00 user nova-compute[75021]:     <features>
Dec 06 06:55:00 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:00 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:00 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:00 user nova-compute[75021]:     </features>
Dec 06 06:55:00 user nova-compute[75021]:   </guest>
Dec 06 06:55:00 user nova-compute[75021]:   <guest>
Dec 06 06:55:00 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:00 user nova-compute[75021]:     <arch name='aarch64'>
Dec 06 06:55:00 user nova-compute[75021]:       <wordsize>64</wordsize>
Dec 06 06:55:00 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>integratorcp</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>borzoi</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>spitz</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>nuri</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>musca-b1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>versatileab</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>kzm</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>musca-a</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='2'>smdkc210</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>sx1</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>z2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>tosa</machine>
Dec 06 06:55:00 user nova-compute[75021]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='4'>sabrelite</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>realview-eb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='512'>sbsa-ref</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>n810</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>n800</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>versatilepb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>terrier</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>mainstone</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='4'>midway</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>musicpal</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>microbit</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='4'>raspi3ap</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>cubieboard</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>verdex</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>netduino2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='4'>raspi3b</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='4'>raspi2b</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>cheetah</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='4'>highbank</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>akita</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>connex</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>collie</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>raspi0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <acpi default='on' toggle='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='cris'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>32</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>axis-dev88</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='i686'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>32</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>x-remote</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>isapc</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>microvm</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='kvm'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <pae/>
Dec 06 06:55:01 user nova-compute[75021]:       <nonpae/>
Dec 06 06:55:01 user nova-compute[75021]:       <acpi default='on' toggle='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:       <apic default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='m68k'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>32</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>mcf5208evb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>an5206</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>virt-6.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>q800</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>virt-6.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>next-cube</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>virt-6.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='microblaze'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>32</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='microblazeel'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>32</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='mips'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>32</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='16'>malta</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>mipssim</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='mipsel'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>32</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='16'>malta</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>mipssim</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='mips64'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>64</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='16'>malta</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>mipssim</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>pica61</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>magnum</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='mips64el'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>64</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='16'>malta</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='16'>loongson3-virt</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>mipssim</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>pica61</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>magnum</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='16'>boston</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>fuloong2e</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='ppc'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>32</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>g3beige</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>mac99</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>ppce500</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>pegasos2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>sam460ex</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>bamboo</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>40p</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>ref405ep</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>taihu</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='ppc64'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>64</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2048'>powernv9</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>taihu</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2048'>powernv10</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>ppce500</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>40p</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>pegasos2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>bamboo</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>g3beige</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>mac99</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>sam460ex</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>ref405ep</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2048'>powernv8</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='ppc64le'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>64</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2048'>powernv9</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>taihu</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2048'>powernv10</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>ppce500</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>40p</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>pegasos2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>bamboo</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>g3beige</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>mac99</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>sam460ex</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>ref405ep</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2048'>powernv8</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='riscv32'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>32</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='8'>spike</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>opentitan</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='5'>sifive_u</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>sifive_e</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='8'>virt</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='riscv64'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>64</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='8'>spike</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='5'>sifive_u</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>shakti_c</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>sifive_e</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='8'>virt</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='s390x'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>64</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='sh4'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>32</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>shix</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>r2d</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='sh4eb'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>64</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>shix</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>r2d</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='sparc'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>32</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>SS-5</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='4'>SS-20</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>LX</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>SPARCClassic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>leon3_generic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>SPARCbook</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>SS-4</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='4'>SS-600MP</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='4'>SS-10</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>Voyager</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='sparc64'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>64</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>sun4u</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>niagara</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>sun4v</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='x86_64'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>64</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>x-remote</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='1'>isapc</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>microvm</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='kvm'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <acpi default='on' toggle='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:       <apic default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='xtensa'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>32</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='4'>sim</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>kc705</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>ml605</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>virt</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>lx200</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>lx60</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]:   <guest>
Dec 06 06:55:01 user nova-compute[75021]:     <os_type>hvm</os_type>
Dec 06 06:55:01 user nova-compute[75021]:     <arch name='xtensaeb'>
Dec 06 06:55:01 user nova-compute[75021]:       <wordsize>32</wordsize>
Dec 06 06:55:01 user nova-compute[75021]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='4'>sim</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>kc705</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>ml605</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>virt</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>lx200</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>lx60</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 06 06:55:01 user nova-compute[75021]:       <domain type='qemu'/>
Dec 06 06:55:01 user nova-compute[75021]:     </arch>
Dec 06 06:55:01 user nova-compute[75021]:     <features>
Dec 06 06:55:01 user nova-compute[75021]:       <cpuselection/>
Dec 06 06:55:01 user nova-compute[75021]:       <deviceboot/>
Dec 06 06:55:01 user nova-compute[75021]:       <disksnapshot default='on' toggle='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     </features>
Dec 06 06:55:01 user nova-compute[75021]:   </guest>
Dec 06 06:55:01 user nova-compute[75021]: </capabilities>
Dec 06 06:55:01 user nova-compute[75021]: 
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Dec 06 06:55:01 user nova-compute[75021]: <domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:   <path>/usr/bin/qemu-system-i386</path>
Dec 06 06:55:01 user nova-compute[75021]:   <domain>kvm</domain>
Dec 06 06:55:01 user nova-compute[75021]:   <machine>pc-i440fx-6.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:   <arch>i686</arch>
Dec 06 06:55:01 user nova-compute[75021]:   <vcpu max='255'/>
Dec 06 06:55:01 user nova-compute[75021]:   <iothreads supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:   <os supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='firmware'/>
Dec 06 06:55:01 user nova-compute[75021]:     <loader supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>rom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pflash</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='readonly'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>yes</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='secure'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </loader>
Dec 06 06:55:01 user nova-compute[75021]:   </os>
Dec 06 06:55:01 user nova-compute[75021]:   <cpu>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-passthrough' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='hostPassthroughMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='maximum' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='maximumMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>on</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-model' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <vendor>Intel</vendor>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ss'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='vmx'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='pcid'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='hypervisor'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arat'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='umip'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='md-clear'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibpb'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibrs'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='erms'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='lm'/>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='custom' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>qemu64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>qemu32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>phenom</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>n270</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>kvm64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>kvm32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>coreduo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>core2duo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>athlon</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Westmere-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Westmere</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Snowridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Penryn</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G5</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G4</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G1</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Nehalem-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Nehalem</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Rome</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Milan</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Dhyana</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cooperlake</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Conroe</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>486</model>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:   </cpu>
Dec 06 06:55:01 user nova-compute[75021]:   <memoryBacking supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='sourceType'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>file</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>anonymous</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>memfd</value>
Dec 06 06:55:01 user nova-compute[75021]:     </enum>
Dec 06 06:55:01 user nova-compute[75021]:   </memoryBacking>
Dec 06 06:55:01 user nova-compute[75021]:   <devices>
Dec 06 06:55:01 user nova-compute[75021]:     <disk supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='diskDevice'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>disk</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cdrom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>floppy</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>lun</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='bus'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>ide</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>fdc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sata</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </disk>
Dec 06 06:55:01 user nova-compute[75021]:     <graphics supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sdl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vnc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>spice</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egl-headless</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </graphics>
Dec 06 06:55:01 user nova-compute[75021]:     <video supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='modelType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cirrus</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vmvga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>qxl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>none</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>bochs</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>ramfb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </video>
Dec 06 06:55:01 user nova-compute[75021]:     <hostdev supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='mode'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>subsystem</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='startupPolicy'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>default</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>mandatory</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>requisite</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>optional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='subsysType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pci</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='capsType'/>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='pciBackend'/>
Dec 06 06:55:01 user nova-compute[75021]:     </hostdev>
Dec 06 06:55:01 user nova-compute[75021]:     <rng supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>random</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egd</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>builtin</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </rng>
Dec 06 06:55:01 user nova-compute[75021]:     <filesystem supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='driverType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>path</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>handle</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtiofs</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </filesystem>
Dec 06 06:55:01 user nova-compute[75021]:     <tpm supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-tis</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-crb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>passthrough</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>emulator</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </tpm>
Dec 06 06:55:01 user nova-compute[75021]:   </devices>
Dec 06 06:55:01 user nova-compute[75021]:   <features>
Dec 06 06:55:01 user nova-compute[75021]:     <gic supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     <vmcoreinfo supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <genid supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backingStoreInput supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backup supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <sev supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:   </features>
Dec 06 06:55:01 user nova-compute[75021]: </domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:  {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Dec 06 06:55:01 user nova-compute[75021]: <domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:   <path>/usr/bin/qemu-system-i386</path>
Dec 06 06:55:01 user nova-compute[75021]:   <domain>kvm</domain>
Dec 06 06:55:01 user nova-compute[75021]:   <machine>pc-i440fx-jammy</machine>
Dec 06 06:55:01 user nova-compute[75021]:   <arch>i686</arch>
Dec 06 06:55:01 user nova-compute[75021]:   <vcpu max='255'/>
Dec 06 06:55:01 user nova-compute[75021]:   <iothreads supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:   <os supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='firmware'/>
Dec 06 06:55:01 user nova-compute[75021]:     <loader supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>rom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pflash</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='readonly'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>yes</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='secure'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </loader>
Dec 06 06:55:01 user nova-compute[75021]:   </os>
Dec 06 06:55:01 user nova-compute[75021]:   <cpu>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-passthrough' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='hostPassthroughMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='maximum' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='maximumMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>on</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-model' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <vendor>Intel</vendor>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ss'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='vmx'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='pcid'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='hypervisor'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arat'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='umip'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='md-clear'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibpb'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibrs'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='erms'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='lm'/>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='custom' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>qemu64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>qemu32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>phenom</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>n270</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>kvm64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>kvm32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>coreduo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>core2duo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>athlon</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Westmere-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Westmere</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Snowridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Penryn</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G5</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G4</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G1</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Nehalem-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Nehalem</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Rome</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Milan</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Dhyana</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cooperlake</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Conroe</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>486</model>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:   </cpu>
Dec 06 06:55:01 user nova-compute[75021]:   <memoryBacking supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='sourceType'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>file</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>anonymous</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>memfd</value>
Dec 06 06:55:01 user nova-compute[75021]:     </enum>
Dec 06 06:55:01 user nova-compute[75021]:   </memoryBacking>
Dec 06 06:55:01 user nova-compute[75021]:   <devices>
Dec 06 06:55:01 user nova-compute[75021]:     <disk supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='diskDevice'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>disk</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cdrom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>floppy</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>lun</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='bus'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>ide</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>fdc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sata</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </disk>
Dec 06 06:55:01 user nova-compute[75021]:     <graphics supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sdl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vnc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>spice</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egl-headless</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </graphics>
Dec 06 06:55:01 user nova-compute[75021]:     <video supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='modelType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cirrus</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vmvga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>qxl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>none</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>bochs</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>ramfb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </video>
Dec 06 06:55:01 user nova-compute[75021]:     <hostdev supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='mode'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>subsystem</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='startupPolicy'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>default</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>mandatory</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>requisite</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>optional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='subsysType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pci</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='capsType'/>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='pciBackend'/>
Dec 06 06:55:01 user nova-compute[75021]:     </hostdev>
Dec 06 06:55:01 user nova-compute[75021]:     <rng supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>random</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egd</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>builtin</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </rng>
Dec 06 06:55:01 user nova-compute[75021]:     <filesystem supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='driverType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>path</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>handle</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtiofs</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </filesystem>
Dec 06 06:55:01 user nova-compute[75021]:     <tpm supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-tis</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-crb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>passthrough</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>emulator</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </tpm>
Dec 06 06:55:01 user nova-compute[75021]:   </devices>
Dec 06 06:55:01 user nova-compute[75021]:   <features>
Dec 06 06:55:01 user nova-compute[75021]:     <gic supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     <vmcoreinfo supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <genid supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backingStoreInput supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backup supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <sev supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:   </features>
Dec 06 06:55:01 user nova-compute[75021]: </domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:  {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Dec 06 06:55:01 user nova-compute[75021]: <domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:   <path>/usr/bin/qemu-system-i386</path>
Dec 06 06:55:01 user nova-compute[75021]:   <domain>kvm</domain>
Dec 06 06:55:01 user nova-compute[75021]:   <machine>pc-q35-6.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:   <arch>i686</arch>
Dec 06 06:55:01 user nova-compute[75021]:   <vcpu max='288'/>
Dec 06 06:55:01 user nova-compute[75021]:   <iothreads supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:   <os supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='firmware'/>
Dec 06 06:55:01 user nova-compute[75021]:     <loader supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>rom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pflash</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='readonly'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>yes</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='secure'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </loader>
Dec 06 06:55:01 user nova-compute[75021]:   </os>
Dec 06 06:55:01 user nova-compute[75021]:   <cpu>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-passthrough' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='hostPassthroughMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='maximum' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='maximumMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>on</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-model' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <vendor>Intel</vendor>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ss'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='vmx'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='pcid'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='hypervisor'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arat'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='umip'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='md-clear'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibpb'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibrs'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='erms'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='lm'/>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='custom' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>qemu64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>qemu32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>phenom</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>n270</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>kvm64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>kvm32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>coreduo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>core2duo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>athlon</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Westmere-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Westmere</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Snowridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Penryn</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G5</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G4</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G1</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Nehalem-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Nehalem</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Rome</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Milan</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Dhyana</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cooperlake</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Conroe</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>486</model>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:   </cpu>
Dec 06 06:55:01 user nova-compute[75021]:   <memoryBacking supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='sourceType'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>file</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>anonymous</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>memfd</value>
Dec 06 06:55:01 user nova-compute[75021]:     </enum>
Dec 06 06:55:01 user nova-compute[75021]:   </memoryBacking>
Dec 06 06:55:01 user nova-compute[75021]:   <devices>
Dec 06 06:55:01 user nova-compute[75021]:     <disk supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='diskDevice'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>disk</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cdrom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>floppy</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>lun</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='bus'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>fdc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sata</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </disk>
Dec 06 06:55:01 user nova-compute[75021]:     <graphics supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sdl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vnc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>spice</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egl-headless</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </graphics>
Dec 06 06:55:01 user nova-compute[75021]:     <video supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='modelType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cirrus</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vmvga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>qxl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>none</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>bochs</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>ramfb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </video>
Dec 06 06:55:01 user nova-compute[75021]:     <hostdev supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='mode'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>subsystem</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='startupPolicy'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>default</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>mandatory</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>requisite</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>optional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='subsysType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pci</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='capsType'/>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='pciBackend'/>
Dec 06 06:55:01 user nova-compute[75021]:     </hostdev>
Dec 06 06:55:01 user nova-compute[75021]:     <rng supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>random</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egd</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>builtin</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </rng>
Dec 06 06:55:01 user nova-compute[75021]:     <filesystem supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='driverType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>path</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>handle</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtiofs</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </filesystem>
Dec 06 06:55:01 user nova-compute[75021]:     <tpm supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-tis</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-crb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>passthrough</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>emulator</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </tpm>
Dec 06 06:55:01 user nova-compute[75021]:   </devices>
Dec 06 06:55:01 user nova-compute[75021]:   <features>
Dec 06 06:55:01 user nova-compute[75021]:     <gic supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     <vmcoreinfo supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <genid supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backingStoreInput supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backup supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <sev supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:   </features>
Dec 06 06:55:01 user nova-compute[75021]: </domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:  {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Dec 06 06:55:01 user nova-compute[75021]: <domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:   <path>/usr/bin/qemu-system-i386</path>
Dec 06 06:55:01 user nova-compute[75021]:   <domain>kvm</domain>
Dec 06 06:55:01 user nova-compute[75021]:   <machine>pc-q35-jammy</machine>
Dec 06 06:55:01 user nova-compute[75021]:   <arch>i686</arch>
Dec 06 06:55:01 user nova-compute[75021]:   <vcpu max='288'/>
Dec 06 06:55:01 user nova-compute[75021]:   <iothreads supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:   <os supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='firmware'/>
Dec 06 06:55:01 user nova-compute[75021]:     <loader supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>rom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pflash</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='readonly'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>yes</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='secure'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </loader>
Dec 06 06:55:01 user nova-compute[75021]:   </os>
Dec 06 06:55:01 user nova-compute[75021]:   <cpu>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-passthrough' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='hostPassthroughMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='maximum' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='maximumMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>on</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-model' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <vendor>Intel</vendor>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ss'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='vmx'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='pcid'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='hypervisor'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arat'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='umip'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='md-clear'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibpb'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibrs'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='erms'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='lm'/>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='custom' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>qemu64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>qemu32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>phenom</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>n270</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>kvm64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>kvm32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>coreduo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>core2duo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>athlon</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Westmere-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Westmere</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Snowridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Penryn</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G5</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G4</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G1</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Nehalem-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Nehalem</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Rome</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Milan</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Dhyana</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cooperlake</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Conroe</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>486</model>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:   </cpu>
Dec 06 06:55:01 user nova-compute[75021]:   <memoryBacking supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='sourceType'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>file</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>anonymous</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>memfd</value>
Dec 06 06:55:01 user nova-compute[75021]:     </enum>
Dec 06 06:55:01 user nova-compute[75021]:   </memoryBacking>
Dec 06 06:55:01 user nova-compute[75021]:   <devices>
Dec 06 06:55:01 user nova-compute[75021]:     <disk supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='diskDevice'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>disk</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cdrom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>floppy</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>lun</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='bus'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>fdc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sata</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </disk>
Dec 06 06:55:01 user nova-compute[75021]:     <graphics supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sdl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vnc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>spice</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egl-headless</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </graphics>
Dec 06 06:55:01 user nova-compute[75021]:     <video supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='modelType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cirrus</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vmvga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>qxl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>none</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>bochs</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>ramfb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </video>
Dec 06 06:55:01 user nova-compute[75021]:     <hostdev supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='mode'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>subsystem</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='startupPolicy'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>default</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>mandatory</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>requisite</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>optional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='subsysType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pci</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='capsType'/>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='pciBackend'/>
Dec 06 06:55:01 user nova-compute[75021]:     </hostdev>
Dec 06 06:55:01 user nova-compute[75021]:     <rng supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>random</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egd</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>builtin</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </rng>
Dec 06 06:55:01 user nova-compute[75021]:     <filesystem supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='driverType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>path</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>handle</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtiofs</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </filesystem>
Dec 06 06:55:01 user nova-compute[75021]:     <tpm supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-tis</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-crb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>passthrough</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>emulator</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </tpm>
Dec 06 06:55:01 user nova-compute[75021]:   </devices>
Dec 06 06:55:01 user nova-compute[75021]:   <features>
Dec 06 06:55:01 user nova-compute[75021]:     <gic supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     <vmcoreinfo supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <genid supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backingStoreInput supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backup supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <sev supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:   </features>
Dec 06 06:55:01 user nova-compute[75021]: </domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:  {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Dec 06 06:55:01 user nova-compute[75021]: <domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 06 06:55:01 user nova-compute[75021]:   <domain>kvm</domain>
Dec 06 06:55:01 user nova-compute[75021]:   <machine>pc-i440fx-6.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:   <arch>x86_64</arch>
Dec 06 06:55:01 user nova-compute[75021]:   <vcpu max='255'/>
Dec 06 06:55:01 user nova-compute[75021]:   <iothreads supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:   <os supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='firmware'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>efi</value>
Dec 06 06:55:01 user nova-compute[75021]:     </enum>
Dec 06 06:55:01 user nova-compute[75021]:     <loader supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>rom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pflash</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='readonly'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>yes</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='secure'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </loader>
Dec 06 06:55:01 user nova-compute[75021]:   </os>
Dec 06 06:55:01 user nova-compute[75021]:   <cpu>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-passthrough' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='hostPassthroughMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>on</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='maximum' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='maximumMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>on</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-model' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <vendor>Intel</vendor>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ss'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='vmx'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='pcid'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='hypervisor'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arat'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='umip'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='md-clear'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='invtsc'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibpb'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibrs'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='rsba'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='pschange-mc-no'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='erms'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='custom' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>qemu64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>qemu32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>phenom</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>n270</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>kvm64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>kvm32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>coreduo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>core2duo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>athlon</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Westmere-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Westmere</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Snowridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Penryn</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G5</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G4</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Opteron_G1</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Nehalem</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Rome</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Milan</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Dhyana</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cooperlake</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Conroe</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>486</model>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:   </cpu>
Dec 06 06:55:01 user nova-compute[75021]:   <memoryBacking supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='sourceType'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>file</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>anonymous</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>memfd</value>
Dec 06 06:55:01 user nova-compute[75021]:     </enum>
Dec 06 06:55:01 user nova-compute[75021]:   </memoryBacking>
Dec 06 06:55:01 user nova-compute[75021]:   <devices>
Dec 06 06:55:01 user nova-compute[75021]:     <disk supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='diskDevice'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>disk</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cdrom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>floppy</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>lun</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='bus'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>ide</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>fdc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sata</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </disk>
Dec 06 06:55:01 user nova-compute[75021]:     <graphics supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sdl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vnc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>spice</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egl-headless</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </graphics>
Dec 06 06:55:01 user nova-compute[75021]:     <video supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='modelType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cirrus</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vmvga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>qxl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>none</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>bochs</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>ramfb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </video>
Dec 06 06:55:01 user nova-compute[75021]:     <hostdev supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='mode'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>subsystem</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='startupPolicy'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>default</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>mandatory</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>requisite</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>optional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='subsysType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pci</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='capsType'/>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='pciBackend'/>
Dec 06 06:55:01 user nova-compute[75021]:     </hostdev>
Dec 06 06:55:01 user nova-compute[75021]:     <rng supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>random</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egd</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>builtin</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </rng>
Dec 06 06:55:01 user nova-compute[75021]:     <filesystem supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='driverType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>path</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>handle</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtiofs</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </filesystem>
Dec 06 06:55:01 user nova-compute[75021]:     <tpm supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-tis</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-crb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>passthrough</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>emulator</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </tpm>
Dec 06 06:55:01 user nova-compute[75021]:   </devices>
Dec 06 06:55:01 user nova-compute[75021]:   <features>
Dec 06 06:55:01 user nova-compute[75021]:     <gic supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     <vmcoreinfo supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <genid supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backingStoreInput supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backup supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <sev supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:   </features>
Dec 06 06:55:01 user nova-compute[75021]: </domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:  {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Dec 06 06:55:01 user nova-compute[75021]: <domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 06 06:55:01 user nova-compute[75021]:   <domain>kvm</domain>
Dec 06 06:55:01 user nova-compute[75021]:   <machine>pc-i440fx-jammy</machine>
Dec 06 06:55:01 user nova-compute[75021]:   <arch>x86_64</arch>
Dec 06 06:55:01 user nova-compute[75021]:   <vcpu max='255'/>
Dec 06 06:55:01 user nova-compute[75021]:   <iothreads supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:   <os supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='firmware'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>efi</value>
Dec 06 06:55:01 user nova-compute[75021]:     </enum>
Dec 06 06:55:01 user nova-compute[75021]:     <loader supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>rom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pflash</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='readonly'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>yes</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='secure'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </loader>
Dec 06 06:55:01 user nova-compute[75021]:   </os>
Dec 06 06:55:01 user nova-compute[75021]:   <cpu>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-passthrough' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='hostPassthroughMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>on</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='maximum' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='maximumMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>on</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-model' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <vendor>Intel</vendor>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ss'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='vmx'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='pcid'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='hypervisor'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arat'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='umip'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='md-clear'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='invtsc'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibpb'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibrs'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='rsba'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='pschange-mc-no'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='erms'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='custom' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>qemu64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>qemu32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>phenom</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>n270</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>kvm64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>kvm32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>coreduo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>core2duo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>athlon</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Westmere-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Westmere</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Snowridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Penryn</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G5</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G4</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Opteron_G1</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Nehalem</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Rome</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Milan</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Dhyana</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cooperlake</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Conroe</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>486</model>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:   </cpu>
Dec 06 06:55:01 user nova-compute[75021]:   <memoryBacking supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='sourceType'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>file</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>anonymous</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>memfd</value>
Dec 06 06:55:01 user nova-compute[75021]:     </enum>
Dec 06 06:55:01 user nova-compute[75021]:   </memoryBacking>
Dec 06 06:55:01 user nova-compute[75021]:   <devices>
Dec 06 06:55:01 user nova-compute[75021]:     <disk supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='diskDevice'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>disk</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cdrom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>floppy</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>lun</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='bus'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>ide</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>fdc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sata</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </disk>
Dec 06 06:55:01 user nova-compute[75021]:     <graphics supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sdl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vnc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>spice</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egl-headless</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </graphics>
Dec 06 06:55:01 user nova-compute[75021]:     <video supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='modelType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cirrus</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vmvga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>qxl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>none</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>bochs</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>ramfb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </video>
Dec 06 06:55:01 user nova-compute[75021]:     <hostdev supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='mode'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>subsystem</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='startupPolicy'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>default</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>mandatory</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>requisite</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>optional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='subsysType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pci</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='capsType'/>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='pciBackend'/>
Dec 06 06:55:01 user nova-compute[75021]:     </hostdev>
Dec 06 06:55:01 user nova-compute[75021]:     <rng supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>random</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egd</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>builtin</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </rng>
Dec 06 06:55:01 user nova-compute[75021]:     <filesystem supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='driverType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>path</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>handle</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtiofs</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </filesystem>
Dec 06 06:55:01 user nova-compute[75021]:     <tpm supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-tis</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-crb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>passthrough</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>emulator</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </tpm>
Dec 06 06:55:01 user nova-compute[75021]:   </devices>
Dec 06 06:55:01 user nova-compute[75021]:   <features>
Dec 06 06:55:01 user nova-compute[75021]:     <gic supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     <vmcoreinfo supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <genid supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backingStoreInput supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backup supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <sev supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:   </features>
Dec 06 06:55:01 user nova-compute[75021]: </domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:  {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Dec 06 06:55:01 user nova-compute[75021]: <domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 06 06:55:01 user nova-compute[75021]:   <domain>kvm</domain>
Dec 06 06:55:01 user nova-compute[75021]:   <machine>pc-q35-6.2</machine>
Dec 06 06:55:01 user nova-compute[75021]:   <arch>x86_64</arch>
Dec 06 06:55:01 user nova-compute[75021]:   <vcpu max='288'/>
Dec 06 06:55:01 user nova-compute[75021]:   <iothreads supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:   <os supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='firmware'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>efi</value>
Dec 06 06:55:01 user nova-compute[75021]:     </enum>
Dec 06 06:55:01 user nova-compute[75021]:     <loader supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>rom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pflash</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='readonly'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>yes</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='secure'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>yes</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </loader>
Dec 06 06:55:01 user nova-compute[75021]:   </os>
Dec 06 06:55:01 user nova-compute[75021]:   <cpu>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-passthrough' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='hostPassthroughMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>on</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='maximum' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='maximumMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>on</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-model' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <vendor>Intel</vendor>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ss'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='vmx'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='pcid'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='hypervisor'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arat'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='umip'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='md-clear'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='invtsc'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibpb'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibrs'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='rsba'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='pschange-mc-no'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='erms'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='custom' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>qemu64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>qemu32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>phenom</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>n270</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>kvm64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>kvm32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>coreduo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>core2duo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>athlon</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Westmere-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Westmere</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Snowridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Penryn</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G5</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G4</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Opteron_G1</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Nehalem</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Rome</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Milan</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Dhyana</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cooperlake</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Conroe</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>486</model>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:   </cpu>
Dec 06 06:55:01 user nova-compute[75021]:   <memoryBacking supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='sourceType'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>file</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>anonymous</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>memfd</value>
Dec 06 06:55:01 user nova-compute[75021]:     </enum>
Dec 06 06:55:01 user nova-compute[75021]:   </memoryBacking>
Dec 06 06:55:01 user nova-compute[75021]:   <devices>
Dec 06 06:55:01 user nova-compute[75021]:     <disk supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='diskDevice'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>disk</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cdrom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>floppy</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>lun</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='bus'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>fdc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sata</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </disk>
Dec 06 06:55:01 user nova-compute[75021]:     <graphics supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sdl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vnc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>spice</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egl-headless</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </graphics>
Dec 06 06:55:01 user nova-compute[75021]:     <video supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='modelType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cirrus</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vmvga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>qxl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>none</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>bochs</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>ramfb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </video>
Dec 06 06:55:01 user nova-compute[75021]:     <hostdev supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='mode'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>subsystem</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='startupPolicy'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>default</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>mandatory</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>requisite</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>optional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='subsysType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pci</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='capsType'/>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='pciBackend'/>
Dec 06 06:55:01 user nova-compute[75021]:     </hostdev>
Dec 06 06:55:01 user nova-compute[75021]:     <rng supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>random</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egd</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>builtin</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </rng>
Dec 06 06:55:01 user nova-compute[75021]:     <filesystem supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='driverType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>path</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>handle</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtiofs</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </filesystem>
Dec 06 06:55:01 user nova-compute[75021]:     <tpm supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-tis</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-crb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>passthrough</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>emulator</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </tpm>
Dec 06 06:55:01 user nova-compute[75021]:   </devices>
Dec 06 06:55:01 user nova-compute[75021]:   <features>
Dec 06 06:55:01 user nova-compute[75021]:     <gic supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     <vmcoreinfo supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <genid supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backingStoreInput supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backup supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <sev supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:   </features>
Dec 06 06:55:01 user nova-compute[75021]: </domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:  {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Dec 06 06:55:01 user nova-compute[75021]: <domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 06 06:55:01 user nova-compute[75021]:   <domain>kvm</domain>
Dec 06 06:55:01 user nova-compute[75021]:   <machine>pc-q35-jammy</machine>
Dec 06 06:55:01 user nova-compute[75021]:   <arch>x86_64</arch>
Dec 06 06:55:01 user nova-compute[75021]:   <vcpu max='288'/>
Dec 06 06:55:01 user nova-compute[75021]:   <iothreads supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:   <os supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='firmware'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>efi</value>
Dec 06 06:55:01 user nova-compute[75021]:     </enum>
Dec 06 06:55:01 user nova-compute[75021]:     <loader supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>rom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pflash</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='readonly'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>yes</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='secure'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>yes</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>no</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </loader>
Dec 06 06:55:01 user nova-compute[75021]:   </os>
Dec 06 06:55:01 user nova-compute[75021]:   <cpu>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-passthrough' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='hostPassthroughMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>on</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='maximum' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='maximumMigratable'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>on</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>off</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='host-model' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <vendor>Intel</vendor>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ss'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='vmx'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='pcid'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='hypervisor'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arat'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='tsc_adjust'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='umip'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='md-clear'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='arch-capabilities'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='invtsc'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibpb'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='ibrs'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-stibp'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='amd-ssbd'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='rsba'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='require' name='pschange-mc-no'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='erms'/>
Dec 06 06:55:01 user nova-compute[75021]:       <feature policy='disable' name='xsaveopt'/>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:     <mode name='custom' supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>qemu64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>qemu32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>phenom</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>pentium</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>n270</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>kvm64</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>kvm32</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>coreduo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>core2duo</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>athlon</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Westmere-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Westmere</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Snowridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Skylake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>SandyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Penryn</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G5</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G4</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G3</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Opteron_G2</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Opteron_G1</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Nehalem</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>IvyBridge</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Icelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Haswell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Rome</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-Milan</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC-IBPB</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>EPYC</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Dhyana</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cooperlake</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>Conroe</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Cascadelake-Server</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-noTSX</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell-IBRS</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='no'>Broadwell</model>
Dec 06 06:55:01 user nova-compute[75021]:       <model usable='yes'>486</model>
Dec 06 06:55:01 user nova-compute[75021]:     </mode>
Dec 06 06:55:01 user nova-compute[75021]:   </cpu>
Dec 06 06:55:01 user nova-compute[75021]:   <memoryBacking supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:     <enum name='sourceType'>
Dec 06 06:55:01 user nova-compute[75021]:       <value>file</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>anonymous</value>
Dec 06 06:55:01 user nova-compute[75021]:       <value>memfd</value>
Dec 06 06:55:01 user nova-compute[75021]:     </enum>
Dec 06 06:55:01 user nova-compute[75021]:   </memoryBacking>
Dec 06 06:55:01 user nova-compute[75021]:   <devices>
Dec 06 06:55:01 user nova-compute[75021]:     <disk supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='diskDevice'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>disk</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cdrom</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>floppy</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>lun</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='bus'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>fdc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sata</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </disk>
Dec 06 06:55:01 user nova-compute[75021]:     <graphics supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='type'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>sdl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vnc</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>spice</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egl-headless</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </graphics>
Dec 06 06:55:01 user nova-compute[75021]:     <video supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='modelType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>cirrus</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>vmvga</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>qxl</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>none</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>bochs</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>ramfb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </video>
Dec 06 06:55:01 user nova-compute[75021]:     <hostdev supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='mode'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>subsystem</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='startupPolicy'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>default</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>mandatory</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>requisite</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>optional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='subsysType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>usb</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>pci</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>scsi</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='capsType'/>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='pciBackend'/>
Dec 06 06:55:01 user nova-compute[75021]:     </hostdev>
Dec 06 06:55:01 user nova-compute[75021]:     <rng supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtio-non-transitional</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>random</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>egd</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>builtin</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </rng>
Dec 06 06:55:01 user nova-compute[75021]:     <filesystem supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='driverType'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>path</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>handle</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>virtiofs</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </filesystem>
Dec 06 06:55:01 user nova-compute[75021]:     <tpm supported='yes'>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='model'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-tis</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>tpm-crb</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:       <enum name='backendModel'>
Dec 06 06:55:01 user nova-compute[75021]:         <value>passthrough</value>
Dec 06 06:55:01 user nova-compute[75021]:         <value>emulator</value>
Dec 06 06:55:01 user nova-compute[75021]:       </enum>
Dec 06 06:55:01 user nova-compute[75021]:     </tpm>
Dec 06 06:55:01 user nova-compute[75021]:   </devices>
Dec 06 06:55:01 user nova-compute[75021]:   <features>
Dec 06 06:55:01 user nova-compute[75021]:     <gic supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:     <vmcoreinfo supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <genid supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backingStoreInput supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <backup supported='yes'/>
Dec 06 06:55:01 user nova-compute[75021]:     <sev supported='no'/>
Dec 06 06:55:01 user nova-compute[75021]:   </features>
Dec 06 06:55:01 user nova-compute[75021]: </domainCapabilities>
Dec 06 06:55:01 user nova-compute[75021]:  {{(pid=75021) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75021) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75021) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Checking secure boot support for host arch (x86_64) {{(pid=75021) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Checking secure boot support for host arch (x86_64) {{(pid=75021) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Checking secure boot support for host arch (x86_64) {{(pid=75021) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Checking secure boot support for host arch (x86_64) {{(pid=75021) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Checking secure boot support for host arch (x86_64) {{(pid=75021) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 06 06:55:01 user nova-compute[75021]: INFO nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Secure Boot support detected
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] cpu compare xml: <cpu match="exact">
Dec 06 06:55:01 user nova-compute[75021]:   <model>Nehalem</model>
Dec 06 06:55:01 user nova-compute[75021]: </cpu>
Dec 06 06:55:01 user nova-compute[75021]:  {{(pid=75021) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10025}}
Dec 06 06:55:01 user nova-compute[75021]: INFO nova.virt.node [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Generated node identity 33dec8e2-b735-4a70-a668-4c31a23cece2
Dec 06 06:55:01 user nova-compute[75021]: INFO nova.virt.node [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Wrote node identity 33dec8e2-b735-4a70-a668-4c31a23cece2 to /opt/stack/data/nova/compute_id
Dec 06 06:55:01 user nova-compute[75021]: WARNING nova.compute.manager [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Compute nodes ['33dec8e2-b735-4a70-a668-4c31a23cece2'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Dec 06 06:55:01 user nova-compute[75021]: INFO nova.compute.manager [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Dec 06 06:55:01 user nova-compute[75021]: WARNING nova.compute.manager [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 06 06:55:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 06:55:01 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:55:01 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Hypervisor/Node resource view: name=user free_ram=11000MB free_disk=26.299053192138672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:55:01 user nova-compute[75021]: WARNING nova.compute.resource_tracker [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] No compute node record for user:33dec8e2-b735-4a70-a668-4c31a23cece2: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 33dec8e2-b735-4a70-a668-4c31a23cece2 could not be found.
Dec 06 06:55:01 user nova-compute[75021]: INFO nova.compute.resource_tracker [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Compute node record created for user:user with uuid: 33dec8e2-b735-4a70-a668-4c31a23cece2
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 06:55:01 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] [req-56ca7178-6448-4402-be6f-022149574778] Created resource provider record via placement API for resource provider with UUID 33dec8e2-b735-4a70-a668-4c31a23cece2 and name user.
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75021) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Dec 06 06:55:01 user nova-compute[75021]: INFO nova.virt.libvirt.host [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] kernel doesn't support AMD SEV
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Updating inventory in ProviderTree for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 06:55:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Libvirt baseline CPU <cpu>
Dec 06 06:55:01 user nova-compute[75021]:   <arch>x86_64</arch>
Dec 06 06:55:01 user nova-compute[75021]:   <model>Nehalem</model>
Dec 06 06:55:01 user nova-compute[75021]:   <vendor>Intel</vendor>
Dec 06 06:55:01 user nova-compute[75021]:   <topology sockets="6" cores="1" threads="1"/>
Dec 06 06:55:01 user nova-compute[75021]: </cpu>
Dec 06 06:55:01 user nova-compute[75021]:  {{(pid=75021) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12524}}
Dec 06 06:55:02 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Updated inventory for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Dec 06 06:55:02 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Updating resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2 generation from 0 to 1 during operation: update_inventory {{(pid=75021) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 06 06:55:02 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Updating inventory in ProviderTree for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 06:55:02 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Updating resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2 generation from 1 to 2 during operation: update_traits {{(pid=75021) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 06 06:55:02 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 06:55:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:55:02 user nova-compute[75021]: DEBUG nova.service [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Creating RPC server for service compute {{(pid=75021) start /opt/stack/nova/nova/service.py:182}}
Dec 06 06:55:02 user nova-compute[75021]: DEBUG nova.service [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] Join ServiceGroup membership for this service compute {{(pid=75021) start /opt/stack/nova/nova/service.py:199}}
Dec 06 06:55:02 user nova-compute[75021]: DEBUG nova.servicegroup.drivers.db [None req-4e3ec29e-17c1-473d-9cfd-e0e59543de3d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75021) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Dec 06 06:55:04 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:55:04 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 06:55:53 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:55:53 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:55:53 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=10447MB free_disk=26.202838897705078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 06:55:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:56:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:56:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:56:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:56:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:56:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 06:56:54 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:56:54 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 06:56:54 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 06:56:54 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 06:56:54 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 06:56:55 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:56:55 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:56:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=10377MB free_disk=26.26779556274414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 06:56:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:57:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:57:54 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:57:54 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 06:57:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:57:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:57:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:57:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:57:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:57:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:57:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 06:57:55 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:57:55 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:57:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=10377MB free_disk=26.021881103515625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 06:57:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:57:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:57:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 06:57:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 06:57:55 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 06:57:55 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 06:57:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 06:57:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:57:56 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:57:56 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:57:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 06:57:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 06:57:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 06:57:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:57:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:58:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 06:58:55 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:58:55 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:58:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=9714MB free_disk=26.049205780029297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 06:58:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:58:56 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:58:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 06:58:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 06:58:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 06:58:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:58:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:58:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:58:58 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:58:58 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:59:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:09 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 06:59:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 06:59:09 user nova-compute[75021]: INFO nova.compute.claims [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Claim successful on node user
Dec 06 06:59:10 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 06:59:10 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 06:59:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 06:59:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 06:59:10 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 06:59:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 06:59:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 06:59:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 06:59:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 06:59:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Creating image(s)
Dec 06 06:59:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "/opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "/opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe.part --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:11 user nova-compute[75021]: DEBUG nova.policy [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6d8114db9fa47c09bc9675da9e19a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d3fb6e885546bd9660c81fac9cfa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 06:59:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:11 user nova-compute[75021]: DEBUG nova.virt.images [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] a0676e02-e61a-446d-aeb1-22dc06cf490d was qcow2, converting to raw {{(pid=75021) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 06:59:11 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 06:59:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe.part /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe.converted {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe.part /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe.converted" returned: 0 in 0.526s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe.converted --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe.converted --force-share --output=json" returned: 0 in 0.168s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.495s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:12 user nova-compute[75021]: INFO oslo.privsep.daemon [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4i8hy0wz/privsep.sock']
Dec 06 06:59:12 user sudo[84503]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4i8hy0wz/privsep.sock
Dec 06 06:59:12 user sudo[84503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 06 06:59:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Acquiring lock "4b621ac2-857c-44be-9466-2f62165c3dfa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 06:59:12 user nova-compute[75021]: INFO nova.compute.claims [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Claim successful on node user
Dec 06 06:59:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.293s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 06:59:12 user nova-compute[75021]: INFO nova.compute.claims [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Claim successful on node user
Dec 06 06:59:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 06:59:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 06:59:13 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 06:59:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 06:59:13 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Creating image(s)
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "/opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "/opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG nova.policy [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '883ff000155c4bfcbb3219cabca0fed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34178a8149604d7f8fc288510f030b9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 06:59:13 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 06:59:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG nova.policy [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6d8114db9fa47c09bc9675da9e19a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d3fb6e885546bd9660c81fac9cfa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 06:59:13 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Creating image(s)
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "/opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "/opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "/opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:13 user sudo[84503]: pam_unix(sudo:session): session closed for user root
Dec 06 06:59:13 user nova-compute[75021]: INFO oslo.privsep.daemon [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Spawned new privsep daemon via rootwrap
Dec 06 06:59:13 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 06 06:59:13 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 06 06:59:13 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Dec 06 06:59:13 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84509
Dec 06 06:59:13 user nova-compute[75021]: WARNING oslo_privsep.priv_context [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] privsep daemon already running
Dec 06 06:59:13 user nova-compute[75021]: WARNING oslo_privsep.priv_context [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] privsep daemon already running
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.176s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Successfully created port: 0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk 1073741824" returned: 0 in 0.042s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.229s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.203s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.209s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk 1073741824" returned: 0 in 0.060s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.525s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Cannot resize image /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Ensure instance console log exists: /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.226s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.225s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Successfully created port: 98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk 1073741824" returned: 0 in 0.061s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Cannot resize image /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Ensure instance console log exists: /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 06:59:14 user nova-compute[75021]: INFO nova.compute.claims [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Claim successful on node user
Dec 06 06:59:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:15 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Cannot resize image /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 06:59:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 06:59:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Ensure instance console log exists: /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 06:59:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:15 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 06:59:15 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 06:59:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:15 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 06:59:15 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 06:59:15 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 06:59:15 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 06:59:15 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 06:59:15 user nova-compute[75021]: DEBUG nova.policy [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9273703a77bf425685228a99248f6d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0482e21a6db45199f3c82f7f5913ec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG nova.network.neutron [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Successfully created port: 193f630e-f83c-4fc1-8840-34b938525ca1 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 06:59:16 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Creating image(s)
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "/opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "/opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.239s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk 1073741824" returned: 0 in 0.126s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Successfully updated port: 98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Successfully updated port: 0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquired lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquired lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Cannot resize image /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Ensure instance console log exists: /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 06:59:17 user nova-compute[75021]: INFO nova.compute.claims [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Claim successful on node user
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.compute.manager [req-49940945-6097-47ed-af2d-a922a980d60f req-2d00a100-fda6-4ecb-b06b-b94e0bf6b080 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received event network-changed-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.compute.manager [req-49940945-6097-47ed-af2d-a922a980d60f req-2d00a100-fda6-4ecb-b06b-b94e0bf6b080 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Refreshing instance network info cache due to event network-changed-98cd38aa-33d7-4859-a2eb-5b76676e927b. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-49940945-6097-47ed-af2d-a922a980d60f req-2d00a100-fda6-4ecb-b06b-b94e0bf6b080 service nova] Acquiring lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.compute.manager [req-b85fa860-6f86-4c2e-be9e-1f26a14a4262 req-db06fcaf-5530-4bcb-b5b4-c72312fd149d service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received event network-changed-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.compute.manager [req-b85fa860-6f86-4c2e-be9e-1f26a14a4262 req-db06fcaf-5530-4bcb-b5b4-c72312fd149d service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Refreshing instance network info cache due to event network-changed-0b799ddb-c34b-457f-9412-d09c3ab04806. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b85fa860-6f86-4c2e-be9e-1f26a14a4262 req-db06fcaf-5530-4bcb-b5b4-c72312fd149d service nova] Acquiring lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Updating instance_info_cache with network_info: [{"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:17 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 06:59:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Releasing lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Instance network_info: |[{"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b85fa860-6f86-4c2e-be9e-1f26a14a4262 req-db06fcaf-5530-4bcb-b5b4-c72312fd149d service nova] Acquired lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.network.neutron [req-b85fa860-6f86-4c2e-be9e-1f26a14a4262 req-db06fcaf-5530-4bcb-b5b4-c72312fd149d service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Refreshing network info cache for port 0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Start _get_guest_xml network_info=[{"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 06:59:17 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:17 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1331447466',display_name='tempest-ServerRescueNegativeTestJSON-server-1331447466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1331447466',id=1,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43d3fb6e885546bd9660c81fac9cfa12',ramdisk_id='',reservation_id='r-degm1zig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-674134420',owner_user_name='tempest-ServerRescueNegativeTestJSON-674134420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:10Z,user_data=None,user_id='e6d8114db9fa47c09bc9675da9e19a8c',uuid=4ffc6429-3f3c-4a7e-98e5-0db984266eae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converting VIF {"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2d:18,bridge_name='br-int',has_traffic_filtering=True,id=0b799ddb-c34b-457f-9412-d09c3ab04806,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b799ddb-c3') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ffc6429-3f3c-4a7e-98e5-0db984266eae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] End _get_guest_xml xml=<domain type="kvm">
Dec 06 06:59:17 user nova-compute[75021]:   <uuid>4ffc6429-3f3c-4a7e-98e5-0db984266eae</uuid>
Dec 06 06:59:17 user nova-compute[75021]:   <name>instance-00000001</name>
Dec 06 06:59:17 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 06:59:17 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 06:59:17 user nova-compute[75021]:   <metadata>
Dec 06 06:59:17 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 06:59:17 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 06:59:17 user nova-compute[75021]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1331447466</nova:name>
Dec 06 06:59:17 user nova-compute[75021]:       <nova:creationTime>2023-12-06 06:59:17</nova:creationTime>
Dec 06 06:59:17 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 06:59:17 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 06:59:17 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 06:59:17 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 06:59:17 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 06:59:17 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 06:59:17 user nova-compute[75021]:       </nova:flavor>
Dec 06 06:59:17 user nova-compute[75021]:       <nova:owner>
Dec 06 06:59:17 user nova-compute[75021]:         <nova:user uuid="e6d8114db9fa47c09bc9675da9e19a8c">tempest-ServerRescueNegativeTestJSON-674134420-project-member</nova:user>
Dec 06 06:59:17 user nova-compute[75021]:         <nova:project uuid="43d3fb6e885546bd9660c81fac9cfa12">tempest-ServerRescueNegativeTestJSON-674134420</nova:project>
Dec 06 06:59:17 user nova-compute[75021]:       </nova:owner>
Dec 06 06:59:17 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 06:59:17 user nova-compute[75021]:       <nova:ports>
Dec 06 06:59:17 user nova-compute[75021]:         <nova:port uuid="0b799ddb-c34b-457f-9412-d09c3ab04806">
Dec 06 06:59:17 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 06:59:17 user nova-compute[75021]:         </nova:port>
Dec 06 06:59:17 user nova-compute[75021]:       </nova:ports>
Dec 06 06:59:17 user nova-compute[75021]:     </nova:instance>
Dec 06 06:59:17 user nova-compute[75021]:   </metadata>
Dec 06 06:59:17 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 06:59:17 user nova-compute[75021]:     <system>
Dec 06 06:59:17 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 06:59:17 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 06:59:17 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 06:59:17 user nova-compute[75021]:       <entry name="serial">4ffc6429-3f3c-4a7e-98e5-0db984266eae</entry>
Dec 06 06:59:17 user nova-compute[75021]:       <entry name="uuid">4ffc6429-3f3c-4a7e-98e5-0db984266eae</entry>
Dec 06 06:59:17 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 06:59:17 user nova-compute[75021]:     </system>
Dec 06 06:59:17 user nova-compute[75021]:   </sysinfo>
Dec 06 06:59:17 user nova-compute[75021]:   <os>
Dec 06 06:59:17 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 06:59:17 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 06:59:17 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 06:59:17 user nova-compute[75021]:   </os>
Dec 06 06:59:17 user nova-compute[75021]:   <features>
Dec 06 06:59:17 user nova-compute[75021]:     <acpi/>
Dec 06 06:59:17 user nova-compute[75021]:     <apic/>
Dec 06 06:59:17 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 06:59:17 user nova-compute[75021]:   </features>
Dec 06 06:59:17 user nova-compute[75021]:   <clock offset="utc">
Dec 06 06:59:17 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 06:59:17 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 06:59:17 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 06:59:17 user nova-compute[75021]:   </clock>
Dec 06 06:59:17 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 06:59:17 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 06:59:17 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 06:59:17 user nova-compute[75021]:   </cpu>
Dec 06 06:59:17 user nova-compute[75021]:   <devices>
Dec 06 06:59:17 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 06:59:17 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 06:59:17 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk"/>
Dec 06 06:59:17 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 06:59:17 user nova-compute[75021]:     </disk>
Dec 06 06:59:17 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 06:59:17 user nova-compute[75021]:       <mac address="fa:16:3e:7a:2d:18"/>
Dec 06 06:59:17 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:17 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 06:59:17 user nova-compute[75021]:       <target dev="tap0b799ddb-c3"/>
Dec 06 06:59:17 user nova-compute[75021]:     </interface>
Dec 06 06:59:17 user nova-compute[75021]:     <serial type="pty">
Dec 06 06:59:17 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/console.log" append="off"/>
Dec 06 06:59:17 user nova-compute[75021]:     </serial>
Dec 06 06:59:17 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 06:59:17 user nova-compute[75021]:     <video>
Dec 06 06:59:17 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:17 user nova-compute[75021]:     </video>
Dec 06 06:59:17 user nova-compute[75021]:     <rng model="virtio">
Dec 06 06:59:17 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 06:59:17 user nova-compute[75021]:     </rng>
Dec 06 06:59:17 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 06:59:17 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 06:59:17 user nova-compute[75021]:       <stats period="10"/>
Dec 06 06:59:17 user nova-compute[75021]:     </memballoon>
Dec 06 06:59:17 user nova-compute[75021]:   </devices>
Dec 06 06:59:17 user nova-compute[75021]: </domain>
Dec 06 06:59:17 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1331447466',display_name='tempest-ServerRescueNegativeTestJSON-server-1331447466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1331447466',id=1,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43d3fb6e885546bd9660c81fac9cfa12',ramdisk_id='',reservation_id='r-degm1zig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-674134420',owner_user_name='tempest-ServerRescueNegativeTestJSON-674134420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:10Z,user_data=None,user_id='e6d8114db9fa47c09bc9675da9e19a8c',uuid=4ffc6429-3f3c-4a7e-98e5-0db984266eae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converting VIF {"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2d:18,bridge_name='br-int',has_traffic_filtering=True,id=0b799ddb-c34b-457f-9412-d09c3ab04806,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b799ddb-c3') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG os_vif [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2d:18,bridge_name='br-int',has_traffic_filtering=True,id=0b799ddb-c34b-457f-9412-d09c3ab04806,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b799ddb-c3') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 06:59:17 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Creating image(s)
Dec 06 06:59:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "/opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "/opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Created schema index Interface.name {{(pid=75021) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Created schema index Port.name {{(pid=75021) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Created schema index Bridge.name {{(pid=75021) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [POLLOUT] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.policy [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4daf20c071c4b5cb826452811323abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75ae216dcb345c79a5c2a4d38e51b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '499ad1b0-786b-52de-92cf-7d7a22358d36', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:18 user nova-compute[75021]: INFO oslo.privsep.daemon [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpebzwc8ar/privsep.sock']
Dec 06 06:59:18 user sudo[84610]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpebzwc8ar/privsep.sock
Dec 06 06:59:18 user sudo[84610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.176s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Updating instance_info_cache with network_info: [{"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Releasing lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Instance network_info: |[{"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-49940945-6097-47ed-af2d-a922a980d60f req-2d00a100-fda6-4ecb-b06b-b94e0bf6b080 service nova] Acquired lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.network.neutron [req-49940945-6097-47ed-af2d-a922a980d60f req-2d00a100-fda6-4ecb-b06b-b94e0bf6b080 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Refreshing network info cache for port 98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Start _get_guest_xml network_info=[{"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 06:59:18 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:18 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Successfully created port: f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-119221818',display_name='tempest-ServerRescueNegativeTestJSON-server-119221818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-119221818',id=2,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43d3fb6e885546bd9660c81fac9cfa12',ramdisk_id='',reservation_id='r-1z4uta0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-674134420',owner_user_name='tempest-ServerRescueNegativeTestJSON-674134420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:13Z,user_data=None,user_id='e6d8114db9fa47c09bc9675da9e19a8c',uuid=a613e2d6-d3f6-4729-aef7-24714608acc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converting VIF {"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:56,bridge_name='br-int',has_traffic_filtering=True,id=98cd38aa-33d7-4859-a2eb-5b76676e927b,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cd38aa-33') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.objects.instance [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'pci_devices' on Instance uuid a613e2d6-d3f6-4729-aef7-24714608acc9 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.199s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] End _get_guest_xml xml=<domain type="kvm">
Dec 06 06:59:18 user nova-compute[75021]:   <uuid>a613e2d6-d3f6-4729-aef7-24714608acc9</uuid>
Dec 06 06:59:18 user nova-compute[75021]:   <name>instance-00000002</name>
Dec 06 06:59:18 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 06:59:18 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 06:59:18 user nova-compute[75021]:   <metadata>
Dec 06 06:59:18 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 06:59:18 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 06:59:18 user nova-compute[75021]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-119221818</nova:name>
Dec 06 06:59:18 user nova-compute[75021]:       <nova:creationTime>2023-12-06 06:59:18</nova:creationTime>
Dec 06 06:59:18 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 06:59:18 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 06:59:18 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 06:59:18 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 06:59:18 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 06:59:18 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 06:59:18 user nova-compute[75021]:       </nova:flavor>
Dec 06 06:59:18 user nova-compute[75021]:       <nova:owner>
Dec 06 06:59:18 user nova-compute[75021]:         <nova:user uuid="e6d8114db9fa47c09bc9675da9e19a8c">tempest-ServerRescueNegativeTestJSON-674134420-project-member</nova:user>
Dec 06 06:59:18 user nova-compute[75021]:         <nova:project uuid="43d3fb6e885546bd9660c81fac9cfa12">tempest-ServerRescueNegativeTestJSON-674134420</nova:project>
Dec 06 06:59:18 user nova-compute[75021]:       </nova:owner>
Dec 06 06:59:18 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 06:59:18 user nova-compute[75021]:       <nova:ports>
Dec 06 06:59:18 user nova-compute[75021]:         <nova:port uuid="98cd38aa-33d7-4859-a2eb-5b76676e927b">
Dec 06 06:59:18 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 06:59:18 user nova-compute[75021]:         </nova:port>
Dec 06 06:59:18 user nova-compute[75021]:       </nova:ports>
Dec 06 06:59:18 user nova-compute[75021]:     </nova:instance>
Dec 06 06:59:18 user nova-compute[75021]:   </metadata>
Dec 06 06:59:18 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 06:59:18 user nova-compute[75021]:     <system>
Dec 06 06:59:18 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 06:59:18 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 06:59:18 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 06:59:18 user nova-compute[75021]:       <entry name="serial">a613e2d6-d3f6-4729-aef7-24714608acc9</entry>
Dec 06 06:59:18 user nova-compute[75021]:       <entry name="uuid">a613e2d6-d3f6-4729-aef7-24714608acc9</entry>
Dec 06 06:59:18 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 06:59:18 user nova-compute[75021]:     </system>
Dec 06 06:59:18 user nova-compute[75021]:   </sysinfo>
Dec 06 06:59:18 user nova-compute[75021]:   <os>
Dec 06 06:59:18 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 06:59:18 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 06:59:18 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 06:59:18 user nova-compute[75021]:   </os>
Dec 06 06:59:18 user nova-compute[75021]:   <features>
Dec 06 06:59:18 user nova-compute[75021]:     <acpi/>
Dec 06 06:59:18 user nova-compute[75021]:     <apic/>
Dec 06 06:59:18 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 06:59:18 user nova-compute[75021]:   </features>
Dec 06 06:59:18 user nova-compute[75021]:   <clock offset="utc">
Dec 06 06:59:18 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 06:59:18 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 06:59:18 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 06:59:18 user nova-compute[75021]:   </clock>
Dec 06 06:59:18 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 06:59:18 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 06:59:18 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 06:59:18 user nova-compute[75021]:   </cpu>
Dec 06 06:59:18 user nova-compute[75021]:   <devices>
Dec 06 06:59:18 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 06:59:18 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 06:59:18 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk"/>
Dec 06 06:59:18 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 06:59:18 user nova-compute[75021]:     </disk>
Dec 06 06:59:18 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 06:59:18 user nova-compute[75021]:       <mac address="fa:16:3e:3a:ab:56"/>
Dec 06 06:59:18 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:18 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 06:59:18 user nova-compute[75021]:       <target dev="tap98cd38aa-33"/>
Dec 06 06:59:18 user nova-compute[75021]:     </interface>
Dec 06 06:59:18 user nova-compute[75021]:     <serial type="pty">
Dec 06 06:59:18 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/console.log" append="off"/>
Dec 06 06:59:18 user nova-compute[75021]:     </serial>
Dec 06 06:59:18 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 06:59:18 user nova-compute[75021]:     <video>
Dec 06 06:59:18 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:18 user nova-compute[75021]:     </video>
Dec 06 06:59:18 user nova-compute[75021]:     <rng model="virtio">
Dec 06 06:59:18 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 06:59:18 user nova-compute[75021]:     </rng>
Dec 06 06:59:18 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 06:59:18 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 06:59:18 user nova-compute[75021]:       <stats period="10"/>
Dec 06 06:59:18 user nova-compute[75021]:     </memballoon>
Dec 06 06:59:18 user nova-compute[75021]:   </devices>
Dec 06 06:59:18 user nova-compute[75021]: </domain>
Dec 06 06:59:18 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-119221818',display_name='tempest-ServerRescueNegativeTestJSON-server-119221818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-119221818',id=2,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43d3fb6e885546bd9660c81fac9cfa12',ramdisk_id='',reservation_id='r-1z4uta0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-674134420',owner_user_name='tempest-ServerRescueNegativeTestJSON-674134420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:13Z,user_data=None,user_id='e6d8114db9fa47c09bc9675da9e19a8c',uuid=a613e2d6-d3f6-4729-aef7-24714608acc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converting VIF {"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:56,bridge_name='br-int',has_traffic_filtering=True,id=98cd38aa-33d7-4859-a2eb-5b76676e927b,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cd38aa-33') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG os_vif [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:56,bridge_name='br-int',has_traffic_filtering=True,id=98cd38aa-33d7-4859-a2eb-5b76676e927b,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cd38aa-33') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk 1073741824" returned: 0 in 0.065s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37c5af24-fc7c-51f6-97c4-636da0f523cd', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.168s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Successfully updated port: 193f630e-f83c-4fc1-8840-34b938525ca1 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Cannot resize image /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Ensure instance console log exists: /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Acquiring lock "refresh_cache-4b621ac2-857c-44be-9466-2f62165c3dfa" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Acquired lock "refresh_cache-4b621ac2-857c-44be-9466-2f62165c3dfa" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 06:59:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:19 user nova-compute[75021]: DEBUG nova.network.neutron [req-b85fa860-6f86-4c2e-be9e-1f26a14a4262 req-db06fcaf-5530-4bcb-b5b4-c72312fd149d service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Updated VIF entry in instance network info cache for port 0b799ddb-c34b-457f-9412-d09c3ab04806. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 06:59:19 user nova-compute[75021]: DEBUG nova.network.neutron [req-b85fa860-6f86-4c2e-be9e-1f26a14a4262 req-db06fcaf-5530-4bcb-b5b4-c72312fd149d service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Updating instance_info_cache with network_info: [{"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b85fa860-6f86-4c2e-be9e-1f26a14a4262 req-db06fcaf-5530-4bcb-b5b4-c72312fd149d service nova] Releasing lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:19 user nova-compute[75021]: DEBUG nova.network.neutron [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 06:59:19 user nova-compute[75021]: DEBUG nova.compute.manager [req-5f16f623-c4ff-45d6-8fdc-203519039782 req-5a6615f0-c1f6-438c-9d0f-784d32c94bfe service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Received event network-changed-193f630e-f83c-4fc1-8840-34b938525ca1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:19 user nova-compute[75021]: DEBUG nova.compute.manager [req-5f16f623-c4ff-45d6-8fdc-203519039782 req-5a6615f0-c1f6-438c-9d0f-784d32c94bfe service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Refreshing instance network info cache due to event network-changed-193f630e-f83c-4fc1-8840-34b938525ca1. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 06:59:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5f16f623-c4ff-45d6-8fdc-203519039782 req-5a6615f0-c1f6-438c-9d0f-784d32c94bfe service nova] Acquiring lock "refresh_cache-4b621ac2-857c-44be-9466-2f62165c3dfa" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:19 user nova-compute[75021]: DEBUG nova.network.neutron [req-49940945-6097-47ed-af2d-a922a980d60f req-2d00a100-fda6-4ecb-b06b-b94e0bf6b080 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Updated VIF entry in instance network info cache for port 98cd38aa-33d7-4859-a2eb-5b76676e927b. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 06:59:19 user nova-compute[75021]: DEBUG nova.network.neutron [req-49940945-6097-47ed-af2d-a922a980d60f req-2d00a100-fda6-4ecb-b06b-b94e0bf6b080 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Updating instance_info_cache with network_info: [{"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-49940945-6097-47ed-af2d-a922a980d60f req-2d00a100-fda6-4ecb-b06b-b94e0bf6b080 service nova] Releasing lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:19 user sudo[84610]: pam_unix(sudo:session): session closed for user root
Dec 06 06:59:19 user nova-compute[75021]: INFO oslo.privsep.daemon [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Spawned new privsep daemon via rootwrap
Dec 06 06:59:19 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 06 06:59:19 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 06 06:59:19 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Dec 06 06:59:19 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84627
Dec 06 06:59:19 user nova-compute[75021]: WARNING oslo_privsep.priv_context [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] privsep daemon already running
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.network.neutron [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Updating instance_info_cache with network_info: [{"id": "193f630e-f83c-4fc1-8840-34b938525ca1", "address": "fa:16:3e:7f:f8:75", "network": {"id": "1904aeb6-4b68-4412-8700-8ebe6870ac63", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169801536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34178a8149604d7f8fc288510f030b9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193f630e-f8", "ovs_interfaceid": "193f630e-f83c-4fc1-8840-34b938525ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Releasing lock "refresh_cache-4b621ac2-857c-44be-9466-2f62165c3dfa" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.compute.manager [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Instance network_info: |[{"id": "193f630e-f83c-4fc1-8840-34b938525ca1", "address": "fa:16:3e:7f:f8:75", "network": {"id": "1904aeb6-4b68-4412-8700-8ebe6870ac63", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169801536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34178a8149604d7f8fc288510f030b9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193f630e-f8", "ovs_interfaceid": "193f630e-f83c-4fc1-8840-34b938525ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5f16f623-c4ff-45d6-8fdc-203519039782 req-5a6615f0-c1f6-438c-9d0f-784d32c94bfe service nova] Acquired lock "refresh_cache-4b621ac2-857c-44be-9466-2f62165c3dfa" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.network.neutron [req-5f16f623-c4ff-45d6-8fdc-203519039782 req-5a6615f0-c1f6-438c-9d0f-784d32c94bfe service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Refreshing network info cache for port 193f630e-f83c-4fc1-8840-34b938525ca1 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Start _get_guest_xml network_info=[{"id": "193f630e-f83c-4fc1-8840-34b938525ca1", "address": "fa:16:3e:7f:f8:75", "network": {"id": "1904aeb6-4b68-4412-8700-8ebe6870ac63", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169801536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34178a8149604d7f8fc288510f030b9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193f630e-f8", "ovs_interfaceid": "193f630e-f83c-4fc1-8840-34b938525ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 06:59:20 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:20 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-299078579',display_name='tempest-DeleteServersTestJSON-server-299078579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-299078579',id=3,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34178a8149604d7f8fc288510f030b9e',ramdisk_id='',reservation_id='r-hgweg6nk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-202698150',owner_user_name='tempest-DeleteServersTestJSON-202698150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:13Z,user_data=None,user_id='883ff000155c4bfcbb3219cabca0fed3',uuid=4b621ac2-857c-44be-9466-2f62165c3dfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "193f630e-f83c-4fc1-8840-34b938525ca1", "address": "fa:16:3e:7f:f8:75", "network": {"id": "1904aeb6-4b68-4412-8700-8ebe6870ac63", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169801536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34178a8149604d7f8fc288510f030b9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193f630e-f8", "ovs_interfaceid": "193f630e-f83c-4fc1-8840-34b938525ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Converting VIF {"id": "193f630e-f83c-4fc1-8840-34b938525ca1", "address": "fa:16:3e:7f:f8:75", "network": {"id": "1904aeb6-4b68-4412-8700-8ebe6870ac63", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169801536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34178a8149604d7f8fc288510f030b9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193f630e-f8", "ovs_interfaceid": "193f630e-f83c-4fc1-8840-34b938525ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f8:75,bridge_name='br-int',has_traffic_filtering=True,id=193f630e-f83c-4fc1-8840-34b938525ca1,network=Network(1904aeb6-4b68-4412-8700-8ebe6870ac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193f630e-f8') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.objects.instance [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b621ac2-857c-44be-9466-2f62165c3dfa {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] End _get_guest_xml xml=<domain type="kvm">
Dec 06 06:59:20 user nova-compute[75021]:   <uuid>4b621ac2-857c-44be-9466-2f62165c3dfa</uuid>
Dec 06 06:59:20 user nova-compute[75021]:   <name>instance-00000003</name>
Dec 06 06:59:20 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 06:59:20 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 06:59:20 user nova-compute[75021]:   <metadata>
Dec 06 06:59:20 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 06:59:20 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 06:59:20 user nova-compute[75021]:       <nova:name>tempest-DeleteServersTestJSON-server-299078579</nova:name>
Dec 06 06:59:20 user nova-compute[75021]:       <nova:creationTime>2023-12-06 06:59:20</nova:creationTime>
Dec 06 06:59:20 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 06:59:20 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 06:59:20 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 06:59:20 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 06:59:20 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 06:59:20 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 06:59:20 user nova-compute[75021]:       </nova:flavor>
Dec 06 06:59:20 user nova-compute[75021]:       <nova:owner>
Dec 06 06:59:20 user nova-compute[75021]:         <nova:user uuid="883ff000155c4bfcbb3219cabca0fed3">tempest-DeleteServersTestJSON-202698150-project-member</nova:user>
Dec 06 06:59:20 user nova-compute[75021]:         <nova:project uuid="34178a8149604d7f8fc288510f030b9e">tempest-DeleteServersTestJSON-202698150</nova:project>
Dec 06 06:59:20 user nova-compute[75021]:       </nova:owner>
Dec 06 06:59:20 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 06:59:20 user nova-compute[75021]:       <nova:ports>
Dec 06 06:59:20 user nova-compute[75021]:         <nova:port uuid="193f630e-f83c-4fc1-8840-34b938525ca1">
Dec 06 06:59:20 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 06:59:20 user nova-compute[75021]:         </nova:port>
Dec 06 06:59:20 user nova-compute[75021]:       </nova:ports>
Dec 06 06:59:20 user nova-compute[75021]:     </nova:instance>
Dec 06 06:59:20 user nova-compute[75021]:   </metadata>
Dec 06 06:59:20 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 06:59:20 user nova-compute[75021]:     <system>
Dec 06 06:59:20 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 06:59:20 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 06:59:20 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 06:59:20 user nova-compute[75021]:       <entry name="serial">4b621ac2-857c-44be-9466-2f62165c3dfa</entry>
Dec 06 06:59:20 user nova-compute[75021]:       <entry name="uuid">4b621ac2-857c-44be-9466-2f62165c3dfa</entry>
Dec 06 06:59:20 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 06:59:20 user nova-compute[75021]:     </system>
Dec 06 06:59:20 user nova-compute[75021]:   </sysinfo>
Dec 06 06:59:20 user nova-compute[75021]:   <os>
Dec 06 06:59:20 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 06:59:20 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 06:59:20 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 06:59:20 user nova-compute[75021]:   </os>
Dec 06 06:59:20 user nova-compute[75021]:   <features>
Dec 06 06:59:20 user nova-compute[75021]:     <acpi/>
Dec 06 06:59:20 user nova-compute[75021]:     <apic/>
Dec 06 06:59:20 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 06:59:20 user nova-compute[75021]:   </features>
Dec 06 06:59:20 user nova-compute[75021]:   <clock offset="utc">
Dec 06 06:59:20 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 06:59:20 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 06:59:20 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 06:59:20 user nova-compute[75021]:   </clock>
Dec 06 06:59:20 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 06:59:20 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 06:59:20 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 06:59:20 user nova-compute[75021]:   </cpu>
Dec 06 06:59:20 user nova-compute[75021]:   <devices>
Dec 06 06:59:20 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 06:59:20 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 06:59:20 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk"/>
Dec 06 06:59:20 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 06:59:20 user nova-compute[75021]:     </disk>
Dec 06 06:59:20 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 06:59:20 user nova-compute[75021]:       <mac address="fa:16:3e:7f:f8:75"/>
Dec 06 06:59:20 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:20 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 06:59:20 user nova-compute[75021]:       <target dev="tap193f630e-f8"/>
Dec 06 06:59:20 user nova-compute[75021]:     </interface>
Dec 06 06:59:20 user nova-compute[75021]:     <serial type="pty">
Dec 06 06:59:20 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/console.log" append="off"/>
Dec 06 06:59:20 user nova-compute[75021]:     </serial>
Dec 06 06:59:20 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 06:59:20 user nova-compute[75021]:     <video>
Dec 06 06:59:20 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:20 user nova-compute[75021]:     </video>
Dec 06 06:59:20 user nova-compute[75021]:     <rng model="virtio">
Dec 06 06:59:20 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 06:59:20 user nova-compute[75021]:     </rng>
Dec 06 06:59:20 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 06:59:20 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 06:59:20 user nova-compute[75021]:       <stats period="10"/>
Dec 06 06:59:20 user nova-compute[75021]:     </memballoon>
Dec 06 06:59:20 user nova-compute[75021]:   </devices>
Dec 06 06:59:20 user nova-compute[75021]: </domain>
Dec 06 06:59:20 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-299078579',display_name='tempest-DeleteServersTestJSON-server-299078579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-299078579',id=3,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34178a8149604d7f8fc288510f030b9e',ramdisk_id='',reservation_id='r-hgweg6nk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-202698150',owner_user_name='tempest-DeleteServersTestJSON-202698150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:13Z,user_data=None,user_id='883ff000155c4bfcbb3219cabca0fed3',uuid=4b621ac2-857c-44be-9466-2f62165c3dfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "193f630e-f83c-4fc1-8840-34b938525ca1", "address": "fa:16:3e:7f:f8:75", "network": {"id": "1904aeb6-4b68-4412-8700-8ebe6870ac63", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169801536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34178a8149604d7f8fc288510f030b9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193f630e-f8", "ovs_interfaceid": "193f630e-f83c-4fc1-8840-34b938525ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Converting VIF {"id": "193f630e-f83c-4fc1-8840-34b938525ca1", "address": "fa:16:3e:7f:f8:75", "network": {"id": "1904aeb6-4b68-4412-8700-8ebe6870ac63", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169801536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34178a8149604d7f8fc288510f030b9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193f630e-f8", "ovs_interfaceid": "193f630e-f83c-4fc1-8840-34b938525ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f8:75,bridge_name='br-int',has_traffic_filtering=True,id=193f630e-f83c-4fc1-8840-34b938525ca1,network=Network(1904aeb6-4b68-4412-8700-8ebe6870ac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193f630e-f8') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG os_vif [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f8:75,bridge_name='br-int',has_traffic_filtering=True,id=193f630e-f83c-4fc1-8840-34b938525ca1,network=Network(1904aeb6-4b68-4412-8700-8ebe6870ac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193f630e-f8') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e714649-b4c7-5536-bcbd-69e7f4a3309e', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Successfully created port: c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b799ddb-c3, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b799ddb-c3, col_values=(('qos', UUID('ba5286a6-af82-400d-8883-189be80f1a0f')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b799ddb-c3, col_values=(('external_ids', {'iface-id': '0b799ddb-c34b-457f-9412-d09c3ab04806', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:2d:18', 'vm-uuid': '4ffc6429-3f3c-4a7e-98e5-0db984266eae'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:20 user nova-compute[75021]: INFO os_vif [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2d:18,bridge_name='br-int',has_traffic_filtering=True,id=0b799ddb-c34b-457f-9412-d09c3ab04806,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b799ddb-c3')
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Successfully updated port: f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98cd38aa-33, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98cd38aa-33, col_values=(('qos', UUID('780c1239-54b3-4199-aa5c-d145d91ae694')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98cd38aa-33, col_values=(('external_ids', {'iface-id': '98cd38aa-33d7-4859-a2eb-5b76676e927b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:ab:56', 'vm-uuid': 'a613e2d6-d3f6-4729-aef7-24714608acc9'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquired lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:20 user nova-compute[75021]: INFO os_vif [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ab:56,bridge_name='br-int',has_traffic_filtering=True,id=98cd38aa-33d7-4859-a2eb-5b76676e927b,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cd38aa-33')
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap193f630e-f8, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap193f630e-f8, col_values=(('qos', UUID('10d5df4b-9192-46df-b362-a3bb3b6a6dfa')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap193f630e-f8, col_values=(('external_ids', {'iface-id': '193f630e-f83c-4fc1-8840-34b938525ca1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:f8:75', 'vm-uuid': '4b621ac2-857c-44be-9466-2f62165c3dfa'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-8fff3eca-f6a6-4370-9969-4427280756db req-f5742167-ebe6-4af3-a613-44f07cd27852 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-changed-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-8fff3eca-f6a6-4370-9969-4427280756db req-f5742167-ebe6-4af3-a613-44f07cd27852 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Refreshing instance network info cache due to event network-changed-f48c57d0-3024-4f70-8989-454717799fe3. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8fff3eca-f6a6-4370-9969-4427280756db req-f5742167-ebe6-4af3-a613-44f07cd27852 service nova] Acquiring lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No VIF found with MAC fa:16:3e:7a:2d:18, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:20 user nova-compute[75021]: INFO os_vif [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f8:75,bridge_name='br-int',has_traffic_filtering=True,id=193f630e-f83c-4fc1-8840-34b938525ca1,network=Network(1904aeb6-4b68-4412-8700-8ebe6870ac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193f630e-f8')
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No VIF found with MAC fa:16:3e:3a:ab:56, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] No VIF found with MAC fa:16:3e:7f:f8:75, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 06:59:20 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updating instance_info_cache with network_info: [{"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Releasing lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Instance network_info: |[{"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8fff3eca-f6a6-4370-9969-4427280756db req-f5742167-ebe6-4af3-a613-44f07cd27852 service nova] Acquired lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.network.neutron [req-8fff3eca-f6a6-4370-9969-4427280756db req-f5742167-ebe6-4af3-a613-44f07cd27852 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Refreshing network info cache for port f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Start _get_guest_xml network_info=[{"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 06:59:21 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:21 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-272299805',display_name='tempest-ServerActionsTestOtherB-server-272299805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-272299805',id=4,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDr10Uf7mSfaKxaWiZMlOkgp+3gz+zk9cuGM2WOwPxRQl0KGDW8m0MH0trEdCAhYZHvExMqqK1A+1XoEwjfDbN1X4V66K4XOiRtH4zqe8KgY/USo0EOIRMWD8nLuB034BA==',key_name='tempest-keypair-2107162455',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0482e21a6db45199f3c82f7f5913ec1',ramdisk_id='',reservation_id='r-lhdcj864',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1150715110',owner_user_name='tempest-ServerActionsTestOtherB-1150715110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9273703a77bf425685228a99248f6d4e',uuid=2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converting VIF {"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.objects.instance [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.network.neutron [req-5f16f623-c4ff-45d6-8fdc-203519039782 req-5a6615f0-c1f6-438c-9d0f-784d32c94bfe service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Updated VIF entry in instance network info cache for port 193f630e-f83c-4fc1-8840-34b938525ca1. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.network.neutron [req-5f16f623-c4ff-45d6-8fdc-203519039782 req-5a6615f0-c1f6-438c-9d0f-784d32c94bfe service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Updating instance_info_cache with network_info: [{"id": "193f630e-f83c-4fc1-8840-34b938525ca1", "address": "fa:16:3e:7f:f8:75", "network": {"id": "1904aeb6-4b68-4412-8700-8ebe6870ac63", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169801536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34178a8149604d7f8fc288510f030b9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193f630e-f8", "ovs_interfaceid": "193f630e-f83c-4fc1-8840-34b938525ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] End _get_guest_xml xml=<domain type="kvm">
Dec 06 06:59:21 user nova-compute[75021]:   <uuid>2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf</uuid>
Dec 06 06:59:21 user nova-compute[75021]:   <name>instance-00000004</name>
Dec 06 06:59:21 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 06:59:21 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 06:59:21 user nova-compute[75021]:   <metadata>
Dec 06 06:59:21 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 06:59:21 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 06:59:21 user nova-compute[75021]:       <nova:name>tempest-ServerActionsTestOtherB-server-272299805</nova:name>
Dec 06 06:59:21 user nova-compute[75021]:       <nova:creationTime>2023-12-06 06:59:21</nova:creationTime>
Dec 06 06:59:21 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 06:59:21 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 06:59:21 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 06:59:21 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 06:59:21 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 06:59:21 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 06:59:21 user nova-compute[75021]:       </nova:flavor>
Dec 06 06:59:21 user nova-compute[75021]:       <nova:owner>
Dec 06 06:59:21 user nova-compute[75021]:         <nova:user uuid="9273703a77bf425685228a99248f6d4e">tempest-ServerActionsTestOtherB-1150715110-project-member</nova:user>
Dec 06 06:59:21 user nova-compute[75021]:         <nova:project uuid="d0482e21a6db45199f3c82f7f5913ec1">tempest-ServerActionsTestOtherB-1150715110</nova:project>
Dec 06 06:59:21 user nova-compute[75021]:       </nova:owner>
Dec 06 06:59:21 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 06:59:21 user nova-compute[75021]:       <nova:ports>
Dec 06 06:59:21 user nova-compute[75021]:         <nova:port uuid="f48c57d0-3024-4f70-8989-454717799fe3">
Dec 06 06:59:21 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 06:59:21 user nova-compute[75021]:         </nova:port>
Dec 06 06:59:21 user nova-compute[75021]:       </nova:ports>
Dec 06 06:59:21 user nova-compute[75021]:     </nova:instance>
Dec 06 06:59:21 user nova-compute[75021]:   </metadata>
Dec 06 06:59:21 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 06:59:21 user nova-compute[75021]:     <system>
Dec 06 06:59:21 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 06:59:21 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 06:59:21 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 06:59:21 user nova-compute[75021]:       <entry name="serial">2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf</entry>
Dec 06 06:59:21 user nova-compute[75021]:       <entry name="uuid">2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf</entry>
Dec 06 06:59:21 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 06:59:21 user nova-compute[75021]:     </system>
Dec 06 06:59:21 user nova-compute[75021]:   </sysinfo>
Dec 06 06:59:21 user nova-compute[75021]:   <os>
Dec 06 06:59:21 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 06:59:21 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 06:59:21 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 06:59:21 user nova-compute[75021]:   </os>
Dec 06 06:59:21 user nova-compute[75021]:   <features>
Dec 06 06:59:21 user nova-compute[75021]:     <acpi/>
Dec 06 06:59:21 user nova-compute[75021]:     <apic/>
Dec 06 06:59:21 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 06:59:21 user nova-compute[75021]:   </features>
Dec 06 06:59:21 user nova-compute[75021]:   <clock offset="utc">
Dec 06 06:59:21 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 06:59:21 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 06:59:21 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 06:59:21 user nova-compute[75021]:   </clock>
Dec 06 06:59:21 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 06:59:21 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 06:59:21 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 06:59:21 user nova-compute[75021]:   </cpu>
Dec 06 06:59:21 user nova-compute[75021]:   <devices>
Dec 06 06:59:21 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 06:59:21 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 06:59:21 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk"/>
Dec 06 06:59:21 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 06:59:21 user nova-compute[75021]:     </disk>
Dec 06 06:59:21 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 06:59:21 user nova-compute[75021]:       <mac address="fa:16:3e:43:60:12"/>
Dec 06 06:59:21 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:21 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 06:59:21 user nova-compute[75021]:       <target dev="tapf48c57d0-30"/>
Dec 06 06:59:21 user nova-compute[75021]:     </interface>
Dec 06 06:59:21 user nova-compute[75021]:     <serial type="pty">
Dec 06 06:59:21 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/console.log" append="off"/>
Dec 06 06:59:21 user nova-compute[75021]:     </serial>
Dec 06 06:59:21 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 06:59:21 user nova-compute[75021]:     <video>
Dec 06 06:59:21 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:21 user nova-compute[75021]:     </video>
Dec 06 06:59:21 user nova-compute[75021]:     <rng model="virtio">
Dec 06 06:59:21 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 06:59:21 user nova-compute[75021]:     </rng>
Dec 06 06:59:21 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 06:59:21 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 06:59:21 user nova-compute[75021]:       <stats period="10"/>
Dec 06 06:59:21 user nova-compute[75021]:     </memballoon>
Dec 06 06:59:21 user nova-compute[75021]:   </devices>
Dec 06 06:59:21 user nova-compute[75021]: </domain>
Dec 06 06:59:21 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-272299805',display_name='tempest-ServerActionsTestOtherB-server-272299805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-272299805',id=4,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDr10Uf7mSfaKxaWiZMlOkgp+3gz+zk9cuGM2WOwPxRQl0KGDW8m0MH0trEdCAhYZHvExMqqK1A+1XoEwjfDbN1X4V66K4XOiRtH4zqe8KgY/USo0EOIRMWD8nLuB034BA==',key_name='tempest-keypair-2107162455',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0482e21a6db45199f3c82f7f5913ec1',ramdisk_id='',reservation_id='r-lhdcj864',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1150715110',owner_user_name='tempest-ServerActionsTestOtherB-1150715110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9273703a77bf425685228a99248f6d4e',uuid=2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converting VIF {"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG os_vif [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5f16f623-c4ff-45d6-8fdc-203519039782 req-5a6615f0-c1f6-438c-9d0f-784d32c94bfe service nova] Releasing lock "refresh_cache-4b621ac2-857c-44be-9466-2f62165c3dfa" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f24ba05-19aa-57a1-8786-2367e3ba21a0', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf48c57d0-30, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf48c57d0-30, col_values=(('qos', UUID('46610192-1c5c-4d73-aec6-5eaf3dc81883')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf48c57d0-30, col_values=(('external_ids', {'iface-id': 'f48c57d0-3024-4f70-8989-454717799fe3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:60:12', 'vm-uuid': '2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:21 user nova-compute[75021]: INFO os_vif [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30')
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 06:59:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] No VIF found with MAC fa:16:3e:43:60:12, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 06:59:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:22 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Successfully updated port: c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 06:59:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquired lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:22 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 06:59:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-b887d914-5598-4870-a85e-9beb85a5eeef req-8867785c-2279-4e25-b0d2-2c31f4497b80 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received event network-changed-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-b887d914-5598-4870-a85e-9beb85a5eeef req-8867785c-2279-4e25-b0d2-2c31f4497b80 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Refreshing instance network info cache due to event network-changed-c605d9e6-fce9-495d-b4f3-e2f1e4952633. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 06:59:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b887d914-5598-4870-a85e-9beb85a5eeef req-8867785c-2279-4e25-b0d2-2c31f4497b80 service nova] Acquiring lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:22 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 06:59:22 user nova-compute[75021]: DEBUG nova.network.neutron [req-8fff3eca-f6a6-4370-9969-4427280756db req-f5742167-ebe6-4af3-a613-44f07cd27852 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updated VIF entry in instance network info cache for port f48c57d0-3024-4f70-8989-454717799fe3. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 06:59:22 user nova-compute[75021]: DEBUG nova.network.neutron [req-8fff3eca-f6a6-4370-9969-4427280756db req-f5742167-ebe6-4af3-a613-44f07cd27852 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updating instance_info_cache with network_info: [{"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8fff3eca-f6a6-4370-9969-4427280756db req-f5742167-ebe6-4af3-a613-44f07cd27852 service nova] Releasing lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Updating instance_info_cache with network_info: [{"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Releasing lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Instance network_info: |[{"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b887d914-5598-4870-a85e-9beb85a5eeef req-8867785c-2279-4e25-b0d2-2c31f4497b80 service nova] Acquired lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.network.neutron [req-b887d914-5598-4870-a85e-9beb85a5eeef req-8867785c-2279-4e25-b0d2-2c31f4497b80 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Refreshing network info cache for port c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Start _get_guest_xml network_info=[{"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 06:59:23 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:23 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2135327261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2135327261',id=5,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3Lr/kdf8MqVfMx/TeUSMAfVzvaX8ereHkjXoBa9ETDzmMjMiQ9csySNchdYnRT2yeIOuwNGKkvlDgg8mH04y1O/ltV6AdPBXl6ROzuZndpgBoI4b+/RQCPqcSHuavY/Q==',key_name='tempest-keypair-400149348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d75ae216dcb345c79a5c2a4d38e51b38',ramdisk_id='',reservation_id='r-mbynyqjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1923852465',owner_user_name='tempest-AttachVolumeShelveTestJSON-1923852465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4daf20c071c4b5cb826452811323abd',uuid=f9275ae0-ccb1-4c73-b639-9cd243c6ff60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converting VIF {"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=c605d9e6-fce9-495d-b4f3-e2f1e4952633,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605d9e6-fc') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'pci_devices' on Instance uuid f9275ae0-ccb1-4c73-b639-9cd243c6ff60 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] End _get_guest_xml xml=<domain type="kvm">
Dec 06 06:59:23 user nova-compute[75021]:   <uuid>f9275ae0-ccb1-4c73-b639-9cd243c6ff60</uuid>
Dec 06 06:59:23 user nova-compute[75021]:   <name>instance-00000005</name>
Dec 06 06:59:23 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 06:59:23 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 06:59:23 user nova-compute[75021]:   <metadata>
Dec 06 06:59:23 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 06:59:23 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 06:59:23 user nova-compute[75021]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2135327261</nova:name>
Dec 06 06:59:23 user nova-compute[75021]:       <nova:creationTime>2023-12-06 06:59:23</nova:creationTime>
Dec 06 06:59:23 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 06:59:23 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 06:59:23 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 06:59:23 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 06:59:23 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 06:59:23 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 06:59:23 user nova-compute[75021]:       </nova:flavor>
Dec 06 06:59:23 user nova-compute[75021]:       <nova:owner>
Dec 06 06:59:23 user nova-compute[75021]:         <nova:user uuid="b4daf20c071c4b5cb826452811323abd">tempest-AttachVolumeShelveTestJSON-1923852465-project-member</nova:user>
Dec 06 06:59:23 user nova-compute[75021]:         <nova:project uuid="d75ae216dcb345c79a5c2a4d38e51b38">tempest-AttachVolumeShelveTestJSON-1923852465</nova:project>
Dec 06 06:59:23 user nova-compute[75021]:       </nova:owner>
Dec 06 06:59:23 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 06:59:23 user nova-compute[75021]:       <nova:ports>
Dec 06 06:59:23 user nova-compute[75021]:         <nova:port uuid="c605d9e6-fce9-495d-b4f3-e2f1e4952633">
Dec 06 06:59:23 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 06:59:23 user nova-compute[75021]:         </nova:port>
Dec 06 06:59:23 user nova-compute[75021]:       </nova:ports>
Dec 06 06:59:23 user nova-compute[75021]:     </nova:instance>
Dec 06 06:59:23 user nova-compute[75021]:   </metadata>
Dec 06 06:59:23 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 06:59:23 user nova-compute[75021]:     <system>
Dec 06 06:59:23 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 06:59:23 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 06:59:23 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 06:59:23 user nova-compute[75021]:       <entry name="serial">f9275ae0-ccb1-4c73-b639-9cd243c6ff60</entry>
Dec 06 06:59:23 user nova-compute[75021]:       <entry name="uuid">f9275ae0-ccb1-4c73-b639-9cd243c6ff60</entry>
Dec 06 06:59:23 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 06:59:23 user nova-compute[75021]:     </system>
Dec 06 06:59:23 user nova-compute[75021]:   </sysinfo>
Dec 06 06:59:23 user nova-compute[75021]:   <os>
Dec 06 06:59:23 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 06:59:23 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 06:59:23 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 06:59:23 user nova-compute[75021]:   </os>
Dec 06 06:59:23 user nova-compute[75021]:   <features>
Dec 06 06:59:23 user nova-compute[75021]:     <acpi/>
Dec 06 06:59:23 user nova-compute[75021]:     <apic/>
Dec 06 06:59:23 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 06:59:23 user nova-compute[75021]:   </features>
Dec 06 06:59:23 user nova-compute[75021]:   <clock offset="utc">
Dec 06 06:59:23 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 06:59:23 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 06:59:23 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 06:59:23 user nova-compute[75021]:   </clock>
Dec 06 06:59:23 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 06:59:23 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 06:59:23 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 06:59:23 user nova-compute[75021]:   </cpu>
Dec 06 06:59:23 user nova-compute[75021]:   <devices>
Dec 06 06:59:23 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 06:59:23 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 06:59:23 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk"/>
Dec 06 06:59:23 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 06:59:23 user nova-compute[75021]:     </disk>
Dec 06 06:59:23 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 06:59:23 user nova-compute[75021]:       <mac address="fa:16:3e:a3:19:e2"/>
Dec 06 06:59:23 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:23 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 06:59:23 user nova-compute[75021]:       <target dev="tapc605d9e6-fc"/>
Dec 06 06:59:23 user nova-compute[75021]:     </interface>
Dec 06 06:59:23 user nova-compute[75021]:     <serial type="pty">
Dec 06 06:59:23 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/console.log" append="off"/>
Dec 06 06:59:23 user nova-compute[75021]:     </serial>
Dec 06 06:59:23 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 06:59:23 user nova-compute[75021]:     <video>
Dec 06 06:59:23 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:23 user nova-compute[75021]:     </video>
Dec 06 06:59:23 user nova-compute[75021]:     <rng model="virtio">
Dec 06 06:59:23 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 06:59:23 user nova-compute[75021]:     </rng>
Dec 06 06:59:23 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 06:59:23 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 06:59:23 user nova-compute[75021]:       <stats period="10"/>
Dec 06 06:59:23 user nova-compute[75021]:     </memballoon>
Dec 06 06:59:23 user nova-compute[75021]:   </devices>
Dec 06 06:59:23 user nova-compute[75021]: </domain>
Dec 06 06:59:23 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2135327261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2135327261',id=5,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3Lr/kdf8MqVfMx/TeUSMAfVzvaX8ereHkjXoBa9ETDzmMjMiQ9csySNchdYnRT2yeIOuwNGKkvlDgg8mH04y1O/ltV6AdPBXl6ROzuZndpgBoI4b+/RQCPqcSHuavY/Q==',key_name='tempest-keypair-400149348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d75ae216dcb345c79a5c2a4d38e51b38',ramdisk_id='',reservation_id='r-mbynyqjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1923852465',owner_user_name='tempest-AttachVolumeShelveTestJSON-1923852465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4daf20c071c4b5cb826452811323abd',uuid=f9275ae0-ccb1-4c73-b639-9cd243c6ff60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converting VIF {"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=c605d9e6-fce9-495d-b4f3-e2f1e4952633,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605d9e6-fc') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG os_vif [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=c605d9e6-fce9-495d-b4f3-e2f1e4952633,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605d9e6-fc') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '560b7370-d01b-5582-9328-7762e883301b', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc605d9e6-fc, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc605d9e6-fc, col_values=(('qos', UUID('59122b12-09e4-4c78-89d0-255dd27d5e15')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc605d9e6-fc, col_values=(('external_ids', {'iface-id': 'c605d9e6-fce9-495d-b4f3-e2f1e4952633', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:19:e2', 'vm-uuid': 'f9275ae0-ccb1-4c73-b639-9cd243c6ff60'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:23 user nova-compute[75021]: INFO os_vif [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=c605d9e6-fce9-495d-b4f3-e2f1e4952633,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605d9e6-fc')
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] No VIF found with MAC fa:16:3e:a3:19:e2, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 06:59:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:24 user nova-compute[75021]: DEBUG nova.network.neutron [req-b887d914-5598-4870-a85e-9beb85a5eeef req-8867785c-2279-4e25-b0d2-2c31f4497b80 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Updated VIF entry in instance network info cache for port c605d9e6-fce9-495d-b4f3-e2f1e4952633. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 06:59:24 user nova-compute[75021]: DEBUG nova.network.neutron [req-b887d914-5598-4870-a85e-9beb85a5eeef req-8867785c-2279-4e25-b0d2-2c31f4497b80 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Updating instance_info_cache with network_info: [{"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b887d914-5598-4870-a85e-9beb85a5eeef req-8867785c-2279-4e25-b0d2-2c31f4497b80 service nova] Releasing lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "b11b4d87-8700-4c0b-9c2c-aac8162def21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 06:59:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 06:59:30 user nova-compute[75021]: INFO nova.compute.claims [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Claim successful on node user
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 06:59:30 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Instance spawned successfully.
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 06:59:30 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Instance spawned successfully.
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Instance spawned successfully.
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 06:59:30 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Instance spawned successfully.
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: INFO nova.compute.manager [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Took 20.11 seconds to spawn the instance on the hypervisor.
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 06:59:30 user nova-compute[75021]: INFO nova.compute.manager [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Took 17.28 seconds to spawn the instance on the hypervisor.
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 06:59:30 user nova-compute[75021]: INFO nova.compute.manager [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Took 14.66 seconds to spawn the instance on the hypervisor.
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:30 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Instance spawned successfully.
Dec 06 06:59:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 06:59:31 user nova-compute[75021]: INFO nova.compute.manager [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Took 18.54 seconds to build instance.
Dec 06 06:59:31 user nova-compute[75021]: INFO nova.compute.manager [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Took 17.88 seconds to spawn the instance on the hypervisor.
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0a6c1746-aa48-47f1-b831-1e9f07bd54a6 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.756s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:31 user nova-compute[75021]: INFO nova.compute.manager [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Took 21.32 seconds to build instance.
Dec 06 06:59:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e03bf0f-3dde-4ddb-87d2-8b1d6a6017ed tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.658s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:31 user nova-compute[75021]: INFO nova.compute.manager [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Took 16.48 seconds to build instance.
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 06:59:31 user nova-compute[75021]: INFO nova.compute.manager [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Took 18.92 seconds to build instance.
Dec 06 06:59:31 user nova-compute[75021]: INFO nova.compute.manager [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Took 13.56 seconds to spawn the instance on the hypervisor.
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.261s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8c0a344c-c9ef-4efa-92ac-cfd85219e33b tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.787s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-17912748-fb44-4ea6-acf6-570d419caf92 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.123s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.network.neutron [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 06:59:31 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Dec 06 06:59:31 user nova-compute[75021]: INFO nova.compute.manager [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Took 14.68 seconds to build instance.
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7e09394-edb2-4bf4-b204-4abf9b6ca33e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.882s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.policy [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35b5bf2dea0b4d3ca9641dbedff96bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b08a5dd15241a39287b6c00de8f344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 06:59:31 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Creating image(s)
Dec 06 06:59:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "/opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "/opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "/opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "dd9a31b5146134da3f18ae3752e4b747b23a34bb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "dd9a31b5146134da3f18ae3752e4b747b23a34bb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb.part --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG nova.compute.manager [req-62b07676-347f-4b61-ad9d-c4a506617f75 req-a2bef65f-6615-426f-a4c0-950e631fa3e8 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-62b07676-347f-4b61-ad9d-c4a506617f75 req-a2bef65f-6615-426f-a4c0-950e631fa3e8 service nova] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-62b07676-347f-4b61-ad9d-c4a506617f75 req-a2bef65f-6615-426f-a4c0-950e631fa3e8 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-62b07676-347f-4b61-ad9d-c4a506617f75 req-a2bef65f-6615-426f-a4c0-950e631fa3e8 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG nova.compute.manager [req-62b07676-347f-4b61-ad9d-c4a506617f75 req-a2bef65f-6615-426f-a4c0-950e631fa3e8 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] No waiting events found dispatching network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:33 user nova-compute[75021]: WARNING nova.compute.manager [req-62b07676-347f-4b61-ad9d-c4a506617f75 req-a2bef65f-6615-426f-a4c0-950e631fa3e8 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received unexpected event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 for instance with vm_state active and task_state None.
Dec 06 06:59:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb.part --force-share --output=json" returned: 0 in 0.335s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG nova.virt.images [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] 7c5b2855-602b-4532-81af-6a9300136ead was qcow2, converting to raw {{(pid=75021) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb.part /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb.converted {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 06:59:33 user nova-compute[75021]: INFO nova.compute.claims [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Claim successful on node user
Dec 06 06:59:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb.part /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb.converted" returned: 0 in 0.280s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb.converted --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG nova.network.neutron [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Successfully created port: f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb.converted --force-share --output=json" returned: 0 in 0.337s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "dd9a31b5146134da3f18ae3752e4b747b23a34bb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.077s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.850s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb --force-share --output=json" returned: 0 in 0.302s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "dd9a31b5146134da3f18ae3752e4b747b23a34bb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "dd9a31b5146134da3f18ae3752e4b747b23a34bb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 06:59:34 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 06:59:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb --force-share --output=json" returned: 0 in 0.391s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb,backing_fmt=raw /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb,backing_fmt=raw /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk 1073741824" returned: 0 in 0.119s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "dd9a31b5146134da3f18ae3752e4b747b23a34bb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.517s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] No waiting events found dispatching network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:34 user nova-compute[75021]: WARNING nova.compute.manager [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received unexpected event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 for instance with vm_state active and task_state None.
Dec 06 06:59:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Received event network-vif-plugged-193f630e-f83c-4fc1-8840-34b938525ca1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] Acquiring lock "4b621ac2-857c-44be-9466-2f62165c3dfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] No waiting events found dispatching network-vif-plugged-193f630e-f83c-4fc1-8840-34b938525ca1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:34 user nova-compute[75021]: WARNING nova.compute.manager [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Received unexpected event network-vif-plugged-193f630e-f83c-4fc1-8840-34b938525ca1 for instance with vm_state active and task_state None.
Dec 06 06:59:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Received event network-vif-plugged-193f630e-f83c-4fc1-8840-34b938525ca1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] Acquiring lock "4b621ac2-857c-44be-9466-2f62165c3dfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] No waiting events found dispatching network-vif-plugged-193f630e-f83c-4fc1-8840-34b938525ca1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:34 user nova-compute[75021]: WARNING nova.compute.manager [req-522d19c0-0dc5-4cc0-9b2e-ac43a7354e6d req-63921a32-c9bd-45fc-aef9-13b2a632e887 service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Received unexpected event network-vif-plugged-193f630e-f83c-4fc1-8840-34b938525ca1 for instance with vm_state active and task_state None.
Dec 06 06:59:35 user nova-compute[75021]: DEBUG nova.policy [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b2add3b5bca409e89667f7508b8450f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e72540b430409b954290965f157c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 06:59:35 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Creating image(s)
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "/opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "/opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb --force-share --output=json" returned: 0 in 0.464s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.510s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.009s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk --force-share --output=json" returned: 0 in 0.460s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Cannot resize image /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Ensure instance console log exists: /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.318s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk 1073741824" returned: 0 in 0.099s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.423s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG nova.network.neutron [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Successfully updated port: f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "refresh_cache-b11b4d87-8700-4c0b-9c2c-aac8162def21" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquired lock "refresh_cache-b11b4d87-8700-4c0b-9c2c-aac8162def21" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG nova.network.neutron [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.429s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json" returned: 0 in 0.337s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Cannot resize image /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Ensure instance console log exists: /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:36 user nova-compute[75021]: DEBUG nova.network.neutron [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received event network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] Acquiring lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] No waiting events found dispatching network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:37 user nova-compute[75021]: WARNING nova.compute.manager [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received unexpected event network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 for instance with vm_state active and task_state None.
Dec 06 06:59:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Received event network-changed-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Refreshing instance network info cache due to event network-changed-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] Acquiring lock "refresh_cache-b11b4d87-8700-4c0b-9c2c-aac8162def21" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Successfully created port: 3c57d6ef-14c3-4e6f-8e82-e0b33416696d {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG nova.network.neutron [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Updating instance_info_cache with network_info: [{"id": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "address": "fa:16:3e:19:71:a3", "network": {"id": "c9847c4f-b306-45d5-8b2a-2254d491735c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571792892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b08a5dd15241a39287b6c00de8f344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7af4eb9-d3", "ovs_interfaceid": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Releasing lock "refresh_cache-b11b4d87-8700-4c0b-9c2c-aac8162def21" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG nova.compute.manager [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Instance network_info: |[{"id": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "address": "fa:16:3e:19:71:a3", "network": {"id": "c9847c4f-b306-45d5-8b2a-2254d491735c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571792892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b08a5dd15241a39287b6c00de8f344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7af4eb9-d3", "ovs_interfaceid": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] Acquired lock "refresh_cache-b11b4d87-8700-4c0b-9c2c-aac8162def21" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG nova.network.neutron [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Refreshing network info cache for port f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 06:59:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Start _get_guest_xml network_info=[{"id": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "address": "fa:16:3e:19:71:a3", "network": {"id": "c9847c4f-b306-45d5-8b2a-2254d491735c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571792892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b08a5dd15241a39287b6c00de8f344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7af4eb9-d3", "ovs_interfaceid": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:59:18Z,direct_url=<?>,disk_format='qcow2',id=7c5b2855-602b-4532-81af-6a9300136ead,min_disk=0,min_ram=0,name='',owner='32289fcc959f4c0dafdd1bebf9564b10',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:59:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': '7c5b2855-602b-4532-81af-6a9300136ead'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 06:59:37 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:38 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:59:18Z,direct_url=<?>,disk_format='qcow2',id=7c5b2855-602b-4532-81af-6a9300136ead,min_disk=0,min_ram=0,name='',owner='32289fcc959f4c0dafdd1bebf9564b10',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:59:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T06:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1065708926',display_name='tempest-AttachSCSIVolumeTestJSON-server-1065708926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1065708926',id=6,image_ref='7c5b2855-602b-4532-81af-6a9300136ead',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuJbaAlOmefID2TKu5+2cXdv8csMmSWXsq1RIrdShPetbGgNSdC/zVXm3xWuDwYeDcAHbKMzNixfin1QqpKhqw0nSSsWvsS/rTlhBQGEUeDVeqkYFjdH693UqV0GPF8kA==',key_name='tempest-keypair-2094782411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63b08a5dd15241a39287b6c00de8f344',ramdisk_id='',reservation_id='r-h5w63zmk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c5b2855-602b-4532-81af-6a9300136ead',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-588244651',owner_user_name='tempest-AttachSCSIVolumeTestJSON-588244651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35b5bf2dea0b4d3ca9641dbedff96bf6',uuid=b11b4d87-8700-4c0b-9c2c-aac8162def21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "address": "fa:16:3e:19:71:a3", "network": {"id": "c9847c4f-b306-45d5-8b2a-2254d491735c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571792892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b08a5dd15241a39287b6c00de8f344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7af4eb9-d3", "ovs_interfaceid": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Converting VIF {"id": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "address": "fa:16:3e:19:71:a3", "network": {"id": "c9847c4f-b306-45d5-8b2a-2254d491735c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571792892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b08a5dd15241a39287b6c00de8f344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7af4eb9-d3", "ovs_interfaceid": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:71:a3,bridge_name='br-int',has_traffic_filtering=True,id=f7af4eb9-d30e-4abd-988e-3ac2fc3434d5,network=Network(c9847c4f-b306-45d5-8b2a-2254d491735c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7af4eb9-d3') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.objects.instance [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lazy-loading 'pci_devices' on Instance uuid b11b4d87-8700-4c0b-9c2c-aac8162def21 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] End _get_guest_xml xml=<domain type="kvm">
Dec 06 06:59:38 user nova-compute[75021]:   <uuid>b11b4d87-8700-4c0b-9c2c-aac8162def21</uuid>
Dec 06 06:59:38 user nova-compute[75021]:   <name>instance-00000006</name>
Dec 06 06:59:38 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 06:59:38 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 06:59:38 user nova-compute[75021]:   <metadata>
Dec 06 06:59:38 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 06:59:38 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 06:59:38 user nova-compute[75021]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1065708926</nova:name>
Dec 06 06:59:38 user nova-compute[75021]:       <nova:creationTime>2023-12-06 06:59:38</nova:creationTime>
Dec 06 06:59:38 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 06:59:38 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 06:59:38 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 06:59:38 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 06:59:38 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 06:59:38 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 06:59:38 user nova-compute[75021]:       </nova:flavor>
Dec 06 06:59:38 user nova-compute[75021]:       <nova:owner>
Dec 06 06:59:38 user nova-compute[75021]:         <nova:user uuid="35b5bf2dea0b4d3ca9641dbedff96bf6">tempest-AttachSCSIVolumeTestJSON-588244651-project-member</nova:user>
Dec 06 06:59:38 user nova-compute[75021]:         <nova:project uuid="63b08a5dd15241a39287b6c00de8f344">tempest-AttachSCSIVolumeTestJSON-588244651</nova:project>
Dec 06 06:59:38 user nova-compute[75021]:       </nova:owner>
Dec 06 06:59:38 user nova-compute[75021]:       <nova:root type="image" uuid="7c5b2855-602b-4532-81af-6a9300136ead"/>
Dec 06 06:59:38 user nova-compute[75021]:       <nova:ports>
Dec 06 06:59:38 user nova-compute[75021]:         <nova:port uuid="f7af4eb9-d30e-4abd-988e-3ac2fc3434d5">
Dec 06 06:59:38 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 06 06:59:38 user nova-compute[75021]:         </nova:port>
Dec 06 06:59:38 user nova-compute[75021]:       </nova:ports>
Dec 06 06:59:38 user nova-compute[75021]:     </nova:instance>
Dec 06 06:59:38 user nova-compute[75021]:   </metadata>
Dec 06 06:59:38 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 06:59:38 user nova-compute[75021]:     <system>
Dec 06 06:59:38 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 06:59:38 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 06:59:38 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 06:59:38 user nova-compute[75021]:       <entry name="serial">b11b4d87-8700-4c0b-9c2c-aac8162def21</entry>
Dec 06 06:59:38 user nova-compute[75021]:       <entry name="uuid">b11b4d87-8700-4c0b-9c2c-aac8162def21</entry>
Dec 06 06:59:38 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 06:59:38 user nova-compute[75021]:     </system>
Dec 06 06:59:38 user nova-compute[75021]:   </sysinfo>
Dec 06 06:59:38 user nova-compute[75021]:   <os>
Dec 06 06:59:38 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 06:59:38 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 06:59:38 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 06:59:38 user nova-compute[75021]:   </os>
Dec 06 06:59:38 user nova-compute[75021]:   <features>
Dec 06 06:59:38 user nova-compute[75021]:     <acpi/>
Dec 06 06:59:38 user nova-compute[75021]:     <apic/>
Dec 06 06:59:38 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 06:59:38 user nova-compute[75021]:   </features>
Dec 06 06:59:38 user nova-compute[75021]:   <clock offset="utc">
Dec 06 06:59:38 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 06:59:38 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 06:59:38 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 06:59:38 user nova-compute[75021]:   </clock>
Dec 06 06:59:38 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 06:59:38 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 06:59:38 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 06:59:38 user nova-compute[75021]:   </cpu>
Dec 06 06:59:38 user nova-compute[75021]:   <devices>
Dec 06 06:59:38 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 06:59:38 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 06:59:38 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk"/>
Dec 06 06:59:38 user nova-compute[75021]:       <target dev="sda" bus="scsi"/>
Dec 06 06:59:38 user nova-compute[75021]:       <address type="drive" controller="0" unit="0"/>
Dec 06 06:59:38 user nova-compute[75021]:     </disk>
Dec 06 06:59:38 user nova-compute[75021]:     <disk type="file" device="cdrom">
Dec 06 06:59:38 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none"/>
Dec 06 06:59:38 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk.config"/>
Dec 06 06:59:38 user nova-compute[75021]:       <target dev="sdb" bus="scsi"/>
Dec 06 06:59:38 user nova-compute[75021]:       <address type="drive" controller="0" unit="1"/>
Dec 06 06:59:38 user nova-compute[75021]:     </disk>
Dec 06 06:59:38 user nova-compute[75021]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Dec 06 06:59:38 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 06:59:38 user nova-compute[75021]:       <mac address="fa:16:3e:19:71:a3"/>
Dec 06 06:59:38 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:38 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 06:59:38 user nova-compute[75021]:       <target dev="tapf7af4eb9-d3"/>
Dec 06 06:59:38 user nova-compute[75021]:     </interface>
Dec 06 06:59:38 user nova-compute[75021]:     <serial type="pty">
Dec 06 06:59:38 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/console.log" append="off"/>
Dec 06 06:59:38 user nova-compute[75021]:     </serial>
Dec 06 06:59:38 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 06:59:38 user nova-compute[75021]:     <video>
Dec 06 06:59:38 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:38 user nova-compute[75021]:     </video>
Dec 06 06:59:38 user nova-compute[75021]:     <rng model="virtio">
Dec 06 06:59:38 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 06:59:38 user nova-compute[75021]:     </rng>
Dec 06 06:59:38 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 06:59:38 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 06:59:38 user nova-compute[75021]:       <stats period="10"/>
Dec 06 06:59:38 user nova-compute[75021]:     </memballoon>
Dec 06 06:59:38 user nova-compute[75021]:   </devices>
Dec 06 06:59:38 user nova-compute[75021]: </domain>
Dec 06 06:59:38 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T06:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1065708926',display_name='tempest-AttachSCSIVolumeTestJSON-server-1065708926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1065708926',id=6,image_ref='7c5b2855-602b-4532-81af-6a9300136ead',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuJbaAlOmefID2TKu5+2cXdv8csMmSWXsq1RIrdShPetbGgNSdC/zVXm3xWuDwYeDcAHbKMzNixfin1QqpKhqw0nSSsWvsS/rTlhBQGEUeDVeqkYFjdH693UqV0GPF8kA==',key_name='tempest-keypair-2094782411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63b08a5dd15241a39287b6c00de8f344',ramdisk_id='',reservation_id='r-h5w63zmk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c5b2855-602b-4532-81af-6a9300136ead',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-588244651',owner_user_name='tempest-AttachSCSIVolumeTestJSON-588244651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35b5bf2dea0b4d3ca9641dbedff96bf6',uuid=b11b4d87-8700-4c0b-9c2c-aac8162def21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "address": "fa:16:3e:19:71:a3", "network": {"id": "c9847c4f-b306-45d5-8b2a-2254d491735c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571792892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b08a5dd15241a39287b6c00de8f344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7af4eb9-d3", "ovs_interfaceid": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Converting VIF {"id": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "address": "fa:16:3e:19:71:a3", "network": {"id": "c9847c4f-b306-45d5-8b2a-2254d491735c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571792892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b08a5dd15241a39287b6c00de8f344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7af4eb9-d3", "ovs_interfaceid": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:71:a3,bridge_name='br-int',has_traffic_filtering=True,id=f7af4eb9-d30e-4abd-988e-3ac2fc3434d5,network=Network(c9847c4f-b306-45d5-8b2a-2254d491735c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7af4eb9-d3') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG os_vif [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:71:a3,bridge_name='br-int',has_traffic_filtering=True,id=f7af4eb9-d30e-4abd-988e-3ac2fc3434d5,network=Network(c9847c4f-b306-45d5-8b2a-2254d491735c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7af4eb9-d3') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc9b8e2a-b977-555a-b031-75de9c805d3b', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7af4eb9-d3, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7af4eb9-d3, col_values=(('qos', UUID('b334e4f9-96a4-4fb7-8877-7c0be300d295')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7af4eb9-d3, col_values=(('external_ids', {'iface-id': 'f7af4eb9-d30e-4abd-988e-3ac2fc3434d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:71:a3', 'vm-uuid': 'b11b4d87-8700-4c0b-9c2c-aac8162def21'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:38 user nova-compute[75021]: INFO os_vif [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:71:a3,bridge_name='br-int',has_traffic_filtering=True,id=f7af4eb9-d30e-4abd-988e-3ac2fc3434d5,network=Network(c9847c4f-b306-45d5-8b2a-2254d491735c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7af4eb9-d3')
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] No BDM found with device name sda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] No VIF found with MAC fa:16:3e:19:71:a3, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 06:59:38 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Using config drive
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.network.neutron [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Updated VIF entry in instance network info cache for port f7af4eb9-d30e-4abd-988e-3ac2fc3434d5. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.network.neutron [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Updating instance_info_cache with network_info: [{"id": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "address": "fa:16:3e:19:71:a3", "network": {"id": "c9847c4f-b306-45d5-8b2a-2254d491735c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571792892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b08a5dd15241a39287b6c00de8f344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7af4eb9-d3", "ovs_interfaceid": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] Releasing lock "refresh_cache-b11b4d87-8700-4c0b-9c2c-aac8162def21" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received event network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] Acquiring lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] No waiting events found dispatching network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:38 user nova-compute[75021]: WARNING nova.compute.manager [req-e3325f9a-1bee-4085-a162-5628e672e569 req-459c6c7a-d863-461b-a7d8-48f92053c8a4 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received unexpected event network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 for instance with vm_state active and task_state None.
Dec 06 06:59:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Creating config drive at /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk.config
Dec 06 06:59:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpc1g26i1z {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpc1g26i1z" returned: 0 in 0.095s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Successfully updated port: 3c57d6ef-14c3-4e6f-8e82-e0b33416696d {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 06:59:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "refresh_cache-9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquired lock "refresh_cache-9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 06:59:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-7e88f833-4023-4041-9897-a8c37395ab44 req-703c6401-f486-48f9-9ca8-f84a83f3c5f4 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Received event network-changed-3c57d6ef-14c3-4e6f-8e82-e0b33416696d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-7e88f833-4023-4041-9897-a8c37395ab44 req-703c6401-f486-48f9-9ca8-f84a83f3c5f4 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Refreshing instance network info cache due to event network-changed-3c57d6ef-14c3-4e6f-8e82-e0b33416696d. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 06:59:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7e88f833-4023-4041-9897-a8c37395ab44 req-703c6401-f486-48f9-9ca8-f84a83f3c5f4 service nova] Acquiring lock "refresh_cache-9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Updating instance_info_cache with network_info: [{"id": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "address": "fa:16:3e:5f:22:74", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c57d6ef-14", "ovs_interfaceid": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Releasing lock "refresh_cache-9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Instance network_info: |[{"id": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "address": "fa:16:3e:5f:22:74", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c57d6ef-14", "ovs_interfaceid": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7e88f833-4023-4041-9897-a8c37395ab44 req-703c6401-f486-48f9-9ca8-f84a83f3c5f4 service nova] Acquired lock "refresh_cache-9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.network.neutron [req-7e88f833-4023-4041-9897-a8c37395ab44 req-703c6401-f486-48f9-9ca8-f84a83f3c5f4 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Refreshing network info cache for port 3c57d6ef-14c3-4e6f-8e82-e0b33416696d {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Start _get_guest_xml network_info=[{"id": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "address": "fa:16:3e:5f:22:74", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c57d6ef-14", "ovs_interfaceid": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 06:59:41 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:41 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-798112927',display_name='tempest-VolumesAdminNegativeTest-server-798112927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-798112927',id=7,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCh5h1ABaLhquTEhAAm7lt90Ql6YNdaXdiEO43OEcufPT+gQzOP/rFX1GTpCMqjWxMkSF3GNbhYI9VvePmWc/Q56QGDKTqbTRAtAC+BfLingkHxciODwQ8m2GIE+UBJ+iQ==',key_name='tempest-keypair-134819701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79e72540b430409b954290965f157c43',ramdisk_id='',reservation_id='r-mkdd5ida',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1751614012',owner_user_name='tempest-VolumesAdminNegativeTest-1751614012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2add3b5bca409e89667f7508b8450f',uuid=9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "address": "fa:16:3e:5f:22:74", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c57d6ef-14", "ovs_interfaceid": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Converting VIF {"id": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "address": "fa:16:3e:5f:22:74", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c57d6ef-14", "ovs_interfaceid": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:22:74,bridge_name='br-int',has_traffic_filtering=True,id=3c57d6ef-14c3-4e6f-8e82-e0b33416696d,network=Network(1bf2263d-db40-4f7c-bf4f-9839edad2d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c57d6ef-14') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] End _get_guest_xml xml=<domain type="kvm">
Dec 06 06:59:41 user nova-compute[75021]:   <uuid>9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a</uuid>
Dec 06 06:59:41 user nova-compute[75021]:   <name>instance-00000007</name>
Dec 06 06:59:41 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 06:59:41 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 06:59:41 user nova-compute[75021]:   <metadata>
Dec 06 06:59:41 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 06:59:41 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 06:59:41 user nova-compute[75021]:       <nova:name>tempest-VolumesAdminNegativeTest-server-798112927</nova:name>
Dec 06 06:59:41 user nova-compute[75021]:       <nova:creationTime>2023-12-06 06:59:41</nova:creationTime>
Dec 06 06:59:41 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 06:59:41 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 06:59:41 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 06:59:41 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 06:59:41 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 06:59:41 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 06:59:41 user nova-compute[75021]:       </nova:flavor>
Dec 06 06:59:41 user nova-compute[75021]:       <nova:owner>
Dec 06 06:59:41 user nova-compute[75021]:         <nova:user uuid="6b2add3b5bca409e89667f7508b8450f">tempest-VolumesAdminNegativeTest-1751614012-project-member</nova:user>
Dec 06 06:59:41 user nova-compute[75021]:         <nova:project uuid="79e72540b430409b954290965f157c43">tempest-VolumesAdminNegativeTest-1751614012</nova:project>
Dec 06 06:59:41 user nova-compute[75021]:       </nova:owner>
Dec 06 06:59:41 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 06:59:41 user nova-compute[75021]:       <nova:ports>
Dec 06 06:59:41 user nova-compute[75021]:         <nova:port uuid="3c57d6ef-14c3-4e6f-8e82-e0b33416696d">
Dec 06 06:59:41 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 06:59:41 user nova-compute[75021]:         </nova:port>
Dec 06 06:59:41 user nova-compute[75021]:       </nova:ports>
Dec 06 06:59:41 user nova-compute[75021]:     </nova:instance>
Dec 06 06:59:41 user nova-compute[75021]:   </metadata>
Dec 06 06:59:41 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 06:59:41 user nova-compute[75021]:     <system>
Dec 06 06:59:41 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 06:59:41 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 06:59:41 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 06:59:41 user nova-compute[75021]:       <entry name="serial">9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a</entry>
Dec 06 06:59:41 user nova-compute[75021]:       <entry name="uuid">9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a</entry>
Dec 06 06:59:41 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 06:59:41 user nova-compute[75021]:     </system>
Dec 06 06:59:41 user nova-compute[75021]:   </sysinfo>
Dec 06 06:59:41 user nova-compute[75021]:   <os>
Dec 06 06:59:41 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 06:59:41 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 06:59:41 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 06:59:41 user nova-compute[75021]:   </os>
Dec 06 06:59:41 user nova-compute[75021]:   <features>
Dec 06 06:59:41 user nova-compute[75021]:     <acpi/>
Dec 06 06:59:41 user nova-compute[75021]:     <apic/>
Dec 06 06:59:41 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 06:59:41 user nova-compute[75021]:   </features>
Dec 06 06:59:41 user nova-compute[75021]:   <clock offset="utc">
Dec 06 06:59:41 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 06:59:41 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 06:59:41 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 06:59:41 user nova-compute[75021]:   </clock>
Dec 06 06:59:41 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 06:59:41 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 06:59:41 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 06:59:41 user nova-compute[75021]:   </cpu>
Dec 06 06:59:41 user nova-compute[75021]:   <devices>
Dec 06 06:59:41 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 06:59:41 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 06:59:41 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk"/>
Dec 06 06:59:41 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 06:59:41 user nova-compute[75021]:     </disk>
Dec 06 06:59:41 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 06:59:41 user nova-compute[75021]:       <mac address="fa:16:3e:5f:22:74"/>
Dec 06 06:59:41 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:41 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 06:59:41 user nova-compute[75021]:       <target dev="tap3c57d6ef-14"/>
Dec 06 06:59:41 user nova-compute[75021]:     </interface>
Dec 06 06:59:41 user nova-compute[75021]:     <serial type="pty">
Dec 06 06:59:41 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/console.log" append="off"/>
Dec 06 06:59:41 user nova-compute[75021]:     </serial>
Dec 06 06:59:41 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 06:59:41 user nova-compute[75021]:     <video>
Dec 06 06:59:41 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:41 user nova-compute[75021]:     </video>
Dec 06 06:59:41 user nova-compute[75021]:     <rng model="virtio">
Dec 06 06:59:41 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 06:59:41 user nova-compute[75021]:     </rng>
Dec 06 06:59:41 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 06:59:41 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 06:59:41 user nova-compute[75021]:       <stats period="10"/>
Dec 06 06:59:41 user nova-compute[75021]:     </memballoon>
Dec 06 06:59:41 user nova-compute[75021]:   </devices>
Dec 06 06:59:41 user nova-compute[75021]: </domain>
Dec 06 06:59:41 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-798112927',display_name='tempest-VolumesAdminNegativeTest-server-798112927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-798112927',id=7,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCh5h1ABaLhquTEhAAm7lt90Ql6YNdaXdiEO43OEcufPT+gQzOP/rFX1GTpCMqjWxMkSF3GNbhYI9VvePmWc/Q56QGDKTqbTRAtAC+BfLingkHxciODwQ8m2GIE+UBJ+iQ==',key_name='tempest-keypair-134819701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79e72540b430409b954290965f157c43',ramdisk_id='',reservation_id='r-mkdd5ida',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1751614012',owner_user_name='tempest-VolumesAdminNegativeTest-1751614012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2add3b5bca409e89667f7508b8450f',uuid=9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "address": "fa:16:3e:5f:22:74", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c57d6ef-14", "ovs_interfaceid": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Converting VIF {"id": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "address": "fa:16:3e:5f:22:74", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c57d6ef-14", "ovs_interfaceid": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:22:74,bridge_name='br-int',has_traffic_filtering=True,id=3c57d6ef-14c3-4e6f-8e82-e0b33416696d,network=Network(1bf2263d-db40-4f7c-bf4f-9839edad2d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c57d6ef-14') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG os_vif [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:22:74,bridge_name='br-int',has_traffic_filtering=True,id=3c57d6ef-14c3-4e6f-8e82-e0b33416696d,network=Network(1bf2263d-db40-4f7c-bf4f-9839edad2d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c57d6ef-14') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aac7c1b9-21c8-5736-9025-6acc2391ac6a', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c57d6ef-14, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c57d6ef-14, col_values=(('qos', UUID('c02dcebf-97ab-4d4d-b652-a9009ed6837f')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c57d6ef-14, col_values=(('external_ids', {'iface-id': '3c57d6ef-14c3-4e6f-8e82-e0b33416696d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:22:74', 'vm-uuid': '9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:41 user nova-compute[75021]: INFO os_vif [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:22:74,bridge_name='br-int',has_traffic_filtering=True,id=3c57d6ef-14c3-4e6f-8e82-e0b33416696d,network=Network(1bf2263d-db40-4f7c-bf4f-9839edad2d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c57d6ef-14')
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] No VIF found with MAC fa:16:3e:5f:22:74, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG nova.network.neutron [req-7e88f833-4023-4041-9897-a8c37395ab44 req-703c6401-f486-48f9-9ca8-f84a83f3c5f4 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Updated VIF entry in instance network info cache for port 3c57d6ef-14c3-4e6f-8e82-e0b33416696d. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG nova.network.neutron [req-7e88f833-4023-4041-9897-a8c37395ab44 req-703c6401-f486-48f9-9ca8-f84a83f3c5f4 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Updating instance_info_cache with network_info: [{"id": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "address": "fa:16:3e:5f:22:74", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c57d6ef-14", "ovs_interfaceid": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7e88f833-4023-4041-9897-a8c37395ab44 req-703c6401-f486-48f9-9ca8-f84a83f3c5f4 service nova] Releasing lock "refresh_cache-9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 06:59:42 user nova-compute[75021]: INFO nova.compute.claims [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Claim successful on node user
Dec 06 06:59:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Acquiring lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.205s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 06:59:42 user nova-compute[75021]: INFO nova.compute.claims [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Claim successful on node user
Dec 06 06:59:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 06:59:42 user nova-compute[75021]: DEBUG nova.network.neutron [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 06:59:42 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 06:59:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG nova.policy [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2de88a1aa57403e8c6614458998b059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6fd76416e04d298f16ae4dffbb2191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 06:59:43 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Creating image(s)
Dec 06 06:59:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.293s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.089s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.381s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG nova.network.neutron [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk 1073741824" returned: 0 in 0.103s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.490s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:44 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 06:59:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG nova.policy [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5c2decab47e4837a24ac498b9b065cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6a7955718c44d79b908d650ea3bbe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.452s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 06:59:44 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Creating image(s)
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Acquiring lock "/opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "/opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "/opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Cannot resize image /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Ensure instance console log exists: /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.356s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.286s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Successfully created port: 94173bea-6e40-4bcc-afe0-031fb7fde7fa {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk 1073741824" returned: 0 in 0.090s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.387s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 06:59:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Instance spawned successfully.
Dec 06 06:59:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.285s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:45 user nova-compute[75021]: INFO nova.compute.manager [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Took 13.76 seconds to spawn the instance on the hypervisor.
Dec 06 06:59:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 06:59:45 user nova-compute[75021]: INFO nova.compute.manager [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Took 17.72 seconds to build instance.
Dec 06 06:59:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-85ce11df-6b2b-48ae-be07-fc1b88589d1a tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.883s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Cannot resize image /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Ensure instance console log exists: /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-30bd6e64-4fc8-4a7e-a9f2-2513c74e2702 req-23bf7e78-cd40-4aea-ad99-2b9fa09a8b84 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-30bd6e64-4fc8-4a7e-a9f2-2513c74e2702 req-23bf7e78-cd40-4aea-ad99-2b9fa09a8b84 service nova] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-30bd6e64-4fc8-4a7e-a9f2-2513c74e2702 req-23bf7e78-cd40-4aea-ad99-2b9fa09a8b84 service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-30bd6e64-4fc8-4a7e-a9f2-2513c74e2702 req-23bf7e78-cd40-4aea-ad99-2b9fa09a8b84 service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-30bd6e64-4fc8-4a7e-a9f2-2513c74e2702 req-23bf7e78-cd40-4aea-ad99-2b9fa09a8b84 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] No waiting events found dispatching network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:46 user nova-compute[75021]: WARNING nova.compute.manager [req-30bd6e64-4fc8-4a7e-a9f2-2513c74e2702 req-23bf7e78-cd40-4aea-ad99-2b9fa09a8b84 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received unexpected event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b for instance with vm_state active and task_state None.
Dec 06 06:59:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:46 user nova-compute[75021]: DEBUG nova.network.neutron [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Successfully created port: a4942c0a-b7fd-467f-80e0-fc4f66261e12 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 06:59:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 06:59:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 06:59:46 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Instance spawned successfully.
Dec 06 06:59:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 06:59:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:47 user nova-compute[75021]: INFO nova.compute.manager [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Took 12.06 seconds to spawn the instance on the hypervisor.
Dec 06 06:59:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 06:59:47 user nova-compute[75021]: INFO nova.compute.manager [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Took 14.13 seconds to build instance.
Dec 06 06:59:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e03dc6cd-8d07-483f-a373-f35a9e60618f tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.370s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Successfully updated port: 94173bea-6e40-4bcc-afe0-031fb7fde7fa {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 06:59:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquired lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 06:59:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.network.neutron [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Successfully updated port: a4942c0a-b7fd-467f-80e0-fc4f66261e12 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Acquiring lock "refresh_cache-9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Acquired lock "refresh_cache-9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.network.neutron [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-f1ba736c-b53d-43bf-aa6b-d1e9c4353e81 req-e2c3f648-9fe3-4e5f-8bbe-10bce9eb2335 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Received event network-changed-a4942c0a-b7fd-467f-80e0-fc4f66261e12 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-f1ba736c-b53d-43bf-aa6b-d1e9c4353e81 req-e2c3f648-9fe3-4e5f-8bbe-10bce9eb2335 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Refreshing instance network info cache due to event network-changed-a4942c0a-b7fd-467f-80e0-fc4f66261e12. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f1ba736c-b53d-43bf-aa6b-d1e9c4353e81 req-e2c3f648-9fe3-4e5f-8bbe-10bce9eb2335 service nova] Acquiring lock "refresh_cache-9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.network.neutron [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-7013a71f-8c10-4e3e-874d-d21bcf268fba req-6a7f3edb-70ef-4df3-a0f4-7550a765af5c service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7013a71f-8c10-4e3e-874d-d21bcf268fba req-6a7f3edb-70ef-4df3-a0f4-7550a765af5c service nova] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7013a71f-8c10-4e3e-874d-d21bcf268fba req-6a7f3edb-70ef-4df3-a0f4-7550a765af5c service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7013a71f-8c10-4e3e-874d-d21bcf268fba req-6a7f3edb-70ef-4df3-a0f4-7550a765af5c service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-7013a71f-8c10-4e3e-874d-d21bcf268fba req-6a7f3edb-70ef-4df3-a0f4-7550a765af5c service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] No waiting events found dispatching network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:48 user nova-compute[75021]: WARNING nova.compute.manager [req-7013a71f-8c10-4e3e-874d-d21bcf268fba req-6a7f3edb-70ef-4df3-a0f4-7550a765af5c service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received unexpected event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b for instance with vm_state active and task_state None.
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-7013a71f-8c10-4e3e-874d-d21bcf268fba req-6a7f3edb-70ef-4df3-a0f4-7550a765af5c service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received event network-changed-94173bea-6e40-4bcc-afe0-031fb7fde7fa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-7013a71f-8c10-4e3e-874d-d21bcf268fba req-6a7f3edb-70ef-4df3-a0f4-7550a765af5c service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Refreshing instance network info cache due to event network-changed-94173bea-6e40-4bcc-afe0-031fb7fde7fa. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7013a71f-8c10-4e3e-874d-d21bcf268fba req-6a7f3edb-70ef-4df3-a0f4-7550a765af5c service nova] Acquiring lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.network.neutron [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Updating instance_info_cache with network_info: [{"id": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "address": "fa:16:3e:91:f2:66", "network": {"id": "ad977a07-4f22-4e25-a953-2c36fdc6aafd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-324709235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94173bea-6e", "ovs_interfaceid": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Releasing lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Instance network_info: |[{"id": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "address": "fa:16:3e:91:f2:66", "network": {"id": "ad977a07-4f22-4e25-a953-2c36fdc6aafd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-324709235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94173bea-6e", "ovs_interfaceid": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7013a71f-8c10-4e3e-874d-d21bcf268fba req-6a7f3edb-70ef-4df3-a0f4-7550a765af5c service nova] Acquired lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.network.neutron [req-7013a71f-8c10-4e3e-874d-d21bcf268fba req-6a7f3edb-70ef-4df3-a0f4-7550a765af5c service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Refreshing network info cache for port 94173bea-6e40-4bcc-afe0-031fb7fde7fa {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Start _get_guest_xml network_info=[{"id": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "address": "fa:16:3e:91:f2:66", "network": {"id": "ad977a07-4f22-4e25-a953-2c36fdc6aafd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-324709235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94173bea-6e", "ovs_interfaceid": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 06:59:48 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:48 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T06:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9053064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9053064',id=8,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfxPXtIc47E18m6Z4qikWqTz2rTTY3bjnRhlRvdXGj9tpXYrXf76otmdZT3oE+W47oRVEPxUwhFLz0Caec3zbc1/KigN/WcfjgJ+3ELWkAH6KQ8DaAIyV9KAyPj8VZgwQ==',key_name='tempest-keypair-399869130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb6fd76416e04d298f16ae4dffbb2191',ramdisk_id='',reservation_id='r-21w39m30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1423166060',owner_user_name='tempest-TaggedAttachmentsTest-1423166060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2de88a1aa57403e8c6614458998b059',uuid=91eeb5a9-b6de-40c0-bc37-49768cc15c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "address": "fa:16:3e:91:f2:66", "network": {"id": "ad977a07-4f22-4e25-a953-2c36fdc6aafd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-324709235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94173bea-6e", "ovs_interfaceid": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Converting VIF {"id": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "address": "fa:16:3e:91:f2:66", "network": {"id": "ad977a07-4f22-4e25-a953-2c36fdc6aafd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-324709235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94173bea-6e", "ovs_interfaceid": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=94173bea-6e40-4bcc-afe0-031fb7fde7fa,network=Network(ad977a07-4f22-4e25-a953-2c36fdc6aafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94173bea-6e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.objects.instance [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lazy-loading 'pci_devices' on Instance uuid 91eeb5a9-b6de-40c0-bc37-49768cc15c9c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.network.neutron [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Updating instance_info_cache with network_info: [{"id": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "address": "fa:16:3e:eb:6e:d5", "network": {"id": "fe4e2805-4027-4464-b44a-98d002a04c2f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-103297198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6a7955718c44d79b908d650ea3bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4942c0a-b7", "ovs_interfaceid": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] End _get_guest_xml xml=<domain type="kvm">
Dec 06 06:59:48 user nova-compute[75021]:   <uuid>91eeb5a9-b6de-40c0-bc37-49768cc15c9c</uuid>
Dec 06 06:59:48 user nova-compute[75021]:   <name>instance-00000008</name>
Dec 06 06:59:48 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 06:59:48 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 06:59:48 user nova-compute[75021]:   <metadata>
Dec 06 06:59:48 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 06:59:48 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 06:59:48 user nova-compute[75021]:       <nova:name>tempest-device-tagging-server-9053064</nova:name>
Dec 06 06:59:48 user nova-compute[75021]:       <nova:creationTime>2023-12-06 06:59:48</nova:creationTime>
Dec 06 06:59:48 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 06:59:48 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 06:59:48 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 06:59:48 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 06:59:48 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 06:59:48 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 06:59:48 user nova-compute[75021]:       </nova:flavor>
Dec 06 06:59:48 user nova-compute[75021]:       <nova:owner>
Dec 06 06:59:48 user nova-compute[75021]:         <nova:user uuid="f2de88a1aa57403e8c6614458998b059">tempest-TaggedAttachmentsTest-1423166060-project-member</nova:user>
Dec 06 06:59:48 user nova-compute[75021]:         <nova:project uuid="eb6fd76416e04d298f16ae4dffbb2191">tempest-TaggedAttachmentsTest-1423166060</nova:project>
Dec 06 06:59:48 user nova-compute[75021]:       </nova:owner>
Dec 06 06:59:48 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 06:59:48 user nova-compute[75021]:       <nova:ports>
Dec 06 06:59:48 user nova-compute[75021]:         <nova:port uuid="94173bea-6e40-4bcc-afe0-031fb7fde7fa">
Dec 06 06:59:48 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 06:59:48 user nova-compute[75021]:         </nova:port>
Dec 06 06:59:48 user nova-compute[75021]:       </nova:ports>
Dec 06 06:59:48 user nova-compute[75021]:     </nova:instance>
Dec 06 06:59:48 user nova-compute[75021]:   </metadata>
Dec 06 06:59:48 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 06:59:48 user nova-compute[75021]:     <system>
Dec 06 06:59:48 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 06:59:48 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 06:59:48 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 06:59:48 user nova-compute[75021]:       <entry name="serial">91eeb5a9-b6de-40c0-bc37-49768cc15c9c</entry>
Dec 06 06:59:48 user nova-compute[75021]:       <entry name="uuid">91eeb5a9-b6de-40c0-bc37-49768cc15c9c</entry>
Dec 06 06:59:48 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 06:59:48 user nova-compute[75021]:     </system>
Dec 06 06:59:48 user nova-compute[75021]:   </sysinfo>
Dec 06 06:59:48 user nova-compute[75021]:   <os>
Dec 06 06:59:48 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 06:59:48 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 06:59:48 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 06:59:48 user nova-compute[75021]:   </os>
Dec 06 06:59:48 user nova-compute[75021]:   <features>
Dec 06 06:59:48 user nova-compute[75021]:     <acpi/>
Dec 06 06:59:48 user nova-compute[75021]:     <apic/>
Dec 06 06:59:48 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 06:59:48 user nova-compute[75021]:   </features>
Dec 06 06:59:48 user nova-compute[75021]:   <clock offset="utc">
Dec 06 06:59:48 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 06:59:48 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 06:59:48 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 06:59:48 user nova-compute[75021]:   </clock>
Dec 06 06:59:48 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 06:59:48 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 06:59:48 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 06:59:48 user nova-compute[75021]:   </cpu>
Dec 06 06:59:48 user nova-compute[75021]:   <devices>
Dec 06 06:59:48 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 06:59:48 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 06:59:48 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk"/>
Dec 06 06:59:48 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 06:59:48 user nova-compute[75021]:     </disk>
Dec 06 06:59:48 user nova-compute[75021]:     <disk type="file" device="cdrom">
Dec 06 06:59:48 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none"/>
Dec 06 06:59:48 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk.config"/>
Dec 06 06:59:48 user nova-compute[75021]:       <target dev="hda" bus="ide"/>
Dec 06 06:59:48 user nova-compute[75021]:     </disk>
Dec 06 06:59:48 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 06:59:48 user nova-compute[75021]:       <mac address="fa:16:3e:91:f2:66"/>
Dec 06 06:59:48 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:48 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 06:59:48 user nova-compute[75021]:       <target dev="tap94173bea-6e"/>
Dec 06 06:59:48 user nova-compute[75021]:     </interface>
Dec 06 06:59:48 user nova-compute[75021]:     <serial type="pty">
Dec 06 06:59:48 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/console.log" append="off"/>
Dec 06 06:59:48 user nova-compute[75021]:     </serial>
Dec 06 06:59:48 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 06:59:48 user nova-compute[75021]:     <video>
Dec 06 06:59:48 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:48 user nova-compute[75021]:     </video>
Dec 06 06:59:48 user nova-compute[75021]:     <rng model="virtio">
Dec 06 06:59:48 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 06:59:48 user nova-compute[75021]:     </rng>
Dec 06 06:59:48 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 06:59:48 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 06:59:48 user nova-compute[75021]:       <stats period="10"/>
Dec 06 06:59:48 user nova-compute[75021]:     </memballoon>
Dec 06 06:59:48 user nova-compute[75021]:   </devices>
Dec 06 06:59:48 user nova-compute[75021]: </domain>
Dec 06 06:59:48 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T06:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9053064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9053064',id=8,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfxPXtIc47E18m6Z4qikWqTz2rTTY3bjnRhlRvdXGj9tpXYrXf76otmdZT3oE+W47oRVEPxUwhFLz0Caec3zbc1/KigN/WcfjgJ+3ELWkAH6KQ8DaAIyV9KAyPj8VZgwQ==',key_name='tempest-keypair-399869130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb6fd76416e04d298f16ae4dffbb2191',ramdisk_id='',reservation_id='r-21w39m30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1423166060',owner_user_name='tempest-TaggedAttachmentsTest-1423166060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2de88a1aa57403e8c6614458998b059',uuid=91eeb5a9-b6de-40c0-bc37-49768cc15c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "address": "fa:16:3e:91:f2:66", "network": {"id": "ad977a07-4f22-4e25-a953-2c36fdc6aafd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-324709235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94173bea-6e", "ovs_interfaceid": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Converting VIF {"id": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "address": "fa:16:3e:91:f2:66", "network": {"id": "ad977a07-4f22-4e25-a953-2c36fdc6aafd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-324709235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94173bea-6e", "ovs_interfaceid": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=94173bea-6e40-4bcc-afe0-031fb7fde7fa,network=Network(ad977a07-4f22-4e25-a953-2c36fdc6aafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94173bea-6e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG os_vif [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=94173bea-6e40-4bcc-afe0-031fb7fde7fa,network=Network(ad977a07-4f22-4e25-a953-2c36fdc6aafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94173bea-6e') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Releasing lock "refresh_cache-9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.compute.manager [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Instance network_info: |[{"id": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "address": "fa:16:3e:eb:6e:d5", "network": {"id": "fe4e2805-4027-4464-b44a-98d002a04c2f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-103297198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6a7955718c44d79b908d650ea3bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4942c0a-b7", "ovs_interfaceid": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '005caff0-297d-5366-af11-1e436ae89769', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f1ba736c-b53d-43bf-aa6b-d1e9c4353e81 req-e2c3f648-9fe3-4e5f-8bbe-10bce9eb2335 service nova] Acquired lock "refresh_cache-9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.network.neutron [req-f1ba736c-b53d-43bf-aa6b-d1e9c4353e81 req-e2c3f648-9fe3-4e5f-8bbe-10bce9eb2335 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Refreshing network info cache for port a4942c0a-b7fd-467f-80e0-fc4f66261e12 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Start _get_guest_xml network_info=[{"id": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "address": "fa:16:3e:eb:6e:d5", "network": {"id": "fe4e2805-4027-4464-b44a-98d002a04c2f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-103297198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6a7955718c44d79b908d650ea3bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4942c0a-b7", "ovs_interfaceid": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94173bea-6e, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94173bea-6e, col_values=(('qos', UUID('61c0b37a-4024-4eb3-8cf6-88fd10445d00')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94173bea-6e, col_values=(('external_ids', {'iface-id': '94173bea-6e40-4bcc-afe0-031fb7fde7fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:f2:66', 'vm-uuid': '91eeb5a9-b6de-40c0-bc37-49768cc15c9c'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:48 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:48 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 06:59:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:48 user nova-compute[75021]: INFO os_vif [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=94173bea-6e40-4bcc-afe0-031fb7fde7fa,network=Network(ad977a07-4f22-4e25-a953-2c36fdc6aafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94173bea-6e')
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1185390691',display_name='tempest-VolumesAssistedSnapshotsTest-server-1185390691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1185390691',id=9,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3Tdw8ld6HVt5lN5liZ5oZHohcW+g1AQHl5ZRg8GsUk1QLz6Vhk7QGdQ7dtThHbS/FGZpb2tddpYPVJD4IJ1xPn9HzxDGGjVnbJbEq7d9dHCJK0vglMa2bubjiCJTNwhA==',key_name='tempest-keypair-249771813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de6a7955718c44d79b908d650ea3bbe5',ramdisk_id='',reservation_id='r-8vg1ona4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-678336041',owner_user_name='tempest-VolumesAssistedSnapshotsTest-678336041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5c2decab47e4837a24ac498b9b065cb',uuid=9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "address": "fa:16:3e:eb:6e:d5", "network": {"id": "fe4e2805-4027-4464-b44a-98d002a04c2f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-103297198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6a7955718c44d79b908d650ea3bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4942c0a-b7", "ovs_interfaceid": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Converting VIF {"id": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "address": "fa:16:3e:eb:6e:d5", "network": {"id": "fe4e2805-4027-4464-b44a-98d002a04c2f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-103297198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6a7955718c44d79b908d650ea3bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4942c0a-b7", "ovs_interfaceid": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:6e:d5,bridge_name='br-int',has_traffic_filtering=True,id=a4942c0a-b7fd-467f-80e0-fc4f66261e12,network=Network(fe4e2805-4027-4464-b44a-98d002a04c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4942c0a-b7') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:48 user nova-compute[75021]: DEBUG nova.objects.instance [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lazy-loading 'pci_devices' on Instance uuid 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] End _get_guest_xml xml=<domain type="kvm">
Dec 06 06:59:49 user nova-compute[75021]:   <uuid>9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0</uuid>
Dec 06 06:59:49 user nova-compute[75021]:   <name>instance-00000009</name>
Dec 06 06:59:49 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 06:59:49 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 06:59:49 user nova-compute[75021]:   <metadata>
Dec 06 06:59:49 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 06:59:49 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 06:59:49 user nova-compute[75021]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1185390691</nova:name>
Dec 06 06:59:49 user nova-compute[75021]:       <nova:creationTime>2023-12-06 06:59:48</nova:creationTime>
Dec 06 06:59:49 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 06:59:49 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 06:59:49 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 06:59:49 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 06:59:49 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 06:59:49 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 06:59:49 user nova-compute[75021]:       </nova:flavor>
Dec 06 06:59:49 user nova-compute[75021]:       <nova:owner>
Dec 06 06:59:49 user nova-compute[75021]:         <nova:user uuid="f5c2decab47e4837a24ac498b9b065cb">tempest-VolumesAssistedSnapshotsTest-678336041-project-member</nova:user>
Dec 06 06:59:49 user nova-compute[75021]:         <nova:project uuid="de6a7955718c44d79b908d650ea3bbe5">tempest-VolumesAssistedSnapshotsTest-678336041</nova:project>
Dec 06 06:59:49 user nova-compute[75021]:       </nova:owner>
Dec 06 06:59:49 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 06:59:49 user nova-compute[75021]:       <nova:ports>
Dec 06 06:59:49 user nova-compute[75021]:         <nova:port uuid="a4942c0a-b7fd-467f-80e0-fc4f66261e12">
Dec 06 06:59:49 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 06:59:49 user nova-compute[75021]:         </nova:port>
Dec 06 06:59:49 user nova-compute[75021]:       </nova:ports>
Dec 06 06:59:49 user nova-compute[75021]:     </nova:instance>
Dec 06 06:59:49 user nova-compute[75021]:   </metadata>
Dec 06 06:59:49 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 06:59:49 user nova-compute[75021]:     <system>
Dec 06 06:59:49 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 06:59:49 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 06:59:49 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 06:59:49 user nova-compute[75021]:       <entry name="serial">9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0</entry>
Dec 06 06:59:49 user nova-compute[75021]:       <entry name="uuid">9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0</entry>
Dec 06 06:59:49 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 06:59:49 user nova-compute[75021]:     </system>
Dec 06 06:59:49 user nova-compute[75021]:   </sysinfo>
Dec 06 06:59:49 user nova-compute[75021]:   <os>
Dec 06 06:59:49 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 06:59:49 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 06:59:49 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 06:59:49 user nova-compute[75021]:   </os>
Dec 06 06:59:49 user nova-compute[75021]:   <features>
Dec 06 06:59:49 user nova-compute[75021]:     <acpi/>
Dec 06 06:59:49 user nova-compute[75021]:     <apic/>
Dec 06 06:59:49 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 06:59:49 user nova-compute[75021]:   </features>
Dec 06 06:59:49 user nova-compute[75021]:   <clock offset="utc">
Dec 06 06:59:49 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 06:59:49 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 06:59:49 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 06:59:49 user nova-compute[75021]:   </clock>
Dec 06 06:59:49 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 06:59:49 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 06:59:49 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 06:59:49 user nova-compute[75021]:   </cpu>
Dec 06 06:59:49 user nova-compute[75021]:   <devices>
Dec 06 06:59:49 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 06:59:49 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 06:59:49 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk"/>
Dec 06 06:59:49 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 06:59:49 user nova-compute[75021]:     </disk>
Dec 06 06:59:49 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 06:59:49 user nova-compute[75021]:       <mac address="fa:16:3e:eb:6e:d5"/>
Dec 06 06:59:49 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:49 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 06:59:49 user nova-compute[75021]:       <target dev="tapa4942c0a-b7"/>
Dec 06 06:59:49 user nova-compute[75021]:     </interface>
Dec 06 06:59:49 user nova-compute[75021]:     <serial type="pty">
Dec 06 06:59:49 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/console.log" append="off"/>
Dec 06 06:59:49 user nova-compute[75021]:     </serial>
Dec 06 06:59:49 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 06:59:49 user nova-compute[75021]:     <video>
Dec 06 06:59:49 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 06:59:49 user nova-compute[75021]:     </video>
Dec 06 06:59:49 user nova-compute[75021]:     <rng model="virtio">
Dec 06 06:59:49 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 06:59:49 user nova-compute[75021]:     </rng>
Dec 06 06:59:49 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 06:59:49 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 06:59:49 user nova-compute[75021]:       <stats period="10"/>
Dec 06 06:59:49 user nova-compute[75021]:     </memballoon>
Dec 06 06:59:49 user nova-compute[75021]:   </devices>
Dec 06 06:59:49 user nova-compute[75021]: </domain>
Dec 06 06:59:49 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1185390691',display_name='tempest-VolumesAssistedSnapshotsTest-server-1185390691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1185390691',id=9,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3Tdw8ld6HVt5lN5liZ5oZHohcW+g1AQHl5ZRg8GsUk1QLz6Vhk7QGdQ7dtThHbS/FGZpb2tddpYPVJD4IJ1xPn9HzxDGGjVnbJbEq7d9dHCJK0vglMa2bubjiCJTNwhA==',key_name='tempest-keypair-249771813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de6a7955718c44d79b908d650ea3bbe5',ramdisk_id='',reservation_id='r-8vg1ona4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-678336041',owner_user_name='tempest-VolumesAssistedSnapshotsTest-678336041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5c2decab47e4837a24ac498b9b065cb',uuid=9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "address": "fa:16:3e:eb:6e:d5", "network": {"id": "fe4e2805-4027-4464-b44a-98d002a04c2f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-103297198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6a7955718c44d79b908d650ea3bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4942c0a-b7", "ovs_interfaceid": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Converting VIF {"id": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "address": "fa:16:3e:eb:6e:d5", "network": {"id": "fe4e2805-4027-4464-b44a-98d002a04c2f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-103297198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6a7955718c44d79b908d650ea3bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4942c0a-b7", "ovs_interfaceid": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:6e:d5,bridge_name='br-int',has_traffic_filtering=True,id=a4942c0a-b7fd-467f-80e0-fc4f66261e12,network=Network(fe4e2805-4027-4464-b44a-98d002a04c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4942c0a-b7') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG os_vif [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:6e:d5,bridge_name='br-int',has_traffic_filtering=True,id=a4942c0a-b7fd-467f-80e0-fc4f66261e12,network=Network(fe4e2805-4027-4464-b44a-98d002a04c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4942c0a-b7') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42c29b1f-ed6f-547d-ac44-5af1a663b7e8', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4942c0a-b7, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4942c0a-b7, col_values=(('qos', UUID('394155cb-acf0-4b95-9cce-4fdaced39bb8')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4942c0a-b7, col_values=(('external_ids', {'iface-id': 'a4942c0a-b7fd-467f-80e0-fc4f66261e12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:6e:d5', 'vm-uuid': '9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] No BDM found with device name hda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] No VIF found with MAC fa:16:3e:91:f2:66, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 06:59:49 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Using config drive
Dec 06 06:59:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:49 user nova-compute[75021]: INFO os_vif [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:6e:d5,bridge_name='br-int',has_traffic_filtering=True,id=a4942c0a-b7fd-467f-80e0-fc4f66261e12,network=Network(fe4e2805-4027-4464-b44a-98d002a04c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4942c0a-b7')
Dec 06 06:59:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] No VIF found with MAC fa:16:3e:eb:6e:d5, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 06:59:49 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Creating config drive at /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk.config
Dec 06 06:59:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppmwv8xlg {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppmwv8xlg" returned: 0 in 0.077s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-7013a71f-8c10-4e3e-874d-d21bcf268fba req-6a7f3edb-70ef-4df3-a0f4-7550a765af5c service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Updated VIF entry in instance network info cache for port 94173bea-6e40-4bcc-afe0-031fb7fde7fa. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-7013a71f-8c10-4e3e-874d-d21bcf268fba req-6a7f3edb-70ef-4df3-a0f4-7550a765af5c service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Updating instance_info_cache with network_info: [{"id": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "address": "fa:16:3e:91:f2:66", "network": {"id": "ad977a07-4f22-4e25-a953-2c36fdc6aafd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-324709235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94173bea-6e", "ovs_interfaceid": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7013a71f-8c10-4e3e-874d-d21bcf268fba req-6a7f3edb-70ef-4df3-a0f4-7550a765af5c service nova] Releasing lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:50 user nova-compute[75021]: DEBUG nova.network.neutron [req-f1ba736c-b53d-43bf-aa6b-d1e9c4353e81 req-e2c3f648-9fe3-4e5f-8bbe-10bce9eb2335 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Updated VIF entry in instance network info cache for port a4942c0a-b7fd-467f-80e0-fc4f66261e12. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 06:59:50 user nova-compute[75021]: DEBUG nova.network.neutron [req-f1ba736c-b53d-43bf-aa6b-d1e9c4353e81 req-e2c3f648-9fe3-4e5f-8bbe-10bce9eb2335 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Updating instance_info_cache with network_info: [{"id": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "address": "fa:16:3e:eb:6e:d5", "network": {"id": "fe4e2805-4027-4464-b44a-98d002a04c2f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-103297198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6a7955718c44d79b908d650ea3bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4942c0a-b7", "ovs_interfaceid": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 06:59:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f1ba736c-b53d-43bf-aa6b-d1e9c4353e81 req-e2c3f648-9fe3-4e5f-8bbe-10bce9eb2335 service nova] Releasing lock "refresh_cache-9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 06:59:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-14552a60-4bc9-4be3-86fc-e8d4ab401bda req-2f846a46-b63f-4e8d-8c39-245e109253e4 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-14552a60-4bc9-4be3-86fc-e8d4ab401bda req-2f846a46-b63f-4e8d-8c39-245e109253e4 service nova] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-14552a60-4bc9-4be3-86fc-e8d4ab401bda req-2f846a46-b63f-4e8d-8c39-245e109253e4 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-14552a60-4bc9-4be3-86fc-e8d4ab401bda req-2f846a46-b63f-4e8d-8c39-245e109253e4 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-14552a60-4bc9-4be3-86fc-e8d4ab401bda req-2f846a46-b63f-4e8d-8c39-245e109253e4 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] No waiting events found dispatching network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:52 user nova-compute[75021]: WARNING nova.compute.manager [req-14552a60-4bc9-4be3-86fc-e8d4ab401bda req-2f846a46-b63f-4e8d-8c39-245e109253e4 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received unexpected event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 for instance with vm_state active and task_state None.
Dec 06 06:59:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-23c87aa3-2452-4b3c-b3a1-e58186e9f1ea req-39d3b3db-b5e5-4d86-9bc5-6f0da05c3ba3 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Received event network-vif-plugged-a4942c0a-b7fd-467f-80e0-fc4f66261e12 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-23c87aa3-2452-4b3c-b3a1-e58186e9f1ea req-39d3b3db-b5e5-4d86-9bc5-6f0da05c3ba3 service nova] Acquiring lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-23c87aa3-2452-4b3c-b3a1-e58186e9f1ea req-39d3b3db-b5e5-4d86-9bc5-6f0da05c3ba3 service nova] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-23c87aa3-2452-4b3c-b3a1-e58186e9f1ea req-39d3b3db-b5e5-4d86-9bc5-6f0da05c3ba3 service nova] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-23c87aa3-2452-4b3c-b3a1-e58186e9f1ea req-39d3b3db-b5e5-4d86-9bc5-6f0da05c3ba3 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] No waiting events found dispatching network-vif-plugged-a4942c0a-b7fd-467f-80e0-fc4f66261e12 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:52 user nova-compute[75021]: WARNING nova.compute.manager [req-23c87aa3-2452-4b3c-b3a1-e58186e9f1ea req-39d3b3db-b5e5-4d86-9bc5-6f0da05c3ba3 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Received unexpected event network-vif-plugged-a4942c0a-b7fd-467f-80e0-fc4f66261e12 for instance with vm_state building and task_state spawning.
Dec 06 06:59:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:59:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 06:59:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-6f3ea261-049a-4033-8750-24b8680bf500 req-57dcfcc0-752c-414f-95be-40d044d4483e service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received event network-vif-plugged-94173bea-6e40-4bcc-afe0-031fb7fde7fa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6f3ea261-049a-4033-8750-24b8680bf500 req-57dcfcc0-752c-414f-95be-40d044d4483e service nova] Acquiring lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6f3ea261-049a-4033-8750-24b8680bf500 req-57dcfcc0-752c-414f-95be-40d044d4483e service nova] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6f3ea261-049a-4033-8750-24b8680bf500 req-57dcfcc0-752c-414f-95be-40d044d4483e service nova] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.013s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-6f3ea261-049a-4033-8750-24b8680bf500 req-57dcfcc0-752c-414f-95be-40d044d4483e service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] No waiting events found dispatching network-vif-plugged-94173bea-6e40-4bcc-afe0-031fb7fde7fa {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:53 user nova-compute[75021]: WARNING nova.compute.manager [req-6f3ea261-049a-4033-8750-24b8680bf500 req-57dcfcc0-752c-414f-95be-40d044d4483e service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received unexpected event network-vif-plugged-94173bea-6e40-4bcc-afe0-031fb7fde7fa for instance with vm_state building and task_state spawning.
Dec 06 06:59:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] There are 0 instances to clean {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 06:59:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:59:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75021) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 06:59:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:59:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] No waiting events found dispatching network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:54 user nova-compute[75021]: WARNING nova.compute.manager [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received unexpected event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 for instance with vm_state active and task_state None.
Dec 06 06:59:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Received event network-vif-plugged-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] Acquiring lock "b11b4d87-8700-4c0b-9c2c-aac8162def21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] No waiting events found dispatching network-vif-plugged-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:54 user nova-compute[75021]: WARNING nova.compute.manager [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Received unexpected event network-vif-plugged-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 for instance with vm_state active and task_state None.
Dec 06 06:59:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Received event network-vif-plugged-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] Acquiring lock "b11b4d87-8700-4c0b-9c2c-aac8162def21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] No waiting events found dispatching network-vif-plugged-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:54 user nova-compute[75021]: WARNING nova.compute.manager [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Received unexpected event network-vif-plugged-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 for instance with vm_state active and task_state None.
Dec 06 06:59:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Received event network-vif-plugged-3c57d6ef-14c3-4e6f-8e82-e0b33416696d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] Acquiring lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] No waiting events found dispatching network-vif-plugged-3c57d6ef-14c3-4e6f-8e82-e0b33416696d {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:54 user nova-compute[75021]: WARNING nova.compute.manager [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Received unexpected event network-vif-plugged-3c57d6ef-14c3-4e6f-8e82-e0b33416696d for instance with vm_state active and task_state None.
Dec 06 06:59:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Received event network-vif-plugged-3c57d6ef-14c3-4e6f-8e82-e0b33416696d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] Acquiring lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] No waiting events found dispatching network-vif-plugged-3c57d6ef-14c3-4e6f-8e82-e0b33416696d {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:54 user nova-compute[75021]: WARNING nova.compute.manager [req-f73facbe-8249-44ba-a6d0-e8c4716d521d req-90a22bfe-6f06-4d1d-9cca-d4a688920c53 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Received unexpected event network-vif-plugged-3c57d6ef-14c3-4e6f-8e82-e0b33416696d for instance with vm_state active and task_state None.
Dec 06 06:59:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-1c5d1992-f70a-430b-8393-17a1bab45c01 req-aa63851c-9137-49de-9e5f-c58de3b608c6 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Received event network-vif-plugged-a4942c0a-b7fd-467f-80e0-fc4f66261e12 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1c5d1992-f70a-430b-8393-17a1bab45c01 req-aa63851c-9137-49de-9e5f-c58de3b608c6 service nova] Acquiring lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1c5d1992-f70a-430b-8393-17a1bab45c01 req-aa63851c-9137-49de-9e5f-c58de3b608c6 service nova] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1c5d1992-f70a-430b-8393-17a1bab45c01 req-aa63851c-9137-49de-9e5f-c58de3b608c6 service nova] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-1c5d1992-f70a-430b-8393-17a1bab45c01 req-aa63851c-9137-49de-9e5f-c58de3b608c6 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] No waiting events found dispatching network-vif-plugged-a4942c0a-b7fd-467f-80e0-fc4f66261e12 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:54 user nova-compute[75021]: WARNING nova.compute.manager [req-1c5d1992-f70a-430b-8393-17a1bab45c01 req-aa63851c-9137-49de-9e5f-c58de3b608c6 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Received unexpected event network-vif-plugged-a4942c0a-b7fd-467f-80e0-fc4f66261e12 for instance with vm_state building and task_state spawning.
Dec 06 06:59:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:59:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:59:55 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 06:59:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 06:59:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-1ba9ef04-7cec-400c-a2d6-770a37f3fdc2 req-ae7ada4f-7400-4f55-a441-f5cef71d3c07 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received event network-vif-plugged-94173bea-6e40-4bcc-afe0-031fb7fde7fa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 06:59:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1ba9ef04-7cec-400c-a2d6-770a37f3fdc2 req-ae7ada4f-7400-4f55-a441-f5cef71d3c07 service nova] Acquiring lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1ba9ef04-7cec-400c-a2d6-770a37f3fdc2 req-ae7ada4f-7400-4f55-a441-f5cef71d3c07 service nova] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1ba9ef04-7cec-400c-a2d6-770a37f3fdc2 req-ae7ada4f-7400-4f55-a441-f5cef71d3c07 service nova] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-1ba9ef04-7cec-400c-a2d6-770a37f3fdc2 req-ae7ada4f-7400-4f55-a441-f5cef71d3c07 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] No waiting events found dispatching network-vif-plugged-94173bea-6e40-4bcc-afe0-031fb7fde7fa {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 06:59:55 user nova-compute[75021]: WARNING nova.compute.manager [req-1ba9ef04-7cec-400c-a2d6-770a37f3fdc2 req-ae7ada4f-7400-4f55-a441-f5cef71d3c07 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received unexpected event network-vif-plugged-94173bea-6e40-4bcc-afe0-031fb7fde7fa for instance with vm_state building and task_state spawning.
Dec 06 06:59:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 06:59:56 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Instance spawned successfully.
Dec 06 06:59:56 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Instance spawned successfully.
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 06:59:56 user nova-compute[75021]: INFO nova.compute.manager [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Took 11.78 seconds to spawn the instance on the hypervisor.
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 06:59:56 user nova-compute[75021]: INFO nova.compute.manager [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Took 13.15 seconds to spawn the instance on the hypervisor.
Dec 06 06:59:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:56 user nova-compute[75021]: INFO nova.compute.manager [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Took 14.53 seconds to build instance.
Dec 06 06:59:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-bcfafaec-b4f0-4727-8513-589c1be2825c tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.919s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:56 user nova-compute[75021]: INFO nova.compute.manager [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Took 14.13 seconds to build instance.
Dec 06 06:59:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-093e0701-d57b-4560-bbcc-0cc2de7f6afb tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.269s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.372s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk --force-share --output=json" returned: 0 in 0.323s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk --force-share --output=json" returned: 0 in 0.381s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 06:59:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 06:59:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 06:59:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 06:59:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 06:59:59 user nova-compute[75021]: INFO nova.compute.claims [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Claim successful on node user
Dec 06 06:59:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json" returned: 0 in 0.340s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 06:59:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 06:59:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json" returned: 0 in 0.353s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:00 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:00:00 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:00:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.331s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:00:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.377s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:00:00 user nova-compute[75021]: DEBUG nova.network.neutron [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:00:00 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:00:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:00:00 user nova-compute[75021]: DEBUG nova.policy [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c13c9f93326641e09f763a42c76449f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71465ef2851b453393044740cb4703a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:00:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.361s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:01 user nova-compute[75021]: INFO nova.virt.block_device [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Booting with volume cc022fa0-75a9-49f7-9908-571e56a19d9d at /dev/vda
Dec 06 07:00:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:01 user nova-compute[75021]: DEBUG os_brick.utils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:00:01 user nova-compute[75021]: INFO oslo.privsep.daemon [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpl8bvil_g/privsep.sock']
Dec 06 07:00:01 user sudo[86137]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpl8bvil_g/privsep.sock
Dec 06 07:00:01 user sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 06 07:00:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Successfully created port: 15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:00:03 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:00:03 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=25.773685455322266GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:03 user sudo[86137]: pam_unix(sudo:session): session closed for user root
Dec 06 07:00:03 user nova-compute[75021]: INFO oslo.privsep.daemon [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Spawned new privsep daemon via rootwrap
Dec 06 07:00:03 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 06 07:00:03 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 06 07:00:03 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Dec 06 07:00:03 user nova-compute[75021]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86148
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b304640-1c80-4271-819e-3f979bca3301]: (2,) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4b621ac2-857c-44be-9466-2f62165c3dfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance f9275ae0-ccb1-4c73-b639-9cd243c6ff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b11b4d87-8700-4c0b-9c2c-aac8162def21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance d5cd8c5d-acc4-44b8-b240-58f8fea899ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80b2c65-d345-4aef-b5b5-3a41329c85cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:03 user nova-compute[75021]: WARNING os_brick.initiator.connectors.nvmeof [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing inventories for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4869dcc-2e43-4b40-ba35-002f3bcdfc3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a39992-f08a-4545-abc3-7f84a6aec6a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4e915e-7596-46a2-a2cd-a1bc5de896e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Updating ProviderTree inventory for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Updating inventory in ProviderTree for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:00:03 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:00:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2374d8-209f-4aa1-9b08-20536d7470bf]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG os_brick.utils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] <== get_connector_properties: return (2512ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Updating existing volume attachment record: 26c8ee01-8760-4eb2-901f-ec045f4aa47b {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing aggregate associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, aggregates: None {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 07:00:03 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing trait associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, traits: HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 07:00:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:04 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:00:04 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:00:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:00:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.294s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:04 user nova-compute[75021]: DEBUG nova.network.neutron [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Successfully updated port: 15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:00:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "refresh_cache-d5cd8c5d-acc4-44b8-b240-58f8fea899ec" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:00:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquired lock "refresh_cache-d5cd8c5d-acc4-44b8-b240-58f8fea899ec" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:00:04 user nova-compute[75021]: DEBUG nova.network.neutron [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-820c7cec-fada-43ab-98fd-aaaf20f8cb54 req-e1fc4bb2-95b9-43cb-bd13-ffce3c83de08 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received event network-changed-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-820c7cec-fada-43ab-98fd-aaaf20f8cb54 req-e1fc4bb2-95b9-43cb-bd13-ffce3c83de08 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Refreshing instance network info cache due to event network-changed-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-820c7cec-fada-43ab-98fd-aaaf20f8cb54 req-e1fc4bb2-95b9-43cb-bd13-ffce3c83de08 service nova] Acquiring lock "refresh_cache-d5cd8c5d-acc4-44b8-b240-58f8fea899ec" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG nova.network.neutron [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Skipping network cache update for instance because it is Building. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid 4ffc6429-3f3c-4a7e-98e5-0db984266eae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG nova.network.neutron [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Updating instance_info_cache with network_info: [{"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Releasing lock "refresh_cache-d5cd8c5d-acc4-44b8-b240-58f8fea899ec" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Instance network_info: |[{"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-820c7cec-fada-43ab-98fd-aaaf20f8cb54 req-e1fc4bb2-95b9-43cb-bd13-ffce3c83de08 service nova] Acquired lock "refresh_cache-d5cd8c5d-acc4-44b8-b240-58f8fea899ec" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:00:05 user nova-compute[75021]: DEBUG nova.network.neutron [req-820c7cec-fada-43ab-98fd-aaaf20f8cb54 req-e1fc4bb2-95b9-43cb-bd13-ffce3c83de08 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Refreshing network info cache for port 15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:00:06 user nova-compute[75021]: DEBUG nova.network.neutron [req-820c7cec-fada-43ab-98fd-aaaf20f8cb54 req-e1fc4bb2-95b9-43cb-bd13-ffce3c83de08 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Updated VIF entry in instance network info cache for port 15d5a156-55aa-4946-9ca4-7bb6cc1a07a0. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:00:06 user nova-compute[75021]: DEBUG nova.network.neutron [req-820c7cec-fada-43ab-98fd-aaaf20f8cb54 req-e1fc4bb2-95b9-43cb-bd13-ffce3c83de08 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Updating instance_info_cache with network_info: [{"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:00:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-820c7cec-fada-43ab-98fd-aaaf20f8cb54 req-e1fc4bb2-95b9-43cb-bd13-ffce3c83de08 service nova] Releasing lock "refresh_cache-d5cd8c5d-acc4-44b8-b240-58f8fea899ec" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:00:06 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Updating instance_info_cache with network_info: [{"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:00:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:00:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:00:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:00:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:00:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:00:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:00:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquiring lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:11 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:00:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:11 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:00:11 user nova-compute[75021]: INFO nova.compute.claims [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Claim successful on node user
Dec 06 07:00:12 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:00:12 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:00:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG nova.policy [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80684806237b41848b68d9b5cbad474f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b82fc63d07764525aac64fb2c9377429', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:00:12 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Creating image(s)
Dec 06 07:00:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquiring lock "/opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "/opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "/opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.242s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk 1073741824" returned: 0 in 0.063s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Successfully created port: b3867e25-16d1-476e-8ebc-4f8bc95f785d {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.200s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Cannot resize image /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Ensure instance console log exists: /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Successfully updated port: b3867e25-16d1-476e-8ebc-4f8bc95f785d {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquiring lock "refresh_cache-b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquired lock "refresh_cache-b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-ff832bab-7e1c-43e5-9a40-d183076c0d8c req-dfd72c2d-c6e1-4a5b-b6c0-7f4d13e9ffd7 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Received event network-changed-b3867e25-16d1-476e-8ebc-4f8bc95f785d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-ff832bab-7e1c-43e5-9a40-d183076c0d8c req-dfd72c2d-c6e1-4a5b-b6c0-7f4d13e9ffd7 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Refreshing instance network info cache due to event network-changed-b3867e25-16d1-476e-8ebc-4f8bc95f785d. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ff832bab-7e1c-43e5-9a40-d183076c0d8c req-dfd72c2d-c6e1-4a5b-b6c0-7f4d13e9ffd7 service nova] Acquiring lock "refresh_cache-b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.network.neutron [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Updating instance_info_cache with network_info: [{"id": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "address": "fa:16:3e:4f:b1:0c", "network": {"id": "8fae4511-0ed6-4cef-af43-c90ede6da761", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2095445360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82fc63d07764525aac64fb2c9377429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3867e25-16", "ovs_interfaceid": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Releasing lock "refresh_cache-b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Instance network_info: |[{"id": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "address": "fa:16:3e:4f:b1:0c", "network": {"id": "8fae4511-0ed6-4cef-af43-c90ede6da761", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2095445360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82fc63d07764525aac64fb2c9377429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3867e25-16", "ovs_interfaceid": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ff832bab-7e1c-43e5-9a40-d183076c0d8c req-dfd72c2d-c6e1-4a5b-b6c0-7f4d13e9ffd7 service nova] Acquired lock "refresh_cache-b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.network.neutron [req-ff832bab-7e1c-43e5-9a40-d183076c0d8c req-dfd72c2d-c6e1-4a5b-b6c0-7f4d13e9ffd7 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Refreshing network info cache for port b3867e25-16d1-476e-8ebc-4f8bc95f785d {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Start _get_guest_xml network_info=[{"id": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "address": "fa:16:3e:4f:b1:0c", "network": {"id": "8fae4511-0ed6-4cef-af43-c90ede6da761", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2095445360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82fc63d07764525aac64fb2c9377429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3867e25-16", "ovs_interfaceid": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:00:14 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:00:14 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2037420528',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2037420528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2037420',id=11,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCM3IMBgbPuHaw83Bd63sFw79Pok5rPcqpuEw7+B9qAyWOxNCPlhG93TV8Y2bkEU89XvSZ8arfA0Y+czfzT9nURsbZljePZpA01aIZjDjsy+UIMiWt+L0WQmus9A0juCrQ==',key_name='tempest-keypair-1635405384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b82fc63d07764525aac64fb2c9377429',ramdisk_id='',reservation_id='r-zz09hyr2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-9680726',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80684806237b41848b68d9b5cbad474f',uuid=b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "address": "fa:16:3e:4f:b1:0c", "network": {"id": "8fae4511-0ed6-4cef-af43-c90ede6da761", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2095445360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82fc63d07764525aac64fb2c9377429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3867e25-16", "ovs_interfaceid": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Converting VIF {"id": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "address": "fa:16:3e:4f:b1:0c", "network": {"id": "8fae4511-0ed6-4cef-af43-c90ede6da761", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2095445360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82fc63d07764525aac64fb2c9377429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3867e25-16", "ovs_interfaceid": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:b1:0c,bridge_name='br-int',has_traffic_filtering=True,id=b3867e25-16d1-476e-8ebc-4f8bc95f785d,network=Network(8fae4511-0ed6-4cef-af43-c90ede6da761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3867e25-16') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.objects.instance [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lazy-loading 'pci_devices' on Instance uuid b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:00:14 user nova-compute[75021]:   <uuid>b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c</uuid>
Dec 06 07:00:14 user nova-compute[75021]:   <name>instance-0000000b</name>
Dec 06 07:00:14 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:00:14 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:00:14 user nova-compute[75021]:   <metadata>
Dec 06 07:00:14 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:00:14 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:00:14 user nova-compute[75021]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2037420528</nova:name>
Dec 06 07:00:14 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:00:14</nova:creationTime>
Dec 06 07:00:14 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:00:14 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:00:14 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:00:14 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:00:14 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:00:14 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:00:14 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:00:14 user nova-compute[75021]:       <nova:owner>
Dec 06 07:00:14 user nova-compute[75021]:         <nova:user uuid="80684806237b41848b68d9b5cbad474f">tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member</nova:user>
Dec 06 07:00:14 user nova-compute[75021]:         <nova:project uuid="b82fc63d07764525aac64fb2c9377429">tempest-TestServerVolumeAttachScenarioOldVersion-9680726</nova:project>
Dec 06 07:00:14 user nova-compute[75021]:       </nova:owner>
Dec 06 07:00:14 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:00:14 user nova-compute[75021]:       <nova:ports>
Dec 06 07:00:14 user nova-compute[75021]:         <nova:port uuid="b3867e25-16d1-476e-8ebc-4f8bc95f785d">
Dec 06 07:00:14 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 06 07:00:14 user nova-compute[75021]:         </nova:port>
Dec 06 07:00:14 user nova-compute[75021]:       </nova:ports>
Dec 06 07:00:14 user nova-compute[75021]:     </nova:instance>
Dec 06 07:00:14 user nova-compute[75021]:   </metadata>
Dec 06 07:00:14 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:00:14 user nova-compute[75021]:     <system>
Dec 06 07:00:14 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:00:14 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:00:14 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:00:14 user nova-compute[75021]:       <entry name="serial">b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c</entry>
Dec 06 07:00:14 user nova-compute[75021]:       <entry name="uuid">b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c</entry>
Dec 06 07:00:14 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:00:14 user nova-compute[75021]:     </system>
Dec 06 07:00:14 user nova-compute[75021]:   </sysinfo>
Dec 06 07:00:14 user nova-compute[75021]:   <os>
Dec 06 07:00:14 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:00:14 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:00:14 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:00:14 user nova-compute[75021]:   </os>
Dec 06 07:00:14 user nova-compute[75021]:   <features>
Dec 06 07:00:14 user nova-compute[75021]:     <acpi/>
Dec 06 07:00:14 user nova-compute[75021]:     <apic/>
Dec 06 07:00:14 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:00:14 user nova-compute[75021]:   </features>
Dec 06 07:00:14 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:00:14 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:00:14 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:00:14 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:00:14 user nova-compute[75021]:   </clock>
Dec 06 07:00:14 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:00:14 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:00:14 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:00:14 user nova-compute[75021]:   </cpu>
Dec 06 07:00:14 user nova-compute[75021]:   <devices>
Dec 06 07:00:14 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:00:14 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:00:14 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk"/>
Dec 06 07:00:14 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:00:14 user nova-compute[75021]:     </disk>
Dec 06 07:00:14 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:00:14 user nova-compute[75021]:       <mac address="fa:16:3e:4f:b1:0c"/>
Dec 06 07:00:14 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:00:14 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:00:14 user nova-compute[75021]:       <target dev="tapb3867e25-16"/>
Dec 06 07:00:14 user nova-compute[75021]:     </interface>
Dec 06 07:00:14 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:00:14 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/console.log" append="off"/>
Dec 06 07:00:14 user nova-compute[75021]:     </serial>
Dec 06 07:00:14 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:00:14 user nova-compute[75021]:     <video>
Dec 06 07:00:14 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:00:14 user nova-compute[75021]:     </video>
Dec 06 07:00:14 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:00:14 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:00:14 user nova-compute[75021]:     </rng>
Dec 06 07:00:14 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:00:14 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:00:14 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:00:14 user nova-compute[75021]:     </memballoon>
Dec 06 07:00:14 user nova-compute[75021]:   </devices>
Dec 06 07:00:14 user nova-compute[75021]: </domain>
Dec 06 07:00:14 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2037420528',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2037420528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2037420',id=11,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCM3IMBgbPuHaw83Bd63sFw79Pok5rPcqpuEw7+B9qAyWOxNCPlhG93TV8Y2bkEU89XvSZ8arfA0Y+czfzT9nURsbZljePZpA01aIZjDjsy+UIMiWt+L0WQmus9A0juCrQ==',key_name='tempest-keypair-1635405384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b82fc63d07764525aac64fb2c9377429',ramdisk_id='',reservation_id='r-zz09hyr2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-9680726',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80684806237b41848b68d9b5cbad474f',uuid=b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "address": "fa:16:3e:4f:b1:0c", "network": {"id": "8fae4511-0ed6-4cef-af43-c90ede6da761", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2095445360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82fc63d07764525aac64fb2c9377429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3867e25-16", "ovs_interfaceid": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Converting VIF {"id": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "address": "fa:16:3e:4f:b1:0c", "network": {"id": "8fae4511-0ed6-4cef-af43-c90ede6da761", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2095445360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82fc63d07764525aac64fb2c9377429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3867e25-16", "ovs_interfaceid": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:b1:0c,bridge_name='br-int',has_traffic_filtering=True,id=b3867e25-16d1-476e-8ebc-4f8bc95f785d,network=Network(8fae4511-0ed6-4cef-af43-c90ede6da761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3867e25-16') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG os_vif [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:b1:0c,bridge_name='br-int',has_traffic_filtering=True,id=b3867e25-16d1-476e-8ebc-4f8bc95f785d,network=Network(8fae4511-0ed6-4cef-af43-c90ede6da761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3867e25-16') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3760713-7ea0-54f7-bf6b-c33c83fa5a96', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3867e25-16, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3867e25-16, col_values=(('qos', UUID('b7284e6f-2116-4785-bac3-93d28ae671c9')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3867e25-16, col_values=(('external_ids', {'iface-id': 'b3867e25-16d1-476e-8ebc-4f8bc95f785d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:b1:0c', 'vm-uuid': 'b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:14 user nova-compute[75021]: INFO os_vif [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:b1:0c,bridge_name='br-int',has_traffic_filtering=True,id=b3867e25-16d1-476e-8ebc-4f8bc95f785d,network=Network(8fae4511-0ed6-4cef-af43-c90ede6da761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3867e25-16')
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:00:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] No VIF found with MAC fa:16:3e:4f:b1:0c, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.network.neutron [req-ff832bab-7e1c-43e5-9a40-d183076c0d8c req-dfd72c2d-c6e1-4a5b-b6c0-7f4d13e9ffd7 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Updated VIF entry in instance network info cache for port b3867e25-16d1-476e-8ebc-4f8bc95f785d. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.network.neutron [req-ff832bab-7e1c-43e5-9a40-d183076c0d8c req-dfd72c2d-c6e1-4a5b-b6c0-7f4d13e9ffd7 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Updating instance_info_cache with network_info: [{"id": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "address": "fa:16:3e:4f:b1:0c", "network": {"id": "8fae4511-0ed6-4cef-af43-c90ede6da761", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2095445360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82fc63d07764525aac64fb2c9377429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3867e25-16", "ovs_interfaceid": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ff832bab-7e1c-43e5-9a40-d183076c0d8c req-dfd72c2d-c6e1-4a5b-b6c0-7f4d13e9ffd7 service nova] Releasing lock "refresh_cache-b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.compute.manager [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:00:15 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Creating image(s)
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Ensure instance console log exists: /opt/stack/data/nova/instances/d5cd8c5d-acc4-44b8-b240-58f8fea899ec/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Start _get_guest_xml network_info=[{"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '26c8ee01-8760-4eb2-901f-ec045f4aa47b', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKNuoOHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd5cd8c5d-acc4-44b8-b240-58f8fea899ec', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc022fa0-75a9-49f7-9908-571e56a19d9d', 'serial': 'cc022fa0-75a9-49f7-9908-571e56a19d9d'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:00:15 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:00:15 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG os_brick.initiator.connector [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Factory for ISCSI on None {{(pid=75021) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKNuoOHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:00:15 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:00:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:00:15 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:00:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:00:15 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d44bed-b237-44e1-9d06-452e507ae828]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:00:15 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd8cb2d-5840-41fc-b49d-13749c16bb12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d] added
Dec 06 07:00:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3657d40c-2437-43a5-982d-749780a79f60]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c97333-f71f-458e-820d-778ece24280d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SKNuoOHB {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SKNuoOHB" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82ff707-3d37-4e86-b4ab-b1ad3e6204bd]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SKNuoOHB'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc42dc3-0924-4eb1-9473-a839457aa34c]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec4cceb-549d-4f35-a4b5-ae86603a3c10]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:00:15 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:00:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:00:15 user nova-compute[75021]:  {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:00:15 user nova-compute[75021]: WARNING os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 07:00:15 user nova-compute[75021]: 
Dec 06 07:00:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f490870c-8a84-4cc0-b902-bf5d0bd20b42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260]
Dec 06 07:00:16 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260] successful.
Dec 06 07:00:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be82ef3-b468-4e1b-8673-5992557314a8]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee884eab-2681-45dc-9936-06cceceac98d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:00:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:00:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c5323b-6505-491b-ba8a-c5f5850bfdc7]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKNuoOHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-1e286a74-8e48-490e-875f-e37a3c4cb5b8 req-fddec6dd-8b07-42b5-82a8-f92dc6c434e4 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Received event network-vif-plugged-b3867e25-16d1-476e-8ebc-4f8bc95f785d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1e286a74-8e48-490e-875f-e37a3c4cb5b8 req-fddec6dd-8b07-42b5-82a8-f92dc6c434e4 service nova] Acquiring lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1e286a74-8e48-490e-875f-e37a3c4cb5b8 req-fddec6dd-8b07-42b5-82a8-f92dc6c434e4 service nova] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1e286a74-8e48-490e-875f-e37a3c4cb5b8 req-fddec6dd-8b07-42b5-82a8-f92dc6c434e4 service nova] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-1e286a74-8e48-490e-875f-e37a3c4cb5b8 req-fddec6dd-8b07-42b5-82a8-f92dc6c434e4 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] No waiting events found dispatching network-vif-plugged-b3867e25-16d1-476e-8ebc-4f8bc95f785d {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:00:16 user nova-compute[75021]: WARNING nova.compute.manager [req-1e286a74-8e48-490e-875f-e37a3c4cb5b8 req-fddec6dd-8b07-42b5-82a8-f92dc6c434e4 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Received unexpected event network-vif-plugged-b3867e25-16d1-476e-8ebc-4f8bc95f785d for instance with vm_state building and task_state spawning.
Dec 06 07:00:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23033643735396465', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033643735396465', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1814435056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1814435056',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiXiD74QqzfgkFXGjJOZvAqeUVo+mq15hHQ8QIS/Wj/WBUADk0S9ETtuL5LG29w5xqYMy6zRLAJsgjvd9bu5CBLpGA3OWWGNin8u/kh+TSTPSCT1+3h0wrNEHGduvVlPw==',key_name='tempest-keypair-139423592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71465ef2851b453393044740cb4703a8',ramdisk_id='',reservation_id='r-d3iwgob5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-888472527',owner_user_name='tempest-ServerActionsV293TestJSON-888472527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c13c9f93326641e09f763a42c76449f9',uuid=d5cd8c5d-acc4-44b8-b240-58f8fea899ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Converting VIF {"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:4e:65,bridge_name='br-int',has_traffic_filtering=True,id=15d5a156-55aa-4946-9ca4-7bb6cc1a07a0,network=Network(48eb6005-fd57-4d35-a701-ac7bed58807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d5a156-55') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG nova.objects.instance [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lazy-loading 'pci_devices' on Instance uuid d5cd8c5d-acc4-44b8-b240-58f8fea899ec {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:00:17 user nova-compute[75021]:   <uuid>d5cd8c5d-acc4-44b8-b240-58f8fea899ec</uuid>
Dec 06 07:00:17 user nova-compute[75021]:   <name>instance-0000000a</name>
Dec 06 07:00:17 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:00:17 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:00:17 user nova-compute[75021]:   <metadata>
Dec 06 07:00:17 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:00:17 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:00:17 user nova-compute[75021]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1814435056</nova:name>
Dec 06 07:00:17 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:00:15</nova:creationTime>
Dec 06 07:00:17 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:00:17 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:00:17 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:00:17 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:00:17 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:00:17 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:00:17 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:00:17 user nova-compute[75021]:       <nova:owner>
Dec 06 07:00:17 user nova-compute[75021]:         <nova:user uuid="c13c9f93326641e09f763a42c76449f9">tempest-ServerActionsV293TestJSON-888472527-project-member</nova:user>
Dec 06 07:00:17 user nova-compute[75021]:         <nova:project uuid="71465ef2851b453393044740cb4703a8">tempest-ServerActionsV293TestJSON-888472527</nova:project>
Dec 06 07:00:17 user nova-compute[75021]:       </nova:owner>
Dec 06 07:00:17 user nova-compute[75021]:       <nova:ports>
Dec 06 07:00:17 user nova-compute[75021]:         <nova:port uuid="15d5a156-55aa-4946-9ca4-7bb6cc1a07a0">
Dec 06 07:00:17 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 07:00:17 user nova-compute[75021]:         </nova:port>
Dec 06 07:00:17 user nova-compute[75021]:       </nova:ports>
Dec 06 07:00:17 user nova-compute[75021]:     </nova:instance>
Dec 06 07:00:17 user nova-compute[75021]:   </metadata>
Dec 06 07:00:17 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:00:17 user nova-compute[75021]:     <system>
Dec 06 07:00:17 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:00:17 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:00:17 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:00:17 user nova-compute[75021]:       <entry name="serial">d5cd8c5d-acc4-44b8-b240-58f8fea899ec</entry>
Dec 06 07:00:17 user nova-compute[75021]:       <entry name="uuid">d5cd8c5d-acc4-44b8-b240-58f8fea899ec</entry>
Dec 06 07:00:17 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:00:17 user nova-compute[75021]:     </system>
Dec 06 07:00:17 user nova-compute[75021]:   </sysinfo>
Dec 06 07:00:17 user nova-compute[75021]:   <os>
Dec 06 07:00:17 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:00:17 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:00:17 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:00:17 user nova-compute[75021]:   </os>
Dec 06 07:00:17 user nova-compute[75021]:   <features>
Dec 06 07:00:17 user nova-compute[75021]:     <acpi/>
Dec 06 07:00:17 user nova-compute[75021]:     <apic/>
Dec 06 07:00:17 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:00:17 user nova-compute[75021]:   </features>
Dec 06 07:00:17 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:00:17 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:00:17 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:00:17 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:00:17 user nova-compute[75021]:   </clock>
Dec 06 07:00:17 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:00:17 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:00:17 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:00:17 user nova-compute[75021]:   </cpu>
Dec 06 07:00:17 user nova-compute[75021]:   <devices>
Dec 06 07:00:17 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:00:17 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:00:17 user nova-compute[75021]:       <source dev="/dev/sdb"/>
Dec 06 07:00:17 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:00:17 user nova-compute[75021]:       <serial>cc022fa0-75a9-49f7-9908-571e56a19d9d</serial>
Dec 06 07:00:17 user nova-compute[75021]:     </disk>
Dec 06 07:00:17 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:00:17 user nova-compute[75021]:       <mac address="fa:16:3e:2a:4e:65"/>
Dec 06 07:00:17 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:00:17 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:00:17 user nova-compute[75021]:       <target dev="tap15d5a156-55"/>
Dec 06 07:00:17 user nova-compute[75021]:     </interface>
Dec 06 07:00:17 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:00:17 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/d5cd8c5d-acc4-44b8-b240-58f8fea899ec/console.log" append="off"/>
Dec 06 07:00:17 user nova-compute[75021]:     </serial>
Dec 06 07:00:17 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:00:17 user nova-compute[75021]:     <video>
Dec 06 07:00:17 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:00:17 user nova-compute[75021]:     </video>
Dec 06 07:00:17 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:00:17 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:00:17 user nova-compute[75021]:     </rng>
Dec 06 07:00:17 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:00:17 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:00:17 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:00:17 user nova-compute[75021]:     </memballoon>
Dec 06 07:00:17 user nova-compute[75021]:   </devices>
Dec 06 07:00:17 user nova-compute[75021]: </domain>
Dec 06 07:00:17 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1814435056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1814435056',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiXiD74QqzfgkFXGjJOZvAqeUVo+mq15hHQ8QIS/Wj/WBUADk0S9ETtuL5LG29w5xqYMy6zRLAJsgjvd9bu5CBLpGA3OWWGNin8u/kh+TSTPSCT1+3h0wrNEHGduvVlPw==',key_name='tempest-keypair-139423592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71465ef2851b453393044740cb4703a8',ramdisk_id='',reservation_id='r-d3iwgob5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-888472527',owner_user_name='tempest-ServerActionsV293TestJSON-888472527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c13c9f93326641e09f763a42c76449f9',uuid=d5cd8c5d-acc4-44b8-b240-58f8fea899ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Converting VIF {"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:4e:65,bridge_name='br-int',has_traffic_filtering=True,id=15d5a156-55aa-4946-9ca4-7bb6cc1a07a0,network=Network(48eb6005-fd57-4d35-a701-ac7bed58807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d5a156-55') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG os_vif [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:4e:65,bridge_name='br-int',has_traffic_filtering=True,id=15d5a156-55aa-4946-9ca4-7bb6cc1a07a0,network=Network(48eb6005-fd57-4d35-a701-ac7bed58807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d5a156-55') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '803a94f6-3431-5b3c-8776-4bf9d1aa973b', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15d5a156-55, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15d5a156-55, col_values=(('qos', UUID('df1cfa25-0d73-46a9-a305-1dd47b8ded32')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15d5a156-55, col_values=(('external_ids', {'iface-id': '15d5a156-55aa-4946-9ca4-7bb6cc1a07a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:4e:65', 'vm-uuid': 'd5cd8c5d-acc4-44b8-b240-58f8fea899ec'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:17 user nova-compute[75021]: INFO os_vif [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:4e:65,bridge_name='br-int',has_traffic_filtering=True,id=15d5a156-55aa-4946-9ca4-7bb6cc1a07a0,network=Network(48eb6005-fd57-4d35-a701-ac7bed58807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d5a156-55')
Dec 06 07:00:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] No VIF found with MAC fa:16:3e:2a:4e:65, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:00:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:00:18 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Instance spawned successfully.
Dec 06 07:00:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-e6fcc254-6487-4fb9-9ac9-03b91fad98cd req-7b0b36e5-5ecc-447f-86b4-1243ba57fd4a service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Received event network-vif-plugged-b3867e25-16d1-476e-8ebc-4f8bc95f785d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e6fcc254-6487-4fb9-9ac9-03b91fad98cd req-7b0b36e5-5ecc-447f-86b4-1243ba57fd4a service nova] Acquiring lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e6fcc254-6487-4fb9-9ac9-03b91fad98cd req-7b0b36e5-5ecc-447f-86b4-1243ba57fd4a service nova] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e6fcc254-6487-4fb9-9ac9-03b91fad98cd req-7b0b36e5-5ecc-447f-86b4-1243ba57fd4a service nova] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-e6fcc254-6487-4fb9-9ac9-03b91fad98cd req-7b0b36e5-5ecc-447f-86b4-1243ba57fd4a service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] No waiting events found dispatching network-vif-plugged-b3867e25-16d1-476e-8ebc-4f8bc95f785d {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:00:18 user nova-compute[75021]: WARNING nova.compute.manager [req-e6fcc254-6487-4fb9-9ac9-03b91fad98cd req-7b0b36e5-5ecc-447f-86b4-1243ba57fd4a service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Received unexpected event network-vif-plugged-b3867e25-16d1-476e-8ebc-4f8bc95f785d for instance with vm_state building and task_state spawning.
Dec 06 07:00:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:18 user nova-compute[75021]: INFO nova.compute.manager [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Took 5.90 seconds to spawn the instance on the hypervisor.
Dec 06 07:00:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:00:18 user nova-compute[75021]: INFO nova.compute.manager [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Took 7.03 seconds to build instance.
Dec 06 07:00:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-94c27fdd-a9d2-4ae3-96e3-930ceeaa4e8f tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.150s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-fff9776c-f361-4246-88a4-afe0ffe6f996 req-5f9e913a-4baf-4df6-a68e-84ea11112747 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received event network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fff9776c-f361-4246-88a4-afe0ffe6f996 req-5f9e913a-4baf-4df6-a68e-84ea11112747 service nova] Acquiring lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fff9776c-f361-4246-88a4-afe0ffe6f996 req-5f9e913a-4baf-4df6-a68e-84ea11112747 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fff9776c-f361-4246-88a4-afe0ffe6f996 req-5f9e913a-4baf-4df6-a68e-84ea11112747 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-fff9776c-f361-4246-88a4-afe0ffe6f996 req-5f9e913a-4baf-4df6-a68e-84ea11112747 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] No waiting events found dispatching network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:00:18 user nova-compute[75021]: WARNING nova.compute.manager [req-fff9776c-f361-4246-88a4-afe0ffe6f996 req-5f9e913a-4baf-4df6-a68e-84ea11112747 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received unexpected event network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 for instance with vm_state building and task_state spawning.
Dec 06 07:00:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "ab907f07-df7b-4d56-baef-f2502b88b622" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:00:20 user nova-compute[75021]: INFO nova.compute.claims [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Claim successful on node user
Dec 06 07:00:20 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG nova.compute.manager [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG nova.compute.manager [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:00:20 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:00:20 user nova-compute[75021]: DEBUG nova.compute.manager [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-8310d1c1-7fdc-420a-bb73-45d2e6f6f9f3 req-7a0eb008-f5b4-43e1-8117-c16442d78db7 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received event network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8310d1c1-7fdc-420a-bb73-45d2e6f6f9f3 req-7a0eb008-f5b4-43e1-8117-c16442d78db7 service nova] Acquiring lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8310d1c1-7fdc-420a-bb73-45d2e6f6f9f3 req-7a0eb008-f5b4-43e1-8117-c16442d78db7 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8310d1c1-7fdc-420a-bb73-45d2e6f6f9f3 req-7a0eb008-f5b4-43e1-8117-c16442d78db7 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-8310d1c1-7fdc-420a-bb73-45d2e6f6f9f3 req-7a0eb008-f5b4-43e1-8117-c16442d78db7 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] No waiting events found dispatching network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:00:20 user nova-compute[75021]: WARNING nova.compute.manager [req-8310d1c1-7fdc-420a-bb73-45d2e6f6f9f3 req-7a0eb008-f5b4-43e1-8117-c16442d78db7 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received unexpected event network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 for instance with vm_state building and task_state spawning.
Dec 06 07:00:20 user nova-compute[75021]: INFO nova.virt.block_device [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Booting with volume e8e5496c-0ebb-419a-9cb5-779af8247ec3 at /dev/vda
Dec 06 07:00:20 user nova-compute[75021]: DEBUG os_brick.utils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG nova.compute.manager [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00a41dc-5a46-42ce-8c44-4853f1b0dbd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:20 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Instance spawned successfully.
Dec 06 07:00:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cff308-2fa7-4175-8d61-b720eefe9b8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0185cbb8-d8f9-411e-b4cb-cfb099e3cedf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7a3e6c-e0ea-4f77-9339-5bd1ca7a9eed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:00:21 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:00:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a928e785-8c34-4c60-b310-0d277049d6cc]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG nova.policy [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '038526fdbc594c88ba8ed742fa8dc471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0be691fa62401a967b32a716490165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG os_brick.utils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating existing volume attachment record: 0b222423-6f15-4823-bead-b71f8b76841f {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:00:21 user nova-compute[75021]: INFO nova.compute.manager [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Took 5.48 seconds to spawn the instance on the hypervisor.
Dec 06 07:00:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:00:21 user nova-compute[75021]: INFO nova.compute.manager [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Took 22.13 seconds to build instance.
Dec 06 07:00:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-79a4098c-08ab-40dd-9bbc-e798ae59dc77 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.340s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:21 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Successfully created port: 69fc2f53-a06e-4792-9f4d-5044050ed607 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:00:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:22 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Successfully created port: 8b7ea8b6-978c-4760-b4eb-81ca2fe10caa {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:00:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:22 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Successfully created port: cfaeaf2a-91aa-405d-ab13-b3827d9165e3 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:00:23 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Successfully created port: 87be3bc7-3281-4732-8ba2-8a1d89d724fe {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:00:24 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Successfully created port: 90de25ad-46b1-410a-bfc6-81ad5873c4f0 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:00:24 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Successfully updated port: 69fc2f53-a06e-4792-9f4d-5044050ed607 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:00:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-a314e990-14c9-44c2-be63-a55fb2b704b5 req-b56a59fe-737c-4a8b-8801-bfc87582a367 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-changed-69fc2f53-a06e-4792-9f4d-5044050ed607 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:00:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-a314e990-14c9-44c2-be63-a55fb2b704b5 req-b56a59fe-737c-4a8b-8801-bfc87582a367 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing instance network info cache due to event network-changed-69fc2f53-a06e-4792-9f4d-5044050ed607. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:00:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a314e990-14c9-44c2-be63-a55fb2b704b5 req-b56a59fe-737c-4a8b-8801-bfc87582a367 service nova] Acquiring lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:00:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a314e990-14c9-44c2-be63-a55fb2b704b5 req-b56a59fe-737c-4a8b-8801-bfc87582a367 service nova] Acquired lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:00:24 user nova-compute[75021]: DEBUG nova.network.neutron [req-a314e990-14c9-44c2-be63-a55fb2b704b5 req-b56a59fe-737c-4a8b-8801-bfc87582a367 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing network info cache for port 69fc2f53-a06e-4792-9f4d-5044050ed607 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:00:25 user nova-compute[75021]: DEBUG nova.network.neutron [req-a314e990-14c9-44c2-be63-a55fb2b704b5 req-b56a59fe-737c-4a8b-8801-bfc87582a367 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:00:25 user nova-compute[75021]: DEBUG nova.network.neutron [req-a314e990-14c9-44c2-be63-a55fb2b704b5 req-b56a59fe-737c-4a8b-8801-bfc87582a367 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:00:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a314e990-14c9-44c2-be63-a55fb2b704b5 req-b56a59fe-737c-4a8b-8801-bfc87582a367 service nova] Releasing lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:00:25 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Successfully updated port: e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:00:26 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Successfully updated port: 16f5b4cc-aef4-43c4-a87f-81993a0cdee9 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-changed-e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing instance network info cache due to event network-changed-e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] Acquiring lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] Acquired lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG nova.network.neutron [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing network info cache for port e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG nova.network.neutron [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG nova.network.neutron [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] Releasing lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-changed-16f5b4cc-aef4-43c4-a87f-81993a0cdee9 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing instance network info cache due to event network-changed-16f5b4cc-aef4-43c4-a87f-81993a0cdee9. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] Acquiring lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] Acquired lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG nova.network.neutron [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing network info cache for port 16f5b4cc-aef4-43c4-a87f-81993a0cdee9 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Successfully updated port: 8b7ea8b6-978c-4760-b4eb-81ca2fe10caa {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG nova.network.neutron [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG nova.network.neutron [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2cafd24d-5ec0-48ac-bbf0-c95c69da3872 req-f5ad1328-43f6-4106-8a08-0cde0ae0647f service nova] Releasing lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:00:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:28 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Successfully updated port: cfaeaf2a-91aa-405d-ab13-b3827d9165e3 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:00:28 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Successfully updated port: 87be3bc7-3281-4732-8ba2-8a1d89d724fe {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-changed-8b7ea8b6-978c-4760-b4eb-81ca2fe10caa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing instance network info cache due to event network-changed-8b7ea8b6-978c-4760-b4eb-81ca2fe10caa. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] Acquiring lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] Acquired lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG nova.network.neutron [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing network info cache for port 8b7ea8b6-978c-4760-b4eb-81ca2fe10caa {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG nova.network.neutron [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG nova.network.neutron [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] Releasing lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-changed-cfaeaf2a-91aa-405d-ab13-b3827d9165e3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing instance network info cache due to event network-changed-cfaeaf2a-91aa-405d-ab13-b3827d9165e3. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] Acquiring lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] Acquired lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG nova.network.neutron [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing network info cache for port cfaeaf2a-91aa-405d-ab13-b3827d9165e3 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Successfully updated port: 90de25ad-46b1-410a-bfc6-81ad5873c4f0 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG nova.network.neutron [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG nova.network.neutron [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] Releasing lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-changed-87be3bc7-3281-4732-8ba2-8a1d89d724fe {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing instance network info cache due to event network-changed-87be3bc7-3281-4732-8ba2-8a1d89d724fe. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] Acquiring lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] Acquired lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG nova.network.neutron [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing network info cache for port 87be3bc7-3281-4732-8ba2-8a1d89d724fe {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:00:29 user nova-compute[75021]: DEBUG nova.network.neutron [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:00:30 user nova-compute[75021]: DEBUG nova.network.neutron [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:00:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c9981cda-17b6-478f-9ec7-d0dc0feb8231 req-e34d04ae-b5d3-4795-9929-a24766645a30 service nova] Releasing lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:00:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquired lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:00:30 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:00:30 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:00:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-12e05d59-74c2-4dfa-ba59-3b0c88a2c58d req-0c4a4519-effd-4449-9244-d9dcd3023d23 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-changed-90de25ad-46b1-410a-bfc6-81ad5873c4f0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:00:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-12e05d59-74c2-4dfa-ba59-3b0c88a2c58d req-0c4a4519-effd-4449-9244-d9dcd3023d23 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing instance network info cache due to event network-changed-90de25ad-46b1-410a-bfc6-81ad5873c4f0. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:00:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-12e05d59-74c2-4dfa-ba59-3b0c88a2c58d req-0c4a4519-effd-4449-9244-d9dcd3023d23 service nova] Acquiring lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:00:32 user nova-compute[75021]: INFO nova.virt.block_device [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Booting with volume c92406e3-bbbe-45a5-8099-4798ac4ba794 at /dev/vdb
Dec 06 07:00:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG os_brick.utils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2aff42-ed8f-4e4a-94cc-781433364433]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c9417e-14b4-4a51-bea4-4d16f571dd1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7355be46-79d0-4651-bd19-3d00bea3dbd2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc425dfa-0ee0-40c3-be82-a8ea60021423]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:00:32 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d540690a-924c-4a43-8fcc-065e0ecce7de]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG os_brick.utils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating existing volume attachment record: 51b56594-6f62-4fb3-87e0-4bf1bac7b901 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG nova.network.neutron [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating instance_info_cache with network_info: [{"id": "69fc2f53-a06e-4792-9f4d-5044050ed607", "address": "fa:16:3e:ce:59:97", "network": {"id": "68f06c4c-2346-43fc-b05a-a1316f086ac9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-574220473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fc2f53-a0", "ovs_interfaceid": "69fc2f53-a06e-4792-9f4d-5044050ed607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "address": "fa:16:3e:98:90:3a", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape296dd9b-d7", "ovs_interfaceid": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "address": "fa:16:3e:b8:dc:57", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f5b4cc-ae", "ovs_interfaceid": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "address": "fa:16:3e:0c:80:0f", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ea8b6-97", "ovs_interfaceid": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "address": "fa:16:3e:05:d0:4b", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaeaf2a-91", "ovs_interfaceid": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "address": "fa:16:3e:c6:50:8e", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87be3bc7-32", "ovs_interfaceid": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "address": "fa:16:3e:1d:25:78", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90de25ad-46", "ovs_interfaceid": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Releasing lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Instance network_info: |[{"id": "69fc2f53-a06e-4792-9f4d-5044050ed607", "address": "fa:16:3e:ce:59:97", "network": {"id": "68f06c4c-2346-43fc-b05a-a1316f086ac9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-574220473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fc2f53-a0", "ovs_interfaceid": "69fc2f53-a06e-4792-9f4d-5044050ed607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "address": "fa:16:3e:98:90:3a", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape296dd9b-d7", "ovs_interfaceid": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "address": "fa:16:3e:b8:dc:57", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f5b4cc-ae", "ovs_interfaceid": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "address": "fa:16:3e:0c:80:0f", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ea8b6-97", "ovs_interfaceid": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "address": "fa:16:3e:05:d0:4b", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaeaf2a-91", "ovs_interfaceid": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "address": "fa:16:3e:c6:50:8e", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87be3bc7-32", "ovs_interfaceid": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "address": "fa:16:3e:1d:25:78", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90de25ad-46", "ovs_interfaceid": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-12e05d59-74c2-4dfa-ba59-3b0c88a2c58d req-0c4a4519-effd-4449-9244-d9dcd3023d23 service nova] Acquired lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG nova.network.neutron [req-12e05d59-74c2-4dfa-ba59-3b0c88a2c58d req-0c4a4519-effd-4449-9244-d9dcd3023d23 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing network info cache for port 90de25ad-46b1-410a-bfc6-81ad5873c4f0 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:00:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:33 user nova-compute[75021]: DEBUG nova.network.neutron [req-12e05d59-74c2-4dfa-ba59-3b0c88a2c58d req-0c4a4519-effd-4449-9244-d9dcd3023d23 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updated VIF entry in instance network info cache for port 90de25ad-46b1-410a-bfc6-81ad5873c4f0. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:00:33 user nova-compute[75021]: DEBUG nova.network.neutron [req-12e05d59-74c2-4dfa-ba59-3b0c88a2c58d req-0c4a4519-effd-4449-9244-d9dcd3023d23 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating instance_info_cache with network_info: [{"id": "69fc2f53-a06e-4792-9f4d-5044050ed607", "address": "fa:16:3e:ce:59:97", "network": {"id": "68f06c4c-2346-43fc-b05a-a1316f086ac9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-574220473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fc2f53-a0", "ovs_interfaceid": "69fc2f53-a06e-4792-9f4d-5044050ed607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "address": "fa:16:3e:98:90:3a", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape296dd9b-d7", "ovs_interfaceid": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "address": "fa:16:3e:b8:dc:57", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f5b4cc-ae", "ovs_interfaceid": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "address": "fa:16:3e:0c:80:0f", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ea8b6-97", "ovs_interfaceid": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "address": "fa:16:3e:05:d0:4b", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaeaf2a-91", "ovs_interfaceid": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "address": "fa:16:3e:c6:50:8e", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87be3bc7-32", "ovs_interfaceid": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "address": "fa:16:3e:1d:25:78", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90de25ad-46", "ovs_interfaceid": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:00:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-12e05d59-74c2-4dfa-ba59-3b0c88a2c58d req-0c4a4519-effd-4449-9244-d9dcd3023d23 service nova] Releasing lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:00:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:49 user nova-compute[75021]: INFO nova.virt.block_device [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Booting with volume 2452ccce-7f6e-4168-b492-cc4cfa3519e5 at /dev/vdc
Dec 06 07:00:49 user nova-compute[75021]: DEBUG os_brick.utils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36a18df-ceb3-4604-917d-0a45e275758d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5774e6-7e45-4107-adc4-ef478d9a1dbf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4eb584-720d-43bd-9cd1-4d4c4ca56b1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3c8793-7d11-4523-95e6-e30e6198e39f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:00:49 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:00:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7394118e-393c-4559-adb1-2cd990100016]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG os_brick.utils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:00:49 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating existing volume attachment record: 13b45cda-0901-47b9-b61e-7b76a6641e4d {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:00:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:00:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:00:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:00:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:00:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:00:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:00:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:00:59 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:00:59 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:00:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=6861MB free_disk=25.61956787109375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4b621ac2-857c-44be-9466-2f62165c3dfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance f9275ae0-ccb1-4c73-b639-9cd243c6ff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b11b4d87-8700-4c0b-9c2c-aac8162def21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance d5cd8c5d-acc4-44b8-b240-58f8fea899ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance ab907f07-df7b-4d56-baef-f2502b88b622 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:00:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:01:00 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:01:00 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:01:00 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:01:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:01:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:01:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:01:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:01:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:01:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:01:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Updating instance_info_cache with network_info: [{"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:01:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:01:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:01:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:01:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:01:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:01:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:01:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:01:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:01:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:02 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:01:02 user nova-compute[75021]: INFO nova.compute.manager [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Rescuing
Dec 06 07:01:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:01:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquired lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:01:02 user nova-compute[75021]: DEBUG nova.network.neutron [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:01:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Updating instance_info_cache with network_info: [{"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:01:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Releasing lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:01:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-5056e670-860a-4074-b97c-e55d741f05ee req-1ab011e9-919f-478f-8b9b-9915ec50bfff service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received event network-vif-unplugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5056e670-860a-4074-b97c-e55d741f05ee req-1ab011e9-919f-478f-8b9b-9915ec50bfff service nova] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5056e670-860a-4074-b97c-e55d741f05ee req-1ab011e9-919f-478f-8b9b-9915ec50bfff service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5056e670-860a-4074-b97c-e55d741f05ee req-1ab011e9-919f-478f-8b9b-9915ec50bfff service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-5056e670-860a-4074-b97c-e55d741f05ee req-1ab011e9-919f-478f-8b9b-9915ec50bfff service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] No waiting events found dispatching network-vif-unplugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:03 user nova-compute[75021]: WARNING nova.compute.manager [req-5056e670-860a-4074-b97c-e55d741f05ee req-1ab011e9-919f-478f-8b9b-9915ec50bfff service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received unexpected event network-vif-unplugged-98cd38aa-33d7-4859-a2eb-5b76676e927b for instance with vm_state active and task_state rescuing.
Dec 06 07:01:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:04 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Instance destroyed successfully.
Dec 06 07:01:04 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Attempting rescue
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75021) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Instance directory exists: not creating {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 07:01:04 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Creating image(s)
Dec 06 07:01:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "/opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "/opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "/opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'trusted_certs' on Instance uuid a613e2d6-d3f6-4729-aef7-24714608acc9 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue" returned: 0 in 0.059s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'migration_context' on Instance uuid a613e2d6-d3f6-4729-aef7-24714608acc9 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.objects.base [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Object Instance<a613e2d6-d3f6-4729-aef7-24714608acc9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Start _get_guest_xml network_info=[{"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "vif_mac": "fa:16:3e:3a:ab:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'resources' on Instance uuid a613e2d6-d3f6-4729-aef7-24714608acc9 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.objects.base [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Object Instance<a613e2d6-d3f6-4729-aef7-24714608acc9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'numa_topology' on Instance uuid a613e2d6-d3f6-4729-aef7-24714608acc9 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.objects.base [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Object Instance<a613e2d6-d3f6-4729-aef7-24714608acc9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:01:04 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:01:04 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'vcpu_model' on Instance uuid a613e2d6-d3f6-4729-aef7-24714608acc9 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.objects.base [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Object Instance<a613e2d6-d3f6-4729-aef7-24714608acc9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-119221818',display_name='tempest-ServerRescueNegativeTestJSON-server-119221818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-119221818',id=2,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43d3fb6e885546bd9660c81fac9cfa12',ramdisk_id='',reservation_id='r-1z4uta0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-674134420',owner_user_name='tempest-ServerRescueNegativeTestJSON-674134420-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:31Z,user_data=None,user_id='e6d8114db9fa47c09bc9675da9e19a8c',uuid=a613e2d6-d3f6-4729-aef7-24714608acc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "vif_mac": "fa:16:3e:3a:ab:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converting VIF {"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "vif_mac": "fa:16:3e:3a:ab:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ab:56,bridge_name='br-int',has_traffic_filtering=True,id=98cd38aa-33d7-4859-a2eb-5b76676e927b,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cd38aa-33') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'pci_devices' on Instance uuid a613e2d6-d3f6-4729-aef7-24714608acc9 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.objects.base [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Object Instance<a613e2d6-d3f6-4729-aef7-24714608acc9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:01:04 user nova-compute[75021]:   <uuid>a613e2d6-d3f6-4729-aef7-24714608acc9</uuid>
Dec 06 07:01:04 user nova-compute[75021]:   <name>instance-00000002</name>
Dec 06 07:01:04 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:01:04 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:01:04 user nova-compute[75021]:   <metadata>
Dec 06 07:01:04 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:01:04 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:01:04 user nova-compute[75021]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-119221818</nova:name>
Dec 06 07:01:04 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:01:04</nova:creationTime>
Dec 06 07:01:04 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:01:04 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:01:04 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:01:04 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:01:04 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:01:04 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:01:04 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:01:04 user nova-compute[75021]:       <nova:owner>
Dec 06 07:01:04 user nova-compute[75021]:         <nova:user uuid="e6d8114db9fa47c09bc9675da9e19a8c">tempest-ServerRescueNegativeTestJSON-674134420-project-member</nova:user>
Dec 06 07:01:04 user nova-compute[75021]:         <nova:project uuid="43d3fb6e885546bd9660c81fac9cfa12">tempest-ServerRescueNegativeTestJSON-674134420</nova:project>
Dec 06 07:01:04 user nova-compute[75021]:       </nova:owner>
Dec 06 07:01:04 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:01:04 user nova-compute[75021]:       <nova:ports>
Dec 06 07:01:04 user nova-compute[75021]:         <nova:port uuid="98cd38aa-33d7-4859-a2eb-5b76676e927b">
Dec 06 07:01:04 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 07:01:04 user nova-compute[75021]:         </nova:port>
Dec 06 07:01:04 user nova-compute[75021]:       </nova:ports>
Dec 06 07:01:04 user nova-compute[75021]:     </nova:instance>
Dec 06 07:01:04 user nova-compute[75021]:   </metadata>
Dec 06 07:01:04 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:01:04 user nova-compute[75021]:     <system>
Dec 06 07:01:04 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:01:04 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:01:04 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:01:04 user nova-compute[75021]:       <entry name="serial">a613e2d6-d3f6-4729-aef7-24714608acc9</entry>
Dec 06 07:01:04 user nova-compute[75021]:       <entry name="uuid">a613e2d6-d3f6-4729-aef7-24714608acc9</entry>
Dec 06 07:01:04 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:01:04 user nova-compute[75021]:     </system>
Dec 06 07:01:04 user nova-compute[75021]:   </sysinfo>
Dec 06 07:01:04 user nova-compute[75021]:   <os>
Dec 06 07:01:04 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:01:04 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:01:04 user nova-compute[75021]:   </os>
Dec 06 07:01:04 user nova-compute[75021]:   <features>
Dec 06 07:01:04 user nova-compute[75021]:     <acpi/>
Dec 06 07:01:04 user nova-compute[75021]:     <apic/>
Dec 06 07:01:04 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:01:04 user nova-compute[75021]:   </features>
Dec 06 07:01:04 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:01:04 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:01:04 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:01:04 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:01:04 user nova-compute[75021]:   </clock>
Dec 06 07:01:04 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:01:04 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:01:04 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:01:04 user nova-compute[75021]:   </cpu>
Dec 06 07:01:04 user nova-compute[75021]:   <devices>
Dec 06 07:01:04 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:01:04 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:01:04 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue"/>
Dec 06 07:01:04 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:01:04 user nova-compute[75021]:     </disk>
Dec 06 07:01:04 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:01:04 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:01:04 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk"/>
Dec 06 07:01:04 user nova-compute[75021]:       <target dev="vdb" bus="virtio"/>
Dec 06 07:01:04 user nova-compute[75021]:     </disk>
Dec 06 07:01:04 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:01:04 user nova-compute[75021]:       <mac address="fa:16:3e:3a:ab:56"/>
Dec 06 07:01:04 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:01:04 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:01:04 user nova-compute[75021]:       <target dev="tap98cd38aa-33"/>
Dec 06 07:01:04 user nova-compute[75021]:     </interface>
Dec 06 07:01:04 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:01:04 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/console.log" append="off"/>
Dec 06 07:01:04 user nova-compute[75021]:     </serial>
Dec 06 07:01:04 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:01:04 user nova-compute[75021]:     <video>
Dec 06 07:01:04 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:01:04 user nova-compute[75021]:     </video>
Dec 06 07:01:04 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:01:04 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:01:04 user nova-compute[75021]:     </rng>
Dec 06 07:01:04 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:01:04 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:01:04 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:01:04 user nova-compute[75021]:     </memballoon>
Dec 06 07:01:04 user nova-compute[75021]:   </devices>
Dec 06 07:01:04 user nova-compute[75021]: </domain>
Dec 06 07:01:04 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:01:04 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Instance destroyed successfully.
Dec 06 07:01:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No VIF found with MAC fa:16:3e:3a:ab:56, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Acquiring lock "4b621ac2-857c-44be-9466-2f62165c3dfa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG nova.objects.instance [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lazy-loading 'flavor' on Instance uuid 4b621ac2-857c-44be-9466-2f62165c3dfa {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] No waiting events found dispatching network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:05 user nova-compute[75021]: WARNING nova.compute.manager [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received unexpected event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b for instance with vm_state active and task_state rescuing.
Dec 06 07:01:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] No waiting events found dispatching network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:05 user nova-compute[75021]: WARNING nova.compute.manager [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received unexpected event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b for instance with vm_state active and task_state rescuing.
Dec 06 07:01:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] No waiting events found dispatching network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:05 user nova-compute[75021]: WARNING nova.compute.manager [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received unexpected event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b for instance with vm_state active and task_state rescuing.
Dec 06 07:01:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received event network-vif-unplugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] No waiting events found dispatching network-vif-unplugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:05 user nova-compute[75021]: WARNING nova.compute.manager [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received unexpected event network-vif-unplugged-98cd38aa-33d7-4859-a2eb-5b76676e927b for instance with vm_state active and task_state rescuing.
Dec 06 07:01:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] No waiting events found dispatching network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:05 user nova-compute[75021]: WARNING nova.compute.manager [req-b34ba025-168f-4b29-af67-51fa1f83e8c6 req-7b4801c3-c9f8-40ed-abd6-9e7d64522def service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received unexpected event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b for instance with vm_state active and task_state rescuing.
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Acquiring lock "4b621ac2-857c-44be-9466-2f62165c3dfa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:05 user nova-compute[75021]: INFO nova.compute.manager [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Attaching volume 19ada9f1-fb28-41fb-9eec-4f014b774f8e to /dev/vdb
Dec 06 07:01:06 user nova-compute[75021]: DEBUG os_brick.utils [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7a9df4-8d38-496e-b3d2-9540cb2c0f8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e91e842-1acf-4c27-b489-7e86e1d3bba9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af0abfd-b01b-498f-a9f0-deae27914ae5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[381b5820-4fb3-41c6-ae8e-1f4497db3df7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:01:06 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[86302163-a45a-4d37-a7ab-1253bcc5b914]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG os_brick.utils [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Updating existing volume attachment record: 8c8aa392-731a-4eb9-a5ae-2d507561fab4 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-51ad72f9-10b5-4a65-a464-26657bdad7b6 req-5c04253a-0d58-40c4-864f-7aff9dde8200 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-changed-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-51ad72f9-10b5-4a65-a464-26657bdad7b6 req-5c04253a-0d58-40c4-864f-7aff9dde8200 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Refreshing instance network info cache due to event network-changed-f48c57d0-3024-4f70-8989-454717799fe3. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-51ad72f9-10b5-4a65-a464-26657bdad7b6 req-5c04253a-0d58-40c4-864f-7aff9dde8200 service nova] Acquiring lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-51ad72f9-10b5-4a65-a464-26657bdad7b6 req-5c04253a-0d58-40c4-864f-7aff9dde8200 service nova] Acquired lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG nova.network.neutron [req-51ad72f9-10b5-4a65-a464-26657bdad7b6 req-5c04253a-0d58-40c4-864f-7aff9dde8200 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Refreshing network info cache for port f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:07 user nova-compute[75021]: DEBUG nova.network.neutron [req-51ad72f9-10b5-4a65-a464-26657bdad7b6 req-5c04253a-0d58-40c4-864f-7aff9dde8200 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updated VIF entry in instance network info cache for port f48c57d0-3024-4f70-8989-454717799fe3. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:01:07 user nova-compute[75021]: DEBUG nova.network.neutron [req-51ad72f9-10b5-4a65-a464-26657bdad7b6 req-5c04253a-0d58-40c4-864f-7aff9dde8200 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updating instance_info_cache with network_info: [{"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:01:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-51ad72f9-10b5-4a65-a464-26657bdad7b6 req-5c04253a-0d58-40c4-864f-7aff9dde8200 service nova] Releasing lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:01:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-2a33081d-5077-4b66-b3f0-4bd3837d2e2c req-1a2e4805-8ac2-4547-8a5c-3176503158c7 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2a33081d-5077-4b66-b3f0-4bd3837d2e2c req-1a2e4805-8ac2-4547-8a5c-3176503158c7 service nova] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2a33081d-5077-4b66-b3f0-4bd3837d2e2c req-1a2e4805-8ac2-4547-8a5c-3176503158c7 service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2a33081d-5077-4b66-b3f0-4bd3837d2e2c req-1a2e4805-8ac2-4547-8a5c-3176503158c7 service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-2a33081d-5077-4b66-b3f0-4bd3837d2e2c req-1a2e4805-8ac2-4547-8a5c-3176503158c7 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] No waiting events found dispatching network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:08 user nova-compute[75021]: WARNING nova.compute.manager [req-2a33081d-5077-4b66-b3f0-4bd3837d2e2c req-1a2e4805-8ac2-4547-8a5c-3176503158c7 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received unexpected event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b for instance with vm_state active and task_state rescuing.
Dec 06 07:01:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-2a33081d-5077-4b66-b3f0-4bd3837d2e2c req-1a2e4805-8ac2-4547-8a5c-3176503158c7 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2a33081d-5077-4b66-b3f0-4bd3837d2e2c req-1a2e4805-8ac2-4547-8a5c-3176503158c7 service nova] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2a33081d-5077-4b66-b3f0-4bd3837d2e2c req-1a2e4805-8ac2-4547-8a5c-3176503158c7 service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2a33081d-5077-4b66-b3f0-4bd3837d2e2c req-1a2e4805-8ac2-4547-8a5c-3176503158c7 service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-2a33081d-5077-4b66-b3f0-4bd3837d2e2c req-1a2e4805-8ac2-4547-8a5c-3176503158c7 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] No waiting events found dispatching network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:08 user nova-compute[75021]: WARNING nova.compute.manager [req-2a33081d-5077-4b66-b3f0-4bd3837d2e2c req-1a2e4805-8ac2-4547-8a5c-3176503158c7 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received unexpected event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b for instance with vm_state active and task_state rescuing.
Dec 06 07:01:08 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b1ee7cb3-2328-4111-b461-a14333f5f79f tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:01:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-63ca08d1-9e0d-4102-a740-c9ecdd73865a req-b0d714eb-1f27-44c5-823f-ba50770e9984 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received event network-changed-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-63ca08d1-9e0d-4102-a740-c9ecdd73865a req-b0d714eb-1f27-44c5-823f-ba50770e9984 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Refreshing instance network info cache due to event network-changed-c605d9e6-fce9-495d-b4f3-e2f1e4952633. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:01:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-63ca08d1-9e0d-4102-a740-c9ecdd73865a req-b0d714eb-1f27-44c5-823f-ba50770e9984 service nova] Acquiring lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:01:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-63ca08d1-9e0d-4102-a740-c9ecdd73865a req-b0d714eb-1f27-44c5-823f-ba50770e9984 service nova] Acquired lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:01:10 user nova-compute[75021]: DEBUG nova.network.neutron [req-63ca08d1-9e0d-4102-a740-c9ecdd73865a req-b0d714eb-1f27-44c5-823f-ba50770e9984 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Refreshing network info cache for port c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:01:10 user nova-compute[75021]: DEBUG nova.network.neutron [req-63ca08d1-9e0d-4102-a740-c9ecdd73865a req-b0d714eb-1f27-44c5-823f-ba50770e9984 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Updated VIF entry in instance network info cache for port c605d9e6-fce9-495d-b4f3-e2f1e4952633. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:01:10 user nova-compute[75021]: DEBUG nova.network.neutron [req-63ca08d1-9e0d-4102-a740-c9ecdd73865a req-b0d714eb-1f27-44c5-823f-ba50770e9984 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Updating instance_info_cache with network_info: [{"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:01:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-63ca08d1-9e0d-4102-a740-c9ecdd73865a req-b0d714eb-1f27-44c5-823f-ba50770e9984 service nova] Releasing lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:01:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:15 user nova-compute[75021]: INFO nova.compute.manager [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Shelving
Dec 06 07:01:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-7871d97c-ef95-4198-ab3b-7b70eaa1761b req-9088d8e2-3972-4734-a03d-7c044de02c7c service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received event network-vif-unplugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7871d97c-ef95-4198-ab3b-7b70eaa1761b req-9088d8e2-3972-4734-a03d-7c044de02c7c service nova] Acquiring lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7871d97c-ef95-4198-ab3b-7b70eaa1761b req-9088d8e2-3972-4734-a03d-7c044de02c7c service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7871d97c-ef95-4198-ab3b-7b70eaa1761b req-9088d8e2-3972-4734-a03d-7c044de02c7c service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-7871d97c-ef95-4198-ab3b-7b70eaa1761b req-9088d8e2-3972-4734-a03d-7c044de02c7c service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] No waiting events found dispatching network-vif-unplugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:16 user nova-compute[75021]: WARNING nova.compute.manager [req-7871d97c-ef95-4198-ab3b-7b70eaa1761b req-9088d8e2-3972-4734-a03d-7c044de02c7c service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received unexpected event network-vif-unplugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 for instance with vm_state active and task_state shelving.
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:01:16 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Creating image(s)
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Ensure instance console log exists: /opt/stack/data/nova/instances/ab907f07-df7b-4d56-baef-f2502b88b622/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Start _get_guest_xml network_info=[{"id": "69fc2f53-a06e-4792-9f4d-5044050ed607", "address": "fa:16:3e:ce:59:97", "network": {"id": "68f06c4c-2346-43fc-b05a-a1316f086ac9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-574220473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fc2f53-a0", "ovs_interfaceid": "69fc2f53-a06e-4792-9f4d-5044050ed607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "address": "fa:16:3e:98:90:3a", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape296dd9b-d7", "ovs_interfaceid": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "address": "fa:16:3e:b8:dc:57", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f5b4cc-ae", "ovs_interfaceid": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "address": "fa:16:3e:0c:80:0f", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ea8b6-97", "ovs_interfaceid": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "address": "fa:16:3e:05:d0:4b", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaeaf2a-91", "ovs_interfaceid": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "address": "fa:16:3e:c6:50:8e", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87be3bc7-32", "ovs_interfaceid": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "address": "fa:16:3e:1d:25:78", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90de25ad-46", "ovs_interfaceid": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0b222423-6f15-4823-bead-b71f8b76841f', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibAxPcmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab907f07-df7b-4d56-baef-f2502b88b622', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8e5496c-0ebb-419a-9cb5-779af8247ec3', 'serial': 'e8e5496c-0ebb-419a-9cb5-779af8247ec3'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '51b56594-6f62-4fb3-87e0-4bf1bac7b901', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjbFHtoY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab907f07-df7b-4d56-baef-f2502b88b622', 'attached_at': '', 'detached_at': '', 'volume_id': 'c92406e3-bbbe-45a5-8099-4798ac4ba794', 'serial': 'c92406e3-bbbe-45a5-8099-4798ac4ba794'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': 1, 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '13b45cda-0901-47b9-b61e-7b76a6641e4d', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSEGodcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab907f07-df7b-4d56-baef-f2502b88b622', 'attached_at': '', 'detached_at': '', 'volume_id': '2452ccce-7f6e-4168-b492-cc4cfa3519e5', 'serial': '2452ccce-7f6e-4168-b492-cc4cfa3519e5'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': 2, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:01:16 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Instance destroyed successfully.
Dec 06 07:01:16 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:01:16 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibAxPcmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:16 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:16 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:16 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1f7249-6a3c-4e81-87b6-471918d97dba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:01:16 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:16 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Beginning cold snapshot process
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cc036f-0a7c-4756-a109-554dd53e8bbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3] added
Dec 06 07:01:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d127c9f-9df7-43ee-a43b-9cf4ce53449c]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3745fffb-5e51-4579-a7c1-4fb7f5fb3ef8]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ibAxPcmI {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ibAxPcmI" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[057e812d-d864-40c0-9b33-7949fb20653d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ibAxPcmI'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[decea9aa-1300-4575-b0ab-3624ac1465a3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4632bcf6-7555-4893-91bf-37d184c4d858]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada22975-6166-4064-8e63-c915c0cea35e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3, portal: 172.16.0.220,3260]
Dec 06 07:01:16 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3, portal: 172.16.0.220,3260] successful.
Dec 06 07:01:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5dc759-259c-4e3c-9283-95255eb7f80e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0927916-5071-48c8-8909-70d41b35d07b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:16 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:16 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaf631d-030e-4850-8d27-d2a9d845dfbb]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibAxPcmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 07:01:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk /opt/stack/data/nova/instances/snapshots/tmpm8duv8dz/d28bb328d5ff46e19e67bb9f632e8fcd {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGVebXUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:17 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23136363131343032', 'path': '/dev/sdc'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136363131343032', 'path': '/dev/sdc'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.144s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:17 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:17 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:01:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk /opt/stack/data/nova/instances/snapshots/tmpm8duv8dz/d28bb328d5ff46e19e67bb9f632e8fcd" returned: 0 in 0.968s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:17 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Snapshot extracted, beginning image upload
Dec 06 07:01:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef1f68a-d4d5-48ee-b6eb-bdbcff6685d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:01:17 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[43693eff-97ce-4e92-b185-0b01aa89bd47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e] added
Dec 06 07:01:17 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjbFHtoY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:17 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c101a202-3a15-48d0-875c-2747f3ac6ff4]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8418f7-6c6c-47fa-96a6-7d75a8c0f2f5]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qGVebXUp {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qGVebXUp" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12dc596-01e4-4279-8a3e-77e49ad6aa65]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qGVebXUp'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb9561e-9a1f-4ad9-9b7d-2b53b25a0881]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b799ba53-a736-440a-9152-b733cd7ba800]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:18 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:18 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:18 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:18 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[15810842-709c-42e4-bee9-a5da2e3299b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e, portal: 172.16.0.220,3260]
Dec 06 07:01:18 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e, portal: 172.16.0.220,3260] successful.
Dec 06 07:01:18 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7017271d-a3d9-4c9f-a079-5deee4df689a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[854bed9b-2798-40cd-9429-0b0490cdd15d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:18 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:18 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)
Dec 06 07:01:18 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:18 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:18 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)
Dec 06 07:01:18 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f285b695-8a89-41bb-920d-0150c789ccbc]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGVebXUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-de6ba81f-27b2-43d4-b737-27c72751ca1f req-6b250785-9f86-4894-8fab-d1dfcd0bb0a0 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received event network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-de6ba81f-27b2-43d4-b737-27c72751ca1f req-6b250785-9f86-4894-8fab-d1dfcd0bb0a0 service nova] Acquiring lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-de6ba81f-27b2-43d4-b737-27c72751ca1f req-6b250785-9f86-4894-8fab-d1dfcd0bb0a0 service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-de6ba81f-27b2-43d4-b737-27c72751ca1f req-6b250785-9f86-4894-8fab-d1dfcd0bb0a0 service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-de6ba81f-27b2-43d4-b737-27c72751ca1f req-6b250785-9f86-4894-8fab-d1dfcd0bb0a0 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] No waiting events found dispatching network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:18 user nova-compute[75021]: WARNING nova.compute.manager [req-de6ba81f-27b2-43d4-b737-27c72751ca1f req-6b250785-9f86-4894-8fab-d1dfcd0bb0a0 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received unexpected event network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 for instance with vm_state active and task_state shelving_image_uploading.
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] <== connect_volume: return (1531ms) {'type': 'block', 'scsi_wwn': '26238653032383438', 'path': '/dev/sdd'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238653032383438', 'path': '/dev/sdd'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.316s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:19 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:19 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG nova.objects.instance [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lazy-loading 'flavor' on Instance uuid 4b621ac2-857c-44be-9466-2f62165c3dfa {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[579c62c0-5e97-459b-b2cd-fbd36bc7837b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:01:19 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c1bfe7-a457-40f9-a964-810e89857876]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794] added
Dec 06 07:01:19 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:01:19 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:19 user nova-compute[75021]:   <source dev="/dev/sdd"/>
Dec 06 07:01:19 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:01:19 user nova-compute[75021]:   <serial>19ada9f1-fb28-41fb-9eec-4f014b774f8e</serial>
Dec 06 07:01:19 user nova-compute[75021]: </disk>
Dec 06 07:01:19 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7c1201-bf39-40e1-b0cb-8fe5e2d8a29b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed088f28-e12a-482b-82bf-4acdb86c35dd]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjbFHtoY {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjbFHtoY" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63833f3-8bd3-4bb9-90e3-ddd946899c8f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VjbFHtoY'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ddb756-dc0f-4c4f-a100-cfd278311d23]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[446842d4-d891-4af3-920e-eb2ccde9e5aa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:19 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:19 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)
Dec 06 07:01:19 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:19 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:19 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)
Dec 06 07:01:19 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[788c8a24-40ba-4a86-8e25-83d2c289f545]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794, portal: 172.16.0.220,3260]
Dec 06 07:01:19 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794, portal: 172.16.0.220,3260] successful.
Dec 06 07:01:19 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.093s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7f3229-374f-474f-a2f5-2783836abf98]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a45d2f4-64ce-4cbc-9109-ba4c9ec2142d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:19 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:19 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)
Dec 06 07:01:19 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:19 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:19 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:19 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)
Dec 06 07:01:19 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:19 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.465s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c011e5b0-0123-457e-9c89-34419d99c292]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjbFHtoY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] No VIF found with MAC fa:16:3e:7f:f8:75, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c2ed0ca-b5d9-4309-b481-34359a50494a tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.031s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Acquiring lock "4b621ac2-857c-44be-9466-2f62165c3dfa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Acquiring lock "4b621ac2-857c-44be-9466-2f62165c3dfa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:20 user nova-compute[75021]: INFO nova.compute.manager [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Terminating instance
Dec 06 07:01:20 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-3498489e-4908-4262-ac08-b789a46d3dca req-23ebc7b6-1566-4c48-8560-328c05ddf23b service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Received event network-changed-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-3498489e-4908-4262-ac08-b789a46d3dca req-23ebc7b6-1566-4c48-8560-328c05ddf23b service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Refreshing instance network info cache due to event network-changed-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3498489e-4908-4262-ac08-b789a46d3dca req-23ebc7b6-1566-4c48-8560-328c05ddf23b service nova] Acquiring lock "refresh_cache-b11b4d87-8700-4c0b-9c2c-aac8162def21" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3498489e-4908-4262-ac08-b789a46d3dca req-23ebc7b6-1566-4c48-8560-328c05ddf23b service nova] Acquired lock "refresh_cache-b11b4d87-8700-4c0b-9c2c-aac8162def21" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG nova.network.neutron [req-3498489e-4908-4262-ac08-b789a46d3dca req-23ebc7b6-1566-4c48-8560-328c05ddf23b service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Refreshing network info cache for port f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.524s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] <== connect_volume: return (2840ms) {'type': 'block', 'scsi_wwn': '23864363165333438', 'path': '/dev/sde'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864363165333438', 'path': '/dev/sde'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSEGodcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:20 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:20 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:20 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd00111-f1b3-411e-a183-4b0bdeff9c0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:01:20 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87039ac-49d0-4d86-b1c4-9113d081a225]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5] added
Dec 06 07:01:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[912b096d-e2f4-44f1-a375-769ca0da5302]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdf45c1-e39b-439b-b172-c56417b22566]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OSEGodcA {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OSEGodcA" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfadc58c-c43c-4371-922c-2ec571fbf0f7]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OSEGodcA'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa503b1-13c0-42a3-bc7f-d0ceb6b75261]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:21 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Snapshot image upload complete
Dec 06 07:01:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab07416-924c-41ee-ab82-34f05cff1969]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:21 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:21 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)
Dec 06 07:01:21 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:21 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:21 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:21 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)
Dec 06 07:01:21 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:21 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:21 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Instance destroyed successfully.
Dec 06 07:01:21 user nova-compute[75021]: DEBUG nova.objects.instance [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lazy-loading 'resources' on Instance uuid 4b621ac2-857c-44be-9466-2f62165c3dfa {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG nova.network.neutron [req-3498489e-4908-4262-ac08-b789a46d3dca req-23ebc7b6-1566-4c48-8560-328c05ddf23b service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Updated VIF entry in instance network info cache for port f7af4eb9-d30e-4abd-988e-3ac2fc3434d5. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG nova.network.neutron [req-3498489e-4908-4262-ac08-b789a46d3dca req-23ebc7b6-1566-4c48-8560-328c05ddf23b service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Updating instance_info_cache with network_info: [{"id": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "address": "fa:16:3e:19:71:a3", "network": {"id": "c9847c4f-b306-45d5-8b2a-2254d491735c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571792892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b08a5dd15241a39287b6c00de8f344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7af4eb9-d3", "ovs_interfaceid": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44ace01-cdbd-4eda-a369-9cca42b9b946]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5, portal: 172.16.0.220,3260]
Dec 06 07:01:21 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5, portal: 172.16.0.220,3260] successful.
Dec 06 07:01:21 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-299078579',display_name='tempest-DeleteServersTestJSON-server-299078579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-299078579',id=3,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34178a8149604d7f8fc288510f030b9e',ramdisk_id='',reservation_id='r-hgweg6nk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-202698150',owner_user_name='tempest-DeleteServersTestJSON-202698150-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T06:59:31Z,user_data=None,user_id='883ff000155c4bfcbb3219cabca0fed3',uuid=4b621ac2-857c-44be-9466-2f62165c3dfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "193f630e-f83c-4fc1-8840-34b938525ca1", "address": "fa:16:3e:7f:f8:75", "network": {"id": "1904aeb6-4b68-4412-8700-8ebe6870ac63", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169801536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34178a8149604d7f8fc288510f030b9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193f630e-f8", "ovs_interfaceid": "193f630e-f83c-4fc1-8840-34b938525ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Converting VIF {"id": "193f630e-f83c-4fc1-8840-34b938525ca1", "address": "fa:16:3e:7f:f8:75", "network": {"id": "1904aeb6-4b68-4412-8700-8ebe6870ac63", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-169801536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34178a8149604d7f8fc288510f030b9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193f630e-f8", "ovs_interfaceid": "193f630e-f83c-4fc1-8840-34b938525ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f8:75,bridge_name='br-int',has_traffic_filtering=True,id=193f630e-f83c-4fc1-8840-34b938525ca1,network=Network(1904aeb6-4b68-4412-8700-8ebe6870ac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193f630e-f8') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_vif [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f8:75,bridge_name='br-int',has_traffic_filtering=True,id=193f630e-f83c-4fc1-8840-34b938525ca1,network=Network(1904aeb6-4b68-4412-8700-8ebe6870ac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193f630e-f8') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:01:21 user nova-compute[75021]: INFO nova.compute.manager [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Shelve offloading
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ac9a31-2dd2-4a0e-be1d-2c3bbf22058d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap193f630e-f8, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3498489e-4908-4262-ac08-b789a46d3dca req-23ebc7b6-1566-4c48-8560-328c05ddf23b service nova] Releasing lock "refresh_cache-b11b4d87-8700-4c0b-9c2c-aac8162def21" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10d5df4b-9192-46df-b362-a3bb3b6a6dfa) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:21 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Instance destroyed successfully.
Dec 06 07:01:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquired lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG nova.network.neutron [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[301be25d-d86a-4cfb-8ea8-f3371ed8b59e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:21 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:21 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)
Dec 06 07:01:21 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:21 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:21 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:21 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:21 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)
Dec 06 07:01:21 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:21 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:21 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.460s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:01:21 user nova-compute[75021]: INFO os_vif [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f8:75,bridge_name='br-int',has_traffic_filtering=True,id=193f630e-f83c-4fc1-8840-34b938525ca1,network=Network(1904aeb6-4b68-4412-8700-8ebe6870ac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193f630e-f8')
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGVebXUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:21 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[963309b4-4fe3-4980-b9f1-c72b5e1abf12]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSEGodcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG nova.network.neutron [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Updating instance_info_cache with network_info: [{"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:01:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Releasing lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.509s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] <== connect_volume: return (1510ms) {'type': 'block', 'scsi_wwn': '23566333438333530', 'path': '/dev/sdf'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566333438333530', 'path': '/dev/sdf'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.038s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69fc2f53-a06e-4792-9f4d-5044050ed607", "address": "fa:16:3e:ce:59:97", "network": {"id": "68f06c4c-2346-43fc-b05a-a1316f086ac9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-574220473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fc2f53-a0", "ovs_interfaceid": "69fc2f53-a06e-4792-9f4d-5044050ed607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "69fc2f53-a06e-4792-9f4d-5044050ed607", "address": "fa:16:3e:ce:59:97", "network": {"id": "68f06c4c-2346-43fc-b05a-a1316f086ac9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-574220473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fc2f53-a0", "ovs_interfaceid": "69fc2f53-a06e-4792-9f4d-5044050ed607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:59:97,bridge_name='br-int',has_traffic_filtering=True,id=69fc2f53-a06e-4792-9f4d-5044050ed607,network=Network(68f06c4c-2346-43fc-b05a-a1316f086ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69fc2f53-a0') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "address": "fa:16:3e:98:90:3a", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape296dd9b-d7", "ovs_interfaceid": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "address": "fa:16:3e:98:90:3a", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape296dd9b-d7", "ovs_interfaceid": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:90:3a,bridge_name='br-int',has_traffic_filtering=True,id=e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape296dd9b-d7') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "address": "fa:16:3e:b8:dc:57", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f5b4cc-ae", "ovs_interfaceid": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "address": "fa:16:3e:b8:dc:57", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f5b4cc-ae", "ovs_interfaceid": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:dc:57,bridge_name='br-int',has_traffic_filtering=True,id=16f5b4cc-aef4-43c4-a87f-81993a0cdee9,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16f5b4cc-ae') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "address": "fa:16:3e:0c:80:0f", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ea8b6-97", "ovs_interfaceid": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "address": "fa:16:3e:0c:80:0f", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ea8b6-97", "ovs_interfaceid": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:80:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b7ea8b6-978c-4760-b4eb-81ca2fe10caa,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7ea8b6-97') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "address": "fa:16:3e:05:d0:4b", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaeaf2a-91", "ovs_interfaceid": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "address": "fa:16:3e:05:d0:4b", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaeaf2a-91", "ovs_interfaceid": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:d0:4b,bridge_name='br-int',has_traffic_filtering=True,id=cfaeaf2a-91aa-405d-ab13-b3827d9165e3,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfaeaf2a-91') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "address": "fa:16:3e:c6:50:8e", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87be3bc7-32", "ovs_interfaceid": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "address": "fa:16:3e:c6:50:8e", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87be3bc7-32", "ovs_interfaceid": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:50:8e,bridge_name='br-int',has_traffic_filtering=True,id=87be3bc7-3281-4732-8ba2-8a1d89d724fe,network=Network(c9839188-595f-4aa5-a6e7-c05d3aed9f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87be3bc7-32') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "address": "fa:16:3e:1d:25:78", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90de25ad-46", "ovs_interfaceid": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "address": "fa:16:3e:1d:25:78", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90de25ad-46", "ovs_interfaceid": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:25:78,bridge_name='br-int',has_traffic_filtering=True,id=90de25ad-46b1-410a-bfc6-81ad5873c4f0,network=Network(c9839188-595f-4aa5-a6e7-c05d3aed9f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90de25ad-46') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.objects.instance [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lazy-loading 'pci_devices' on Instance uuid ab907f07-df7b-4d56-baef-f2502b88b622 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e92bca3-6e7b-4838-8caf-58108bc43741]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:01:22 user nova-compute[75021]: No targets found.
Dec 06 07:01:22 user nova-compute[75021]: iSNS:
Dec 06 07:01:22 user nova-compute[75021]: No targets found.
Dec 06 07:01:22 user nova-compute[75021]: STATIC:
Dec 06 07:01:22 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5
Dec 06 07:01:22 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:22 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:22 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e
Dec 06 07:01:22 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:22 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:22 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3
Dec 06 07:01:22 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:22 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:22 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d
Dec 06 07:01:22 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:22 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:22 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794
Dec 06 07:01:22 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:22 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:22 user nova-compute[75021]: FIRMWARE:
Dec 06 07:01:22 user nova-compute[75021]: No targets found.
Dec 06 07:01:22 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:01:22 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:01:22 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:01:22 user nova-compute[75021]:   <uuid>ab907f07-df7b-4d56-baef-f2502b88b622</uuid>
Dec 06 07:01:22 user nova-compute[75021]:   <name>instance-0000000c</name>
Dec 06 07:01:22 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:01:22 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:01:22 user nova-compute[75021]:   <metadata>
Dec 06 07:01:22 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:01:22 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:01:22 user nova-compute[75021]:       <nova:name>tempest-device-tagging-server-469752436</nova:name>
Dec 06 07:01:22 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:01:16</nova:creationTime>
Dec 06 07:01:22 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:01:22 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:01:22 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:01:22 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:01:22 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:01:22 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:01:22 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:01:22 user nova-compute[75021]:       <nova:owner>
Dec 06 07:01:22 user nova-compute[75021]:         <nova:user uuid="038526fdbc594c88ba8ed742fa8dc471">tempest-TaggedBootDevicesTest-556945540-project-member</nova:user>
Dec 06 07:01:22 user nova-compute[75021]:         <nova:project uuid="bb0be691fa62401a967b32a716490165">tempest-TaggedBootDevicesTest-556945540</nova:project>
Dec 06 07:01:22 user nova-compute[75021]:       </nova:owner>
Dec 06 07:01:22 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:01:22 user nova-compute[75021]:       <nova:ports>
Dec 06 07:01:22 user nova-compute[75021]:         <nova:port uuid="69fc2f53-a06e-4792-9f4d-5044050ed607">
Dec 06 07:01:22 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 07:01:22 user nova-compute[75021]:         </nova:port>
Dec 06 07:01:22 user nova-compute[75021]:         <nova:port uuid="e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e">
Dec 06 07:01:22 user nova-compute[75021]:           <nova:ip type="fixed" address="10.1.1.62" ipVersion="4"/>
Dec 06 07:01:22 user nova-compute[75021]:         </nova:port>
Dec 06 07:01:22 user nova-compute[75021]:         <nova:port uuid="16f5b4cc-aef4-43c4-a87f-81993a0cdee9">
Dec 06 07:01:22 user nova-compute[75021]:           <nova:ip type="fixed" address="10.1.1.16" ipVersion="4"/>
Dec 06 07:01:22 user nova-compute[75021]:         </nova:port>
Dec 06 07:01:22 user nova-compute[75021]:         <nova:port uuid="8b7ea8b6-978c-4760-b4eb-81ca2fe10caa">
Dec 06 07:01:22 user nova-compute[75021]:           <nova:ip type="fixed" address="10.1.1.81" ipVersion="4"/>
Dec 06 07:01:22 user nova-compute[75021]:         </nova:port>
Dec 06 07:01:22 user nova-compute[75021]:         <nova:port uuid="cfaeaf2a-91aa-405d-ab13-b3827d9165e3">
Dec 06 07:01:22 user nova-compute[75021]:           <nova:ip type="fixed" address="10.1.1.193" ipVersion="4"/>
Dec 06 07:01:22 user nova-compute[75021]:         </nova:port>
Dec 06 07:01:22 user nova-compute[75021]:         <nova:port uuid="87be3bc7-3281-4732-8ba2-8a1d89d724fe">
Dec 06 07:01:22 user nova-compute[75021]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 06 07:01:22 user nova-compute[75021]:         </nova:port>
Dec 06 07:01:22 user nova-compute[75021]:         <nova:port uuid="90de25ad-46b1-410a-bfc6-81ad5873c4f0">
Dec 06 07:01:22 user nova-compute[75021]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 06 07:01:22 user nova-compute[75021]:         </nova:port>
Dec 06 07:01:22 user nova-compute[75021]:       </nova:ports>
Dec 06 07:01:22 user nova-compute[75021]:     </nova:instance>
Dec 06 07:01:22 user nova-compute[75021]:   </metadata>
Dec 06 07:01:22 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:01:22 user nova-compute[75021]:     <system>
Dec 06 07:01:22 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:01:22 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:01:22 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:01:22 user nova-compute[75021]:       <entry name="serial">ab907f07-df7b-4d56-baef-f2502b88b622</entry>
Dec 06 07:01:22 user nova-compute[75021]:       <entry name="uuid">ab907f07-df7b-4d56-baef-f2502b88b622</entry>
Dec 06 07:01:22 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:01:22 user nova-compute[75021]:     </system>
Dec 06 07:01:22 user nova-compute[75021]:   </sysinfo>
Dec 06 07:01:22 user nova-compute[75021]:   <os>
Dec 06 07:01:22 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:01:22 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:01:22 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:01:22 user nova-compute[75021]:   </os>
Dec 06 07:01:22 user nova-compute[75021]:   <features>
Dec 06 07:01:22 user nova-compute[75021]:     <acpi/>
Dec 06 07:01:22 user nova-compute[75021]:     <apic/>
Dec 06 07:01:22 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:01:22 user nova-compute[75021]:   </features>
Dec 06 07:01:22 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:01:22 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:01:22 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:01:22 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:01:22 user nova-compute[75021]:   </clock>
Dec 06 07:01:22 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:01:22 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:01:22 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:01:22 user nova-compute[75021]:   </cpu>
Dec 06 07:01:22 user nova-compute[75021]:   <devices>
Dec 06 07:01:22 user nova-compute[75021]:     <disk type="file" device="cdrom">
Dec 06 07:01:22 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none"/>
Dec 06 07:01:22 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/ab907f07-df7b-4d56-baef-f2502b88b622/disk.config"/>
Dec 06 07:01:22 user nova-compute[75021]:       <target dev="hda" bus="ide"/>
Dec 06 07:01:22 user nova-compute[75021]:     </disk>
Dec 06 07:01:22 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:01:22 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:22 user nova-compute[75021]:       <source dev="/dev/sdc"/>
Dec 06 07:01:22 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:01:22 user nova-compute[75021]:       <serial>e8e5496c-0ebb-419a-9cb5-779af8247ec3</serial>
Dec 06 07:01:22 user nova-compute[75021]:     </disk>
Dec 06 07:01:22 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:01:22 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:22 user nova-compute[75021]:       <source dev="/dev/sde"/>
Dec 06 07:01:22 user nova-compute[75021]:       <target dev="vdb" bus="virtio"/>
Dec 06 07:01:22 user nova-compute[75021]:       <serial>c92406e3-bbbe-45a5-8099-4798ac4ba794</serial>
Dec 06 07:01:22 user nova-compute[75021]:     </disk>
Dec 06 07:01:22 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:01:22 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:22 user nova-compute[75021]:       <source dev="/dev/sdf"/>
Dec 06 07:01:22 user nova-compute[75021]:       <target dev="vdc" bus="virtio"/>
Dec 06 07:01:22 user nova-compute[75021]:       <serial>2452ccce-7f6e-4168-b492-cc4cfa3519e5</serial>
Dec 06 07:01:22 user nova-compute[75021]:     </disk>
Dec 06 07:01:22 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:01:22 user nova-compute[75021]:       <mac address="fa:16:3e:ce:59:97"/>
Dec 06 07:01:22 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:01:22 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:01:22 user nova-compute[75021]:       <target dev="tap69fc2f53-a0"/>
Dec 06 07:01:22 user nova-compute[75021]:     </interface>
Dec 06 07:01:22 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:01:22 user nova-compute[75021]:       <mac address="fa:16:3e:98:90:3a"/>
Dec 06 07:01:22 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:01:22 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:01:22 user nova-compute[75021]:       <target dev="tape296dd9b-d7"/>
Dec 06 07:01:22 user nova-compute[75021]:     </interface>
Dec 06 07:01:22 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:01:22 user nova-compute[75021]:       <mac address="fa:16:3e:b8:dc:57"/>
Dec 06 07:01:22 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:01:22 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:01:22 user nova-compute[75021]:       <target dev="tap16f5b4cc-ae"/>
Dec 06 07:01:22 user nova-compute[75021]:     </interface>
Dec 06 07:01:22 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:01:22 user nova-compute[75021]:       <mac address="fa:16:3e:0c:80:0f"/>
Dec 06 07:01:22 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:01:22 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:01:22 user nova-compute[75021]:       <target dev="tap8b7ea8b6-97"/>
Dec 06 07:01:22 user nova-compute[75021]:     </interface>
Dec 06 07:01:22 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:01:22 user nova-compute[75021]:       <mac address="fa:16:3e:05:d0:4b"/>
Dec 06 07:01:22 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:01:22 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:01:22 user nova-compute[75021]:       <target dev="tapcfaeaf2a-91"/>
Dec 06 07:01:22 user nova-compute[75021]:     </interface>
Dec 06 07:01:22 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:01:22 user nova-compute[75021]:       <mac address="fa:16:3e:c6:50:8e"/>
Dec 06 07:01:22 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:01:22 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:01:22 user nova-compute[75021]:       <target dev="tap87be3bc7-32"/>
Dec 06 07:01:22 user nova-compute[75021]:     </interface>
Dec 06 07:01:22 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:01:22 user nova-compute[75021]:       <mac address="fa:16:3e:1d:25:78"/>
Dec 06 07:01:22 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:01:22 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:01:22 user nova-compute[75021]:       <target dev="tap90de25ad-46"/>
Dec 06 07:01:22 user nova-compute[75021]:     </interface>
Dec 06 07:01:22 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:01:22 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/ab907f07-df7b-4d56-baef-f2502b88b622/console.log" append="off"/>
Dec 06 07:01:22 user nova-compute[75021]:     </serial>
Dec 06 07:01:22 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:01:22 user nova-compute[75021]:     <video>
Dec 06 07:01:22 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:01:22 user nova-compute[75021]:     </video>
Dec 06 07:01:22 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:01:22 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:01:22 user nova-compute[75021]:     </rng>
Dec 06 07:01:22 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:01:22 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:01:22 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:01:22 user nova-compute[75021]:     </memballoon>
Dec 06 07:01:22 user nova-compute[75021]:   </devices>
Dec 06 07:01:22 user nova-compute[75021]: </domain>
Dec 06 07:01:22 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69fc2f53-a06e-4792-9f4d-5044050ed607", "address": "fa:16:3e:ce:59:97", "network": {"id": "68f06c4c-2346-43fc-b05a-a1316f086ac9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-574220473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fc2f53-a0", "ovs_interfaceid": "69fc2f53-a06e-4792-9f4d-5044050ed607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "69fc2f53-a06e-4792-9f4d-5044050ed607", "address": "fa:16:3e:ce:59:97", "network": {"id": "68f06c4c-2346-43fc-b05a-a1316f086ac9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-574220473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fc2f53-a0", "ovs_interfaceid": "69fc2f53-a06e-4792-9f4d-5044050ed607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:59:97,bridge_name='br-int',has_traffic_filtering=True,id=69fc2f53-a06e-4792-9f4d-5044050ed607,network=Network(68f06c4c-2346-43fc-b05a-a1316f086ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69fc2f53-a0') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:59:97,bridge_name='br-int',has_traffic_filtering=True,id=69fc2f53-a06e-4792-9f4d-5044050ed607,network=Network(68f06c4c-2346-43fc-b05a-a1316f086ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69fc2f53-a0') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0602967-4286-43ae-b169-df38e8d8ff02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f44e19a-aa91-51b7-8866-1e251c3d11bb', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-8d00b810-8f47-4065-8c15-2b176a5c9ebf req-486ad168-8cca-408a-b9cf-f8b97ae88cac service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received event network-changed-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-8d00b810-8f47-4065-8c15-2b176a5c9ebf req-486ad168-8cca-408a-b9cf-f8b97ae88cac service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Refreshing instance network info cache due to event network-changed-c605d9e6-fce9-495d-b4f3-e2f1e4952633. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8d00b810-8f47-4065-8c15-2b176a5c9ebf req-486ad168-8cca-408a-b9cf-f8b97ae88cac service nova] Acquiring lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8d00b810-8f47-4065-8c15-2b176a5c9ebf req-486ad168-8cca-408a-b9cf-f8b97ae88cac service nova] Acquired lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.neutron [req-8d00b810-8f47-4065-8c15-2b176a5c9ebf req-486ad168-8cca-408a-b9cf-f8b97ae88cac service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Refreshing network info cache for port c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4211a1-554f-41c7-8971-a0718e1d6287]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:22 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:22 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)
Dec 06 07:01:22 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:22 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:22 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:22 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:22 user nova-compute[75021]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e (non-flash)
Dec 06 07:01:22 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:22 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:22 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d84f3eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e'): ({'sdd'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Removing single pathed devices sdd {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "b11b4d87-8700-4c0b-9c2c-aac8162def21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69fc2f53-a0, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69fc2f53-a0, col_values=(('qos', UUID('87ae653b-6632-4c79-9ea7-04ebc1b60278')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69fc2f53-a0, col_values=(('external_ids', {'iface-id': '69fc2f53-a06e-4792-9f4d-5044050ed607', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:59:97', 'vm-uuid': 'ab907f07-df7b-4d56-baef-f2502b88b622'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Instance destroyed successfully.
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.objects.instance [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'resources' on Instance uuid f9275ae0-ccb1-4c73-b639-9cd243c6ff60 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2110edb-250a-4ff9-b589-5f8d1e8f3d8c]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.objects.instance [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lazy-loading 'flavor' on Instance uuid b11b4d87-8700-4c0b-9c2c-aac8162def21 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2135327261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2135327261',id=5,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3Lr/kdf8MqVfMx/TeUSMAfVzvaX8ereHkjXoBa9ETDzmMjMiQ9csySNchdYnRT2yeIOuwNGKkvlDgg8mH04y1O/ltV6AdPBXl6ROzuZndpgBoI4b+/RQCPqcSHuavY/Q==',key_name='tempest-keypair-400149348',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d75ae216dcb345c79a5c2a4d38e51b38',ramdisk_id='',reservation_id='r-mbynyqjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1923852465',owner_user_name='tempest-AttachVolumeShelveTestJSON-1923852465-project-member',shelved_at='2023-12-06T07:01:21.094812',shelved_host='user',shelved_image_id='c08f3275-f5dd-4456-977a-4de852703db0'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:01:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4daf20c071c4b5cb826452811323abd',uuid=f9275ae0-ccb1-4c73-b639-9cd243c6ff60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converting VIF {"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=c605d9e6-fce9-495d-b4f3-e2f1e4952633,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605d9e6-fc') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_vif [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=c605d9e6-fce9-495d-b4f3-e2f1e4952633,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605d9e6-fc') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: INFO os_vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:59:97,bridge_name='br-int',has_traffic_filtering=True,id=69fc2f53-a06e-4792-9f4d-5044050ed607,network=Network(68f06c4c-2346-43fc-b05a-a1316f086ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69fc2f53-a0')
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "address": "fa:16:3e:98:90:3a", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape296dd9b-d7", "ovs_interfaceid": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "address": "fa:16:3e:98:90:3a", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape296dd9b-d7", "ovs_interfaceid": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:90:3a,bridge_name='br-int',has_traffic_filtering=True,id=e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape296dd9b-d7') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:90:3a,bridge_name='br-int',has_traffic_filtering=True,id=e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape296dd9b-d7') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc605d9e6-fc, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5b9be5-9068-458f-a167-b4a37c71d44b]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Flushing IO for device /dev/sdd {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59122b12-09e4-4c78-89d0-255dd27d5e15) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d51f815-6b7a-4f0f-8781-0b913c12bff0]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c4a407c-6e68-5c71-8647-4e50cc81707a', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: INFO os_vif [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=c605d9e6-fce9-495d-b4f3-e2f1e4952633,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605d9e6-fc')
Dec 06 07:01:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Deleting instance files /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60_del
Dec 06 07:01:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Deletion of /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60_del complete
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d18c15-d876-4151-bd3d-920406ba56f7]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.140s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape296dd9b-d7, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape296dd9b-d7, col_values=(('qos', UUID('2931bd06-8247-47b9-b44d-c5ea5431a512')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape296dd9b-d7, col_values=(('external_ids', {'iface-id': 'e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:90:3a', 'vm-uuid': 'ab907f07-df7b-4d56-baef-f2502b88b622'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43290b8-7125-4155-959c-1e664724057e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: INFO os_vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:90:3a,bridge_name='br-int',has_traffic_filtering=True,id=e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape296dd9b-d7')
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "address": "fa:16:3e:b8:dc:57", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f5b4cc-ae", "ovs_interfaceid": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "address": "fa:16:3e:b8:dc:57", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f5b4cc-ae", "ovs_interfaceid": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:dc:57,bridge_name='br-int',has_traffic_filtering=True,id=16f5b4cc-aef4-43c4-a87f-81993a0cdee9,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16f5b4cc-ae') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:dc:57,bridge_name='br-int',has_traffic_filtering=True,id=16f5b4cc-aef4-43c4-a87f-81993a0cdee9,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16f5b4cc-ae') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11b2666b-e432-5e04-9fe0-8a55f5a25ca4', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-2e99ba9f-67bb-4589-ac33-967dd9d309c5 req-0e4ff184-9623-41b8-94c6-8326f3238023 service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Received event network-vif-unplugged-193f630e-f83c-4fc1-8840-34b938525ca1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e99ba9f-67bb-4589-ac33-967dd9d309c5 req-0e4ff184-9623-41b8-94c6-8326f3238023 service nova] Acquiring lock "4b621ac2-857c-44be-9466-2f62165c3dfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e99ba9f-67bb-4589-ac33-967dd9d309c5 req-0e4ff184-9623-41b8-94c6-8326f3238023 service nova] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e99ba9f-67bb-4589-ac33-967dd9d309c5 req-0e4ff184-9623-41b8-94c6-8326f3238023 service nova] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-2e99ba9f-67bb-4589-ac33-967dd9d309c5 req-0e4ff184-9623-41b8-94c6-8326f3238023 service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] No waiting events found dispatching network-vif-unplugged-193f630e-f83c-4fc1-8840-34b938525ca1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-2e99ba9f-67bb-4589-ac33-967dd9d309c5 req-0e4ff184-9623-41b8-94c6-8326f3238023 service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Received event network-vif-unplugged-193f630e-f83c-4fc1-8840-34b938525ca1 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-2e99ba9f-67bb-4589-ac33-967dd9d309c5 req-0e4ff184-9623-41b8-94c6-8326f3238023 service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Received event network-vif-plugged-193f630e-f83c-4fc1-8840-34b938525ca1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e99ba9f-67bb-4589-ac33-967dd9d309c5 req-0e4ff184-9623-41b8-94c6-8326f3238023 service nova] Acquiring lock "4b621ac2-857c-44be-9466-2f62165c3dfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e99ba9f-67bb-4589-ac33-967dd9d309c5 req-0e4ff184-9623-41b8-94c6-8326f3238023 service nova] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e99ba9f-67bb-4589-ac33-967dd9d309c5 req-0e4ff184-9623-41b8-94c6-8326f3238023 service nova] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-2e99ba9f-67bb-4589-ac33-967dd9d309c5 req-0e4ff184-9623-41b8-94c6-8326f3238023 service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] No waiting events found dispatching network-vif-plugged-193f630e-f83c-4fc1-8840-34b938525ca1 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:22 user nova-compute[75021]: WARNING nova.compute.manager [req-2e99ba9f-67bb-4589-ac33-967dd9d309c5 req-0e4ff184-9623-41b8-94c6-8326f3238023 service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Received unexpected event network-vif-plugged-193f630e-f83c-4fc1-8840-34b938525ca1 for instance with vm_state active and task_state deleting.
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16f5b4cc-ae, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16f5b4cc-ae, col_values=(('qos', UUID('f926a2ac-b55c-4afd-ba74-19e9a3797fdd')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16f5b4cc-ae, col_values=(('external_ids', {'iface-id': '16f5b4cc-aef4-43c4-a87f-81993a0cdee9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:dc:57', 'vm-uuid': 'ab907f07-df7b-4d56-baef-f2502b88b622'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5f7c3a-4b0f-47fb-985a-34a8998b5eb2]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e, portal: 172.16.0.220,3260]
Dec 06 07:01:22 user nova-compute[75021]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e, portal: 172.16.0.220,3260] successful.
Dec 06 07:01:22 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75021) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Dec 06 07:01:22 user nova-compute[75021]: INFO nova.virt.libvirt.host [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] UEFI support detected
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: INFO os_vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:dc:57,bridge_name='br-int',has_traffic_filtering=True,id=16f5b4cc-aef4-43c4-a87f-81993a0cdee9,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16f5b4cc-ae')
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "address": "fa:16:3e:0c:80:0f", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ea8b6-97", "ovs_interfaceid": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "address": "fa:16:3e:0c:80:0f", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ea8b6-97", "ovs_interfaceid": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:80:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b7ea8b6-978c-4760-b4eb-81ca2fe10caa,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7ea8b6-97') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:80:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b7ea8b6-978c-4760-b4eb-81ca2fe10caa,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7ea8b6-97') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ada9f1-fb28-41fb-9eec-4f014b774f8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2bc579-6894-466f-b5d3-8c127a3e03ad]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] <== disconnect_volume: return (1502ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:01:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Deleting instance files /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa_del
Dec 06 07:01:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Deletion of /opt/stack/data/nova/instances/4b621ac2-857c-44be-9466-2f62165c3dfa_del complete
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c520c977-6d07-5381-8fb2-d25342902e51', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:22 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Deleted allocations for instance f9275ae0-ccb1-4c73-b639-9cd243c6ff60
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "b11b4d87-8700-4c0b-9c2c-aac8162def21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:22 user nova-compute[75021]: INFO nova.compute.manager [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Attaching volume f90ea2b4-fbec-42bf-a3b7-a0890c227dea to /dev/sdc
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b7ea8b6-97, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b7ea8b6-97, col_values=(('qos', UUID('e9eed5c6-4d95-41c6-a1e9-a01b24cf7f0d')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b7ea8b6-97, col_values=(('external_ids', {'iface-id': '8b7ea8b6-978c-4760-b4eb-81ca2fe10caa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:80:0f', 'vm-uuid': 'ab907f07-df7b-4d56-baef-f2502b88b622'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.objects.instance [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'numa_topology' on Instance uuid f9275ae0-ccb1-4c73-b639-9cd243c6ff60 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: INFO os_vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:80:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b7ea8b6-978c-4760-b4eb-81ca2fe10caa,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7ea8b6-97')
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "address": "fa:16:3e:05:d0:4b", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaeaf2a-91", "ovs_interfaceid": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "address": "fa:16:3e:05:d0:4b", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaeaf2a-91", "ovs_interfaceid": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:d0:4b,bridge_name='br-int',has_traffic_filtering=True,id=cfaeaf2a-91aa-405d-ab13-b3827d9165e3,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfaeaf2a-91') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:d0:4b,bridge_name='br-int',has_traffic_filtering=True,id=cfaeaf2a-91aa-405d-ab13-b3827d9165e3,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfaeaf2a-91') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:01:22 user nova-compute[75021]: INFO nova.compute.manager [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Took 2.58 seconds to destroy the instance on the hypervisor.
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c469e576-577a-54c6-97af-dc30a0b72b11', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG nova.objects.base [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Object Instance<f9275ae0-ccb1-4c73-b639-9cd243c6ff60> lazy-loaded attributes: resources,numa_topology {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG os_brick.utils [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b55b6b-a604-4410-be43-b4b6579a4b7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfaeaf2a-91, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfaeaf2a-91, col_values=(('qos', UUID('a932fbcc-e7c0-439c-8040-69c75ba914c3')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfaeaf2a-91, col_values=(('external_ids', {'iface-id': 'cfaeaf2a-91aa-405d-ab13-b3827d9165e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:d0:4b', 'vm-uuid': 'ab907f07-df7b-4d56-baef-f2502b88b622'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bec341-4129-4ce6-89b6-ae17c2224620]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71e79bd-6d91-4185-bd52-53befc2ab441]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3122478b-d986-4d86-b575-db41dab0e0f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:01:23 user nova-compute[75021]: INFO os_vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:d0:4b,bridge_name='br-int',has_traffic_filtering=True,id=cfaeaf2a-91aa-405d-ab13-b3827d9165e3,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfaeaf2a-91')
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "address": "fa:16:3e:c6:50:8e", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87be3bc7-32", "ovs_interfaceid": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "address": "fa:16:3e:c6:50:8e", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87be3bc7-32", "ovs_interfaceid": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:50:8e,bridge_name='br-int',has_traffic_filtering=True,id=87be3bc7-3281-4732-8ba2-8a1d89d724fe,network=Network(c9839188-595f-4aa5-a6e7-c05d3aed9f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87be3bc7-32') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG os_vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:50:8e,bridge_name='br-int',has_traffic_filtering=True,id=87be3bc7-3281-4732-8ba2-8a1d89d724fe,network=Network(c9839188-595f-4aa5-a6e7-c05d3aed9f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87be3bc7-32') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:01:23 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:01:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d739cb0-d3fb-4201-9907-10c79f29dbe3]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG os_brick.utils [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Updating existing volume attachment record: 7357c299-db44-4ff6-88c0-5ff19ae147ab {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47ed67b1-615f-5e3a-b0e3-f6a8874163d8', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87be3bc7-32, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87be3bc7-32, col_values=(('qos', UUID('b7432894-83c3-462b-8207-6b1b14273d70')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87be3bc7-32, col_values=(('external_ids', {'iface-id': '87be3bc7-3281-4732-8ba2-8a1d89d724fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:50:8e', 'vm-uuid': 'ab907f07-df7b-4d56-baef-f2502b88b622'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: INFO os_vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:50:8e,bridge_name='br-int',has_traffic_filtering=True,id=87be3bc7-3281-4732-8ba2-8a1d89d724fe,network=Network(c9839188-595f-4aa5-a6e7-c05d3aed9f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87be3bc7-32')
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "address": "fa:16:3e:1d:25:78", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90de25ad-46", "ovs_interfaceid": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "address": "fa:16:3e:1d:25:78", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90de25ad-46", "ovs_interfaceid": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:25:78,bridge_name='br-int',has_traffic_filtering=True,id=90de25ad-46b1-410a-bfc6-81ad5873c4f0,network=Network(c9839188-595f-4aa5-a6e7-c05d3aed9f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90de25ad-46') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG os_vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:25:78,bridge_name='br-int',has_traffic_filtering=True,id=90de25ad-46b1-410a-bfc6-81ad5873c4f0,network=Network(c9839188-595f-4aa5-a6e7-c05d3aed9f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90de25ad-46') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74d81110-22e9-5eba-8e56-08e280523ce4', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90de25ad-46, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90de25ad-46, col_values=(('qos', UUID('4ef3b5b5-d2fc-4749-826e-b7cd3fe316eb')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90de25ad-46, col_values=(('external_ids', {'iface-id': '90de25ad-46b1-410a-bfc6-81ad5873c4f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:25:78', 'vm-uuid': 'ab907f07-df7b-4d56-baef-f2502b88b622'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:01:23 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Took 0.79 seconds to deallocate network for instance.
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.network.neutron [req-8d00b810-8f47-4065-8c15-2b176a5c9ebf req-486ad168-8cca-408a-b9cf-f8b97ae88cac service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Updated VIF entry in instance network info cache for port c605d9e6-fce9-495d-b4f3-e2f1e4952633. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.network.neutron [req-8d00b810-8f47-4065-8c15-2b176a5c9ebf req-486ad168-8cca-408a-b9cf-f8b97ae88cac service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Updating instance_info_cache with network_info: [{"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:23 user nova-compute[75021]: INFO os_vif [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:25:78,bridge_name='br-int',has_traffic_filtering=True,id=90de25ad-46b1-410a-bfc6-81ad5873c4f0,network=Network(c9839188-595f-4aa5-a6e7-c05d3aed9f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90de25ad-46')
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-9b920c68-e2c0-4ac6-aeaf-f4425e04d88a req-e60d3dba-3ea0-4f73-b0ee-61ab044ba9ec service nova] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Received event network-vif-deleted-193f630e-f83c-4fc1-8840-34b938525ca1 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8d00b810-8f47-4065-8c15-2b176a5c9ebf req-486ad168-8cca-408a-b9cf-f8b97ae88cac service nova] Releasing lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.929s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] No BDM found with device name hda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] No VIF found with MAC fa:16:3e:ce:59:97, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:01:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] No VIF found with MAC fa:16:3e:05:d0:4b, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:01:23 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Using config drive
Dec 06 07:01:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-19dfb46f-13fc-4bff-9b94-90f774ef1b73 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.111s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:24 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Creating config drive at /opt/stack/data/nova/instances/ab907f07-df7b-4d56-baef-f2502b88b622/disk.config
Dec 06 07:01:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ab907f07-df7b-4d56-baef-f2502b88b622/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph6unlkxt {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ab907f07-df7b-4d56-baef-f2502b88b622/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph6unlkxt" returned: 0 in 0.056s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:24 user nova-compute[75021]: INFO nova.compute.manager [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] [instance: 4b621ac2-857c-44be-9466-2f62165c3dfa] Took 0.95 seconds to detach 1 volumes for instance.
Dec 06 07:01:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-16cc9880-b0ef-4e38-8822-0adc1516e7dd req-4aca8f68-6834-464c-81c0-25b7c2d0531a service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Received event network-changed-3c57d6ef-14c3-4e6f-8e82-e0b33416696d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-16cc9880-b0ef-4e38-8822-0adc1516e7dd req-4aca8f68-6834-464c-81c0-25b7c2d0531a service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Refreshing instance network info cache due to event network-changed-3c57d6ef-14c3-4e6f-8e82-e0b33416696d. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:01:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-16cc9880-b0ef-4e38-8822-0adc1516e7dd req-4aca8f68-6834-464c-81c0-25b7c2d0531a service nova] Acquiring lock "refresh_cache-9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:01:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-16cc9880-b0ef-4e38-8822-0adc1516e7dd req-4aca8f68-6834-464c-81c0-25b7c2d0531a service nova] Acquired lock "refresh_cache-9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:01:24 user nova-compute[75021]: DEBUG nova.network.neutron [req-16cc9880-b0ef-4e38-8822-0adc1516e7dd req-4aca8f68-6834-464c-81c0-25b7c2d0531a service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Refreshing network info cache for port 3c57d6ef-14c3-4e6f-8e82-e0b33416696d {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:01:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:25 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:01:25 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:01:25 user nova-compute[75021]: DEBUG nova.network.neutron [req-16cc9880-b0ef-4e38-8822-0adc1516e7dd req-4aca8f68-6834-464c-81c0-25b7c2d0531a service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Updated VIF entry in instance network info cache for port 3c57d6ef-14c3-4e6f-8e82-e0b33416696d. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:01:25 user nova-compute[75021]: DEBUG nova.network.neutron [req-16cc9880-b0ef-4e38-8822-0adc1516e7dd req-4aca8f68-6834-464c-81c0-25b7c2d0531a service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Updating instance_info_cache with network_info: [{"id": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "address": "fa:16:3e:5f:22:74", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c57d6ef-14", "ovs_interfaceid": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:01:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-16cc9880-b0ef-4e38-8822-0adc1516e7dd req-4aca8f68-6834-464c-81c0-25b7c2d0531a service nova] Releasing lock "refresh_cache-9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:01:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.624s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:25 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Deleted allocations for instance 4b621ac2-857c-44be-9466-2f62165c3dfa
Dec 06 07:01:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ab8e8b94-101d-4221-977b-6ca07ec76c16 tempest-DeleteServersTestJSON-202698150 tempest-DeleteServersTestJSON-202698150-project-member] Lock "4b621ac2-857c-44be-9466-2f62165c3dfa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.340s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-49a36aff-b799-4aea-86fe-9691ab970a5d req-debf627c-8435-4bf6-8661-85cb6463dde4 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-69fc2f53-a06e-4792-9f4d-5044050ed607 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-49a36aff-b799-4aea-86fe-9691ab970a5d req-debf627c-8435-4bf6-8661-85cb6463dde4 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-49a36aff-b799-4aea-86fe-9691ab970a5d req-debf627c-8435-4bf6-8661-85cb6463dde4 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-49a36aff-b799-4aea-86fe-9691ab970a5d req-debf627c-8435-4bf6-8661-85cb6463dde4 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-49a36aff-b799-4aea-86fe-9691ab970a5d req-debf627c-8435-4bf6-8661-85cb6463dde4 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-69fc2f53-a06e-4792-9f4d-5044050ed607 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:26 user nova-compute[75021]: WARNING nova.compute.manager [req-49a36aff-b799-4aea-86fe-9691ab970a5d req-debf627c-8435-4bf6-8661-85cb6463dde4 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-69fc2f53-a06e-4792-9f4d-5044050ed607 for instance with vm_state building and task_state spawning.
Dec 06 07:01:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-5dac4fff-5d43-4b94-a748-40785459e716 req-44f3362f-512f-41a7-9c8f-6e7d8cb23083 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5dac4fff-5d43-4b94-a748-40785459e716 req-44f3362f-512f-41a7-9c8f-6e7d8cb23083 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5dac4fff-5d43-4b94-a748-40785459e716 req-44f3362f-512f-41a7-9c8f-6e7d8cb23083 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5dac4fff-5d43-4b94-a748-40785459e716 req-44f3362f-512f-41a7-9c8f-6e7d8cb23083 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-5dac4fff-5d43-4b94-a748-40785459e716 req-44f3362f-512f-41a7-9c8f-6e7d8cb23083 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:26 user nova-compute[75021]: WARNING nova.compute.manager [req-5dac4fff-5d43-4b94-a748-40785459e716 req-44f3362f-512f-41a7-9c8f-6e7d8cb23083 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e for instance with vm_state building and task_state spawning.
Dec 06 07:01:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-e5f34bc8-a303-49d1-9b9c-849695921cf2 req-1fb6e355-e1ca-4aa7-8385-39d0da317499 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-16f5b4cc-aef4-43c4-a87f-81993a0cdee9 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e5f34bc8-a303-49d1-9b9c-849695921cf2 req-1fb6e355-e1ca-4aa7-8385-39d0da317499 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e5f34bc8-a303-49d1-9b9c-849695921cf2 req-1fb6e355-e1ca-4aa7-8385-39d0da317499 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e5f34bc8-a303-49d1-9b9c-849695921cf2 req-1fb6e355-e1ca-4aa7-8385-39d0da317499 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-e5f34bc8-a303-49d1-9b9c-849695921cf2 req-1fb6e355-e1ca-4aa7-8385-39d0da317499 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-16f5b4cc-aef4-43c4-a87f-81993a0cdee9 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:26 user nova-compute[75021]: WARNING nova.compute.manager [req-e5f34bc8-a303-49d1-9b9c-849695921cf2 req-1fb6e355-e1ca-4aa7-8385-39d0da317499 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-16f5b4cc-aef4-43c4-a87f-81993a0cdee9 for instance with vm_state building and task_state spawning.
Dec 06 07:01:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG nova.objects.instance [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lazy-loading 'flavor' on Instance uuid 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:28 user nova-compute[75021]: INFO nova.compute.manager [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Attaching volume b2eda485-0c13-422b-8670-722844825575 to /dev/vdb
Dec 06 07:01:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-69fc2f53-a06e-4792-9f4d-5044050ed607 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-69fc2f53-a06e-4792-9f4d-5044050ed607 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:28 user nova-compute[75021]: WARNING nova.compute.manager [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-69fc2f53-a06e-4792-9f4d-5044050ed607 for instance with vm_state building and task_state spawning.
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-8b7ea8b6-978c-4760-b4eb-81ca2fe10caa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-8b7ea8b6-978c-4760-b4eb-81ca2fe10caa {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:28 user nova-compute[75021]: WARNING nova.compute.manager [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-8b7ea8b6-978c-4760-b4eb-81ca2fe10caa for instance with vm_state building and task_state spawning.
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-8b7ea8b6-978c-4760-b4eb-81ca2fe10caa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-8b7ea8b6-978c-4760-b4eb-81ca2fe10caa {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:28 user nova-compute[75021]: WARNING nova.compute.manager [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-8b7ea8b6-978c-4760-b4eb-81ca2fe10caa for instance with vm_state building and task_state spawning.
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-cfaeaf2a-91aa-405d-ab13-b3827d9165e3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-cfaeaf2a-91aa-405d-ab13-b3827d9165e3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:28 user nova-compute[75021]: WARNING nova.compute.manager [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-cfaeaf2a-91aa-405d-ab13-b3827d9165e3 for instance with vm_state building and task_state spawning.
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-cfaeaf2a-91aa-405d-ab13-b3827d9165e3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-cfaeaf2a-91aa-405d-ab13-b3827d9165e3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:28 user nova-compute[75021]: WARNING nova.compute.manager [req-014f0696-75b7-44da-90df-ed00d07764ab req-6eedb0fa-0140-4e94-ba98-a84c9fd38a98 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-cfaeaf2a-91aa-405d-ab13-b3827d9165e3 for instance with vm_state building and task_state spawning.
Dec 06 07:01:28 user nova-compute[75021]: DEBUG os_brick.utils [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35c48dd-2159-48c2-a238-997787c9e09d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[871c2020-3060-481a-9e53-672bc4371851]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4b15a2-427a-4c70-89e7-8ccd9c58bdaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1709452-dac3-4e88-9726-9527a405a305]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:01:28 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d835fa4d-4ff7-4fe3-8a06-70607ea5cf08]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG os_brick.utils [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Updating existing volume attachment record: ce714fe9-4288-4c66-9d81-73af0487bd31 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:28 user nova-compute[75021]: WARNING nova.compute.manager [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e for instance with vm_state building and task_state spawning.
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-90de25ad-46b1-410a-bfc6-81ad5873c4f0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-90de25ad-46b1-410a-bfc6-81ad5873c4f0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:28 user nova-compute[75021]: WARNING nova.compute.manager [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-90de25ad-46b1-410a-bfc6-81ad5873c4f0 for instance with vm_state building and task_state spawning.
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-90de25ad-46b1-410a-bfc6-81ad5873c4f0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-90de25ad-46b1-410a-bfc6-81ad5873c4f0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:28 user nova-compute[75021]: WARNING nova.compute.manager [req-687bd2de-9ae9-4e86-a2d5-8d178b3a3295 req-cefbbbd5-3948-4ae0-a5e6-0e8e28d6d063 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-90de25ad-46b1-410a-bfc6-81ad5873c4f0 for instance with vm_state building and task_state spawning.
Dec 06 07:01:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-16f5b4cc-aef4-43c4-a87f-81993a0cdee9 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-16f5b4cc-aef4-43c4-a87f-81993a0cdee9 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:28 user nova-compute[75021]: WARNING nova.compute.manager [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-16f5b4cc-aef4-43c4-a87f-81993a0cdee9 for instance with vm_state building and task_state spawning.
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-87be3bc7-3281-4732-8ba2-8a1d89d724fe {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-87be3bc7-3281-4732-8ba2-8a1d89d724fe {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:28 user nova-compute[75021]: WARNING nova.compute.manager [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-87be3bc7-3281-4732-8ba2-8a1d89d724fe for instance with vm_state building and task_state spawning.
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-87be3bc7-3281-4732-8ba2-8a1d89d724fe {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-87be3bc7-3281-4732-8ba2-8a1d89d724fe {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:28 user nova-compute[75021]: WARNING nova.compute.manager [req-30ccf78e-af8d-4cd7-8b75-b3df4620ea01 req-1cbd6203-b3c7-4f5e-83b2-d97e06820134 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-87be3bc7-3281-4732-8ba2-8a1d89d724fe for instance with vm_state building and task_state spawning.
Dec 06 07:01:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:01:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:01:30 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Instance spawned successfully.
Dec 06 07:01:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:01:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:01:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:01:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:01:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:01:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:01:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:01:30 user nova-compute[75021]: INFO nova.compute.manager [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Took 13.78 seconds to spawn the instance on the hypervisor.
Dec 06 07:01:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:01:30 user nova-compute[75021]: INFO nova.compute.manager [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Took 70.29 seconds to build instance.
Dec 06 07:01:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-05983d3b-c29b-4665-8fe0-1de2c06c93fe tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "ab907f07-df7b-4d56-baef-f2502b88b622" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 70.415s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:32 user nova-compute[75021]: DEBUG nova.compute.manager [req-faeffd9f-b3e8-4a6c-a7f8-ac3cef2f4137 req-fc025197-de9a-4991-a42b-915223dc5150 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received event network-changed-94173bea-6e40-4bcc-afe0-031fb7fde7fa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:32 user nova-compute[75021]: DEBUG nova.compute.manager [req-faeffd9f-b3e8-4a6c-a7f8-ac3cef2f4137 req-fc025197-de9a-4991-a42b-915223dc5150 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Refreshing instance network info cache due to event network-changed-94173bea-6e40-4bcc-afe0-031fb7fde7fa. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:01:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-faeffd9f-b3e8-4a6c-a7f8-ac3cef2f4137 req-fc025197-de9a-4991-a42b-915223dc5150 service nova] Acquiring lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:01:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-faeffd9f-b3e8-4a6c-a7f8-ac3cef2f4137 req-fc025197-de9a-4991-a42b-915223dc5150 service nova] Acquired lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:01:32 user nova-compute[75021]: DEBUG nova.network.neutron [req-faeffd9f-b3e8-4a6c-a7f8-ac3cef2f4137 req-fc025197-de9a-4991-a42b-915223dc5150 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Refreshing network info cache for port 94173bea-6e40-4bcc-afe0-031fb7fde7fa {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:01:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:32 user nova-compute[75021]: DEBUG nova.network.neutron [req-faeffd9f-b3e8-4a6c-a7f8-ac3cef2f4137 req-fc025197-de9a-4991-a42b-915223dc5150 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Updated VIF entry in instance network info cache for port 94173bea-6e40-4bcc-afe0-031fb7fde7fa. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:01:32 user nova-compute[75021]: DEBUG nova.network.neutron [req-faeffd9f-b3e8-4a6c-a7f8-ac3cef2f4137 req-fc025197-de9a-4991-a42b-915223dc5150 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Updating instance_info_cache with network_info: [{"id": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "address": "fa:16:3e:91:f2:66", "network": {"id": "ad977a07-4f22-4e25-a953-2c36fdc6aafd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-324709235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94173bea-6e", "ovs_interfaceid": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:01:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-faeffd9f-b3e8-4a6c-a7f8-ac3cef2f4137 req-fc025197-de9a-4991-a42b-915223dc5150 service nova] Releasing lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:01:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "interface-91eeb5a9-b6de-40c0-bc37-49768cc15c9c-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "interface-91eeb5a9-b6de-40c0-bc37-49768cc15c9c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:33 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lazy-loading 'flavor' on Instance uuid 91eeb5a9-b6de-40c0-bc37-49768cc15c9c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:33 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lazy-loading 'pci_requests' on Instance uuid 91eeb5a9-b6de-40c0-bc37-49768cc15c9c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:33 user nova-compute[75021]: DEBUG nova.objects.base [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Object Instance<91eeb5a9-b6de-40c0-bc37-49768cc15c9c> lazy-loaded attributes: flavor,pci_requests {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:01:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:01:33 user nova-compute[75021]: DEBUG nova.policy [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2de88a1aa57403e8c6614458998b059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6fd76416e04d298f16ae4dffbb2191', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:01:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Acquiring lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:33 user nova-compute[75021]: DEBUG nova.objects.instance [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Lazy-loading 'flavor' on Instance uuid 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Acquiring lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:34 user nova-compute[75021]: INFO nova.compute.manager [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Attaching volume a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 to /dev/vdb
Dec 06 07:01:34 user nova-compute[75021]: DEBUG os_brick.utils [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG nova.network.neutron [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Successfully created port: 0e389dcb-c0a8-47b6-997f-8af8932019e0 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42a40f9-ce26-43b7-ae62-d18b6e9cd3ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfed5ebd-eb3a-4b56-a327-fdaa246e8dad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[542b8b08-9b5b-4097-8e13-6eb0e096c460]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0df8494-59e8-4d13-8119-7055d044527c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:01:34 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de63d70-5fb5-43e5-8be9-6aa2d7e46591]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG os_brick.utils [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Updating existing volume attachment record: d818f4b1-d735-4db8-9864-4aa4104016e4 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-afbddd39-17bd-49f2-b13c-3268b03dd470 req-c52b5344-9f31-4838-b8ab-836511aea404 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Received event network-changed-a4942c0a-b7fd-467f-80e0-fc4f66261e12 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-afbddd39-17bd-49f2-b13c-3268b03dd470 req-c52b5344-9f31-4838-b8ab-836511aea404 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Refreshing instance network info cache due to event network-changed-a4942c0a-b7fd-467f-80e0-fc4f66261e12. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-afbddd39-17bd-49f2-b13c-3268b03dd470 req-c52b5344-9f31-4838-b8ab-836511aea404 service nova] Acquiring lock "refresh_cache-9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-afbddd39-17bd-49f2-b13c-3268b03dd470 req-c52b5344-9f31-4838-b8ab-836511aea404 service nova] Acquired lock "refresh_cache-9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-afbddd39-17bd-49f2-b13c-3268b03dd470 req-c52b5344-9f31-4838-b8ab-836511aea404 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Refreshing network info cache for port a4942c0a-b7fd-467f-80e0-fc4f66261e12 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG nova.network.neutron [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Successfully updated port: 0e389dcb-c0a8-47b6-997f-8af8932019e0 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquired lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG nova.network.neutron [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-7f53414c-6c96-415d-8248-96cd7a9f2817 req-3b285d8e-db02-4d09-9ac9-61435e9236f5 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received event network-changed-0e389dcb-c0a8-47b6-997f-8af8932019e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-7f53414c-6c96-415d-8248-96cd7a9f2817 req-3b285d8e-db02-4d09-9ac9-61435e9236f5 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Refreshing instance network info cache due to event network-changed-0e389dcb-c0a8-47b6-997f-8af8932019e0. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:01:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7f53414c-6c96-415d-8248-96cd7a9f2817 req-3b285d8e-db02-4d09-9ac9-61435e9236f5 service nova] Acquiring lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG nova.network.neutron [req-afbddd39-17bd-49f2-b13c-3268b03dd470 req-c52b5344-9f31-4838-b8ab-836511aea404 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Updated VIF entry in instance network info cache for port a4942c0a-b7fd-467f-80e0-fc4f66261e12. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG nova.network.neutron [req-afbddd39-17bd-49f2-b13c-3268b03dd470 req-c52b5344-9f31-4838-b8ab-836511aea404 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Updating instance_info_cache with network_info: [{"id": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "address": "fa:16:3e:eb:6e:d5", "network": {"id": "fe4e2805-4027-4464-b44a-98d002a04c2f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-103297198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6a7955718c44d79b908d650ea3bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4942c0a-b7", "ovs_interfaceid": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-afbddd39-17bd-49f2-b13c-3268b03dd470 req-c52b5344-9f31-4838-b8ab-836511aea404 service nova] Releasing lock "refresh_cache-9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG nova.network.neutron [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Updating instance_info_cache with network_info: [{"id": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "address": "fa:16:3e:91:f2:66", "network": {"id": "ad977a07-4f22-4e25-a953-2c36fdc6aafd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-324709235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94173bea-6e", "ovs_interfaceid": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "address": "fa:16:3e:6a:99:11", "network": {"id": "b25b1d3d-788d-4093-9933-d13031e93c63", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-721588809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e389dcb-c0", "ovs_interfaceid": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Releasing lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7f53414c-6c96-415d-8248-96cd7a9f2817 req-3b285d8e-db02-4d09-9ac9-61435e9236f5 service nova] Acquired lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG nova.network.neutron [req-7f53414c-6c96-415d-8248-96cd7a9f2817 req-3b285d8e-db02-4d09-9ac9-61435e9236f5 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Refreshing network info cache for port 0e389dcb-c0a8-47b6-997f-8af8932019e0 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T06:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9053064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9053064',id=8,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfxPXtIc47E18m6Z4qikWqTz2rTTY3bjnRhlRvdXGj9tpXYrXf76otmdZT3oE+W47oRVEPxUwhFLz0Caec3zbc1/KigN/WcfjgJ+3ELWkAH6KQ8DaAIyV9KAyPj8VZgwQ==',key_name='tempest-keypair-399869130',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb6fd76416e04d298f16ae4dffbb2191',ramdisk_id='',reservation_id='r-21w39m30',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1423166060',owner_user_name='tempest-TaggedAttachmentsTest-1423166060-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T06:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2de88a1aa57403e8c6614458998b059',uuid=91eeb5a9-b6de-40c0-bc37-49768cc15c9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "address": "fa:16:3e:6a:99:11", "network": {"id": "b25b1d3d-788d-4093-9933-d13031e93c63", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-721588809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e389dcb-c0", "ovs_interfaceid": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Converting VIF {"id": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "address": "fa:16:3e:6a:99:11", "network": {"id": "b25b1d3d-788d-4093-9933-d13031e93c63", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-721588809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e389dcb-c0", "ovs_interfaceid": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:99:11,bridge_name='br-int',has_traffic_filtering=True,id=0e389dcb-c0a8-47b6-997f-8af8932019e0,network=Network(b25b1d3d-788d-4093-9933-d13031e93c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e389dcb-c0') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG os_vif [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:99:11,bridge_name='br-int',has_traffic_filtering=True,id=0e389dcb-c0a8-47b6-997f-8af8932019e0,network=Network(b25b1d3d-788d-4093-9933-d13031e93c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e389dcb-c0') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9c22d30-c121-5b4a-ad10-a1e8beb98544', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e389dcb-c0, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e389dcb-c0, col_values=(('qos', UUID('93ecf498-d226-4e24-b329-57ef77d582d9')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e389dcb-c0, col_values=(('external_ids', {'iface-id': '0e389dcb-c0a8-47b6-997f-8af8932019e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:99:11', 'vm-uuid': '91eeb5a9-b6de-40c0-bc37-49768cc15c9c'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:35 user nova-compute[75021]: INFO os_vif [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:99:11,bridge_name='br-int',has_traffic_filtering=True,id=0e389dcb-c0a8-47b6-997f-8af8932019e0,network=Network(b25b1d3d-788d-4093-9933-d13031e93c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e389dcb-c0')
Dec 06 07:01:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T06:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9053064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9053064',id=8,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfxPXtIc47E18m6Z4qikWqTz2rTTY3bjnRhlRvdXGj9tpXYrXf76otmdZT3oE+W47oRVEPxUwhFLz0Caec3zbc1/KigN/WcfjgJ+3ELWkAH6KQ8DaAIyV9KAyPj8VZgwQ==',key_name='tempest-keypair-399869130',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eb6fd76416e04d298f16ae4dffbb2191',ramdisk_id='',reservation_id='r-21w39m30',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1423166060',owner_user_name='tempest-TaggedAttachmentsTest-1423166060-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T06:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2de88a1aa57403e8c6614458998b059',uuid=91eeb5a9-b6de-40c0-bc37-49768cc15c9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "address": "fa:16:3e:6a:99:11", "network": {"id": "b25b1d3d-788d-4093-9933-d13031e93c63", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-721588809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e389dcb-c0", "ovs_interfaceid": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Converting VIF {"id": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "address": "fa:16:3e:6a:99:11", "network": {"id": "b25b1d3d-788d-4093-9933-d13031e93c63", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-721588809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e389dcb-c0", "ovs_interfaceid": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:99:11,bridge_name='br-int',has_traffic_filtering=True,id=0e389dcb-c0a8-47b6-997f-8af8932019e0,network=Network(b25b1d3d-788d-4093-9933-d13031e93c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e389dcb-c0') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] attach device xml: <interface type="ethernet">
Dec 06 07:01:35 user nova-compute[75021]:   <mac address="fa:16:3e:6a:99:11"/>
Dec 06 07:01:35 user nova-compute[75021]:   <model type="virtio"/>
Dec 06 07:01:35 user nova-compute[75021]:   <mtu size="1442"/>
Dec 06 07:01:35 user nova-compute[75021]:   <target dev="tap0e389dcb-c0"/>
Dec 06 07:01:35 user nova-compute[75021]: </interface>
Dec 06 07:01:35 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:01:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] No BDM found with device name hda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] No VIF found with MAC fa:16:3e:91:f2:66, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:01:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:01:36 user nova-compute[75021]:   <nova:package version="0.0.0"/>
Dec 06 07:01:36 user nova-compute[75021]:   <nova:name>tempest-device-tagging-server-9053064</nova:name>
Dec 06 07:01:36 user nova-compute[75021]:   <nova:creationTime>2023-12-06 07:01:36</nova:creationTime>
Dec 06 07:01:36 user nova-compute[75021]:   <nova:flavor name="m1.tiny">
Dec 06 07:01:36 user nova-compute[75021]:     <nova:memory>512</nova:memory>
Dec 06 07:01:36 user nova-compute[75021]:     <nova:disk>1</nova:disk>
Dec 06 07:01:36 user nova-compute[75021]:     <nova:swap>0</nova:swap>
Dec 06 07:01:36 user nova-compute[75021]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:01:36 user nova-compute[75021]:     <nova:vcpus>1</nova:vcpus>
Dec 06 07:01:36 user nova-compute[75021]:   </nova:flavor>
Dec 06 07:01:36 user nova-compute[75021]:   <nova:owner>
Dec 06 07:01:36 user nova-compute[75021]:     <nova:user uuid="f2de88a1aa57403e8c6614458998b059">tempest-TaggedAttachmentsTest-1423166060-project-member</nova:user>
Dec 06 07:01:36 user nova-compute[75021]:     <nova:project uuid="eb6fd76416e04d298f16ae4dffbb2191">tempest-TaggedAttachmentsTest-1423166060</nova:project>
Dec 06 07:01:36 user nova-compute[75021]:   </nova:owner>
Dec 06 07:01:36 user nova-compute[75021]:   <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:01:36 user nova-compute[75021]:   <nova:ports>
Dec 06 07:01:36 user nova-compute[75021]:     <nova:port uuid="94173bea-6e40-4bcc-afe0-031fb7fde7fa">
Dec 06 07:01:36 user nova-compute[75021]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 07:01:36 user nova-compute[75021]:     </nova:port>
Dec 06 07:01:36 user nova-compute[75021]:     <nova:port uuid="0e389dcb-c0a8-47b6-997f-8af8932019e0">
Dec 06 07:01:36 user nova-compute[75021]:       <nova:ip type="fixed" address="10.10.10.117" ipVersion="4"/>
Dec 06 07:01:36 user nova-compute[75021]:     </nova:port>
Dec 06 07:01:36 user nova-compute[75021]:   </nova:ports>
Dec 06 07:01:36 user nova-compute[75021]: </nova:instance>
Dec 06 07:01:36 user nova-compute[75021]:  {{(pid=75021) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 06 07:01:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fe3252e0-58a8-4735-bf96-b006de3037d7 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "interface-91eeb5a9-b6de-40c0-bc37-49768cc15c9c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.259s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:36 user nova-compute[75021]: DEBUG nova.network.neutron [req-7f53414c-6c96-415d-8248-96cd7a9f2817 req-3b285d8e-db02-4d09-9ac9-61435e9236f5 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Updated VIF entry in instance network info cache for port 0e389dcb-c0a8-47b6-997f-8af8932019e0. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:01:36 user nova-compute[75021]: DEBUG nova.network.neutron [req-7f53414c-6c96-415d-8248-96cd7a9f2817 req-3b285d8e-db02-4d09-9ac9-61435e9236f5 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Updating instance_info_cache with network_info: [{"id": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "address": "fa:16:3e:91:f2:66", "network": {"id": "ad977a07-4f22-4e25-a953-2c36fdc6aafd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-324709235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94173bea-6e", "ovs_interfaceid": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "address": "fa:16:3e:6a:99:11", "network": {"id": "b25b1d3d-788d-4093-9933-d13031e93c63", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-721588809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e389dcb-c0", "ovs_interfaceid": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:01:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7f53414c-6c96-415d-8248-96cd7a9f2817 req-3b285d8e-db02-4d09-9ac9-61435e9236f5 service nova] Releasing lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:01:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-b5fd5644-6e9b-47d3-b991-7abd95404ee0 req-c82c9cd3-a0d5-42c1-a7c1-eaa8bc0197e1 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received event network-vif-plugged-0e389dcb-c0a8-47b6-997f-8af8932019e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b5fd5644-6e9b-47d3-b991-7abd95404ee0 req-c82c9cd3-a0d5-42c1-a7c1-eaa8bc0197e1 service nova] Acquiring lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b5fd5644-6e9b-47d3-b991-7abd95404ee0 req-c82c9cd3-a0d5-42c1-a7c1-eaa8bc0197e1 service nova] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b5fd5644-6e9b-47d3-b991-7abd95404ee0 req-c82c9cd3-a0d5-42c1-a7c1-eaa8bc0197e1 service nova] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-b5fd5644-6e9b-47d3-b991-7abd95404ee0 req-c82c9cd3-a0d5-42c1-a7c1-eaa8bc0197e1 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] No waiting events found dispatching network-vif-plugged-0e389dcb-c0a8-47b6-997f-8af8932019e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:37 user nova-compute[75021]: WARNING nova.compute.manager [req-b5fd5644-6e9b-47d3-b991-7abd95404ee0 req-c82c9cd3-a0d5-42c1-a7c1-eaa8bc0197e1 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received unexpected event network-vif-plugged-0e389dcb-c0a8-47b6-997f-8af8932019e0 for instance with vm_state active and task_state None.
Dec 06 07:01:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-b5fd5644-6e9b-47d3-b991-7abd95404ee0 req-c82c9cd3-a0d5-42c1-a7c1-eaa8bc0197e1 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received event network-vif-plugged-0e389dcb-c0a8-47b6-997f-8af8932019e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b5fd5644-6e9b-47d3-b991-7abd95404ee0 req-c82c9cd3-a0d5-42c1-a7c1-eaa8bc0197e1 service nova] Acquiring lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b5fd5644-6e9b-47d3-b991-7abd95404ee0 req-c82c9cd3-a0d5-42c1-a7c1-eaa8bc0197e1 service nova] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b5fd5644-6e9b-47d3-b991-7abd95404ee0 req-c82c9cd3-a0d5-42c1-a7c1-eaa8bc0197e1 service nova] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-b5fd5644-6e9b-47d3-b991-7abd95404ee0 req-c82c9cd3-a0d5-42c1-a7c1-eaa8bc0197e1 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] No waiting events found dispatching network-vif-plugged-0e389dcb-c0a8-47b6-997f-8af8932019e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:37 user nova-compute[75021]: WARNING nova.compute.manager [req-b5fd5644-6e9b-47d3-b991-7abd95404ee0 req-c82c9cd3-a0d5-42c1-a7c1-eaa8bc0197e1 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received unexpected event network-vif-plugged-0e389dcb-c0a8-47b6-997f-8af8932019e0 for instance with vm_state active and task_state None.
Dec 06 07:01:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhWEyASf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:39 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:39 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:39 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e0a615-cf33-40d3-97c7-e9b511c01168]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:01:39 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1f0667-a76d-4e49-a9c2-02ebeed102a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575] added
Dec 06 07:01:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b24e01-ff8b-4fb1-8319-50a396ceb9f2]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[172be66d-b861-4784-a254-39bf0d82850d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhWEyASf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhWEyASf" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67b97f2-e2c5-4b35-ac42-8ae01f2050eb]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xhWEyASf'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0db065-d89e-4fe4-aa15-d65f5f995d38]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73e4b73-77a1-4ea6-bd70-4e719539ea35]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:39 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:39 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:39 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:39 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:39 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:39 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG nova.objects.instance [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lazy-loading 'flavor' on Instance uuid 91eeb5a9-b6de-40c0-bc37-49768cc15c9c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[587d4980-7e7e-466d-9c4e-a8b0900fab5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575, portal: 172.16.0.220,3260]
Dec 06 07:01:39 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575, portal: 172.16.0.220,3260] successful.
Dec 06 07:01:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efbb0ac-9ca2-47b2-800d-a6dfeadda4fb]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[febe81e5-c436-4938-932c-8f97e29697ed]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:39 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:39 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:39 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:39 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:39 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:39 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:39 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:39 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] HCTL ('35', '-', '-', 0) found on session 7 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:01:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ce2ec6-f5ff-4e64-ad3c-d8fa4abcec8c]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Searching for a device in session 7 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhWEyASf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:40 user nova-compute[75021]: INFO nova.compute.manager [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Attaching volume ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 to /dev/vdb
Dec 06 07:01:40 user nova-compute[75021]: DEBUG os_brick.utils [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[521681b5-8464-46c6-ac51-bd28719114a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa09946-ca84-45ec-962e-c03216fa9e7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[42540ec6-16ed-429d-9b0b-782716d3a1eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf0ce4a-6d5d-48e3-a8d9-1bdad1568bc8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:01:40 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:01:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60db848-c521-4895-a285-d19518b2a241]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG os_brick.utils [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Updating existing volume attachment record: 4c03cebb-688f-4aea-b808-b6240c6125c4 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23861316463353063', 'path': '/dev/sdd'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861316463353063', 'path': '/dev/sdd'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:01:41 user nova-compute[75021]: DEBUG nova.objects.instance [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lazy-loading 'flavor' on Instance uuid 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:01:41 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:41 user nova-compute[75021]:   <source dev="/dev/sdd"/>
Dec 06 07:01:41 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:01:41 user nova-compute[75021]:   <serial>b2eda485-0c13-422b-8670-722844825575</serial>
Dec 06 07:01:41 user nova-compute[75021]: </disk>
Dec 06 07:01:41 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:01:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] No VIF found with MAC fa:16:3e:5f:22:74, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:01:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:01:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGuNZxMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:44 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:44 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:44 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:01:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9bc5bd-dee2-4092-8c0b-01cb4b8f7686]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:01:44 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98de1b7-666a-40f5-8eab-4c944a14dcf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7] added
Dec 06 07:01:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2431db70-e864-4ce0-bc3d-f4ce41100203]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef3fd91-45b0-44bf-a772-97319b9645a9]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGuNZxMH {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGuNZxMH" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e8c80b-e77b-41e5-9a94-55367dcb8c60]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tGuNZxMH'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b625e00d-53de-4c7b-8380-cbf49459b1fe]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[65156392-3f61-46b0-beb2-8fa372dc5aaa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b65855-4201-424e-9b25-264a17d8e7c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7, portal: 172.16.0.220,3260]
Dec 06 07:01:45 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7, portal: 172.16.0.220,3260] successful.
Dec 06 07:01:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2452efc3-4b17-4023-bb2d-465eefbd80ee]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f3b0201b-9942-488b-afe4-2ae07200a7f4 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.098s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c95e48-555d-47bb-8c4f-b64f909be1ba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:01:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[37786954-fa3c-4738-90c6-38e23954567b]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGuNZxMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amchovrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:45 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23862656430623635', 'path': '/dev/sdg'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862656430623635', 'path': '/dev/sdg'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.414s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:46 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:46 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG nova.objects.instance [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Lazy-loading 'flavor' on Instance uuid 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff8a376-8505-424a-8124-227fa2bb8288]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:01:46 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc336e9-c729-4a92-a570-99e8be912bad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea] added
Dec 06 07:01:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a53050-352d-4799-ac39-fd9e1c9059b9]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] attach device xml: <disk type="block" device="disk">
Dec 06 07:01:46 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:46 user nova-compute[75021]:   <source dev="/dev/sdg"/>
Dec 06 07:01:46 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:01:46 user nova-compute[75021]:   <serial>a3975c5f-033a-47e8-8554-4b3bd1e1d8c7</serial>
Dec 06 07:01:46 user nova-compute[75021]: </disk>
Dec 06 07:01:46 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7e440e-ca75-4abe-aadb-1ae9946393c2]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amchovrQ {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amchovrQ" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[590b26d0-81f4-4ee6-b218-d070d689dd4a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'amchovrQ'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f264bc0a-1926-43d0-8c5d-3cd219a824ef]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dc2f2d-8252-4ae1-b206-9947cfc94867]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9c9249-623a-4820-bdaa-75e16949deae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea, portal: 172.16.0.220,3260]
Dec 06 07:01:46 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea, portal: 172.16.0.220,3260] successful.
Dec 06 07:01:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcac922-7931-4e04-b3ec-0f691cb55f08]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc6d66e-044a-4bf6-8dc1-ba6b6974b939]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:01:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:01:46 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:01:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[362e4f5b-6809-4c4a-88a3-0f805c74722e]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amchovrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] No VIF found with MAC fa:16:3e:eb:6e:d5, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:46 user nova-compute[75021]: INFO nova.compute.manager [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Detaching volume b2eda485-0c13-422b-8670-722844825575
Dec 06 07:01:47 user nova-compute[75021]: INFO nova.virt.block_device [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Attempting to driver detach volume b2eda485-0c13-422b-8670-722844825575 from mountpoint /dev/vdb
Dec 06 07:01:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Attempting to detach device vdb from instance 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:01:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:01:47 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:47 user nova-compute[75021]:   <source dev="/dev/sdd"/>
Dec 06 07:01:47 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:01:47 user nova-compute[75021]:   <serial>b2eda485-0c13-422b-8670-722844825575</serial>
Dec 06 07:01:47 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:01:47 user nova-compute[75021]: </disk>
Dec 06 07:01:47 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:01:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-22a558b7-ee08-4d3d-bdab-96075c350a1c tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.929s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:47 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Successfully detached device vdb from instance 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a from the persistent domain config.
Dec 06 07:01:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:01:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:01:47 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:47 user nova-compute[75021]:   <source dev="/dev/sdd"/>
Dec 06 07:01:47 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:01:47 user nova-compute[75021]:   <serial>b2eda485-0c13-422b-8670-722844825575</serial>
Dec 06 07:01:47 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:01:47 user nova-compute[75021]: </disk>
Dec 06 07:01:47 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:01:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:01:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-828c3192-a687-4c33-bf5b-aaf9eac6ab02 tempest-VolumesAssistedSnapshotsTest-1943862712 tempest-VolumesAssistedSnapshotsTest-1943862712-project] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] volume_snapshot_create: create_info: {'snapshot_id': 'e49930dc-9759-44bf-b265-faad24db49a8', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75021) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3572}}
Dec 06 07:01:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-828c3192-a687-4c33-bf5b-aaf9eac6ab02 tempest-VolumesAssistedSnapshotsTest-1943862712 tempest-VolumesAssistedSnapshotsTest-1943862712-project] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] snap xml: <domainsnapshot>
Dec 06 07:01:47 user nova-compute[75021]:   <disks>
Dec 06 07:01:47 user nova-compute[75021]:     <disk name="/dev/sdg" snapshot="external" type="file">
Dec 06 07:01:47 user nova-compute[75021]:       <source file="/dev/new_file"/>
Dec 06 07:01:47 user nova-compute[75021]:     </disk>
Dec 06 07:01:47 user nova-compute[75021]:     <disk name="vda" snapshot="no"/>
Dec 06 07:01:47 user nova-compute[75021]:   </disks>
Dec 06 07:01:47 user nova-compute[75021]: </domainsnapshot>
Dec 06 07:01:47 user nova-compute[75021]:  {{(pid=75021) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3513}}
Dec 06 07:01:47 user nova-compute[75021]: DEBUG nova.objects.instance [None req-828c3192-a687-4c33-bf5b-aaf9eac6ab02 tempest-VolumesAssistedSnapshotsTest-1943862712 tempest-VolumesAssistedSnapshotsTest-1943862712-project] Lazy-loading 'system_metadata' on Instance uuid 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] <== connect_volume: return (1864ms) {'type': 'block', 'scsi_wwn': '23835396264363631', 'path': '/dev/sdh'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835396264363631', 'path': '/dev/sdh'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:01:47 user nova-compute[75021]: DEBUG nova.objects.instance [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lazy-loading 'flavor' on Instance uuid b11b4d87-8700-4c0b-9c2c-aac8162def21 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:47 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-828c3192-a687-4c33-bf5b-aaf9eac6ab02 tempest-VolumesAssistedSnapshotsTest-1943862712 tempest-VolumesAssistedSnapshotsTest-1943862712-project] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [None req-828c3192-a687-4c33-bf5b-aaf9eac6ab02 tempest-VolumesAssistedSnapshotsTest-1943862712 tempest-VolumesAssistedSnapshotsTest-1943862712-project] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Traceback (most recent call last):
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     rv = execute(f, *args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     six.reraise(c, e, tb)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     raise value
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     rv = meth(*args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] 
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [None req-828c3192-a687-4c33-bf5b-aaf9eac6ab02 tempest-VolumesAssistedSnapshotsTest-1943862712 tempest-VolumesAssistedSnapshotsTest-1943862712-project] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Traceback (most recent call last):
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     self._volume_snapshot_create(context, instance, guest,
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     rv = execute(f, *args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     six.reraise(c, e, tb)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     raise value
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     rv = meth(*args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] 
Dec 06 07:01:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-23986e93-e1c4-42fd-9c09-d85294f9da5a tempest-VolumesAssistedSnapshotsTest-1943862712 tempest-VolumesAssistedSnapshotsTest-1943862712-project] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] volume_snapshot_delete: delete_info: {'volume_id': 'a3975c5f-033a-47e8-8554-4b3bd1e1d8c7'} {{(pid=75021) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3673}}
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [None req-23986e93-e1c4-42fd-9c09-d85294f9da5a tempest-VolumesAssistedSnapshotsTest-1943862712 tempest-VolumesAssistedSnapshotsTest-1943862712-project] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Traceback (most recent call last):
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     self._volume_snapshot_delete(context, instance, volume_id,
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0]     if delete_info['type'] != 'qcow2':
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] KeyError: 'type'
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] 
Dec 06 07:01:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:01:47 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:47 user nova-compute[75021]:   <source dev="/dev/sdh"/>
Dec 06 07:01:47 user nova-compute[75021]:   <target dev="sdc" bus="scsi"/>
Dec 06 07:01:47 user nova-compute[75021]:   <serial>f90ea2b4-fbec-42bf-a3b7-a0890c227dea</serial>
Dec 06 07:01:47 user nova-compute[75021]:   <address type="drive" controller="0" unit="2"/>
Dec 06 07:01:47 user nova-compute[75021]: </disk>
Dec 06 07:01:47 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:01:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [None req-828c3192-a687-4c33-bf5b-aaf9eac6ab02 tempest-VolumesAssistedSnapshotsTest-1943862712 tempest-VolumesAssistedSnapshotsTest-1943862712-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot e49930dc-9759-44bf-b265-faad24db49a8 could not be found.
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     raise value
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver 
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver 
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot e49930dc-9759-44bf-b265-faad24db49a8 could not be found. (HTTP 404) (Request-ID: req-3b577017-085f-4ea0-b2ee-ade991f4b7a3)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver 
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver 
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot e49930dc-9759-44bf-b265-faad24db49a8 could not be found.
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver 
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver [None req-23986e93-e1c4-42fd-9c09-d85294f9da5a tempest-VolumesAssistedSnapshotsTest-1943862712 tempest-VolumesAssistedSnapshotsTest-1943862712-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver 
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver 
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-9137bd46-626a-4d75-a518-bc04697a809d)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver 
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver 
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 06 07:01:47 user nova-compute[75021]: ERROR nova.virt.libvirt.driver 
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server [None req-828c3192-a687-4c33-bf5b-aaf9eac6ab02 tempest-VolumesAssistedSnapshotsTest-1943862712 tempest-VolumesAssistedSnapshotsTest-1943862712-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3593, in volume_snapshot_create
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     raise value
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server 
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server [None req-23986e93-e1c4-42fd-9c09-d85294f9da5a tempest-VolumesAssistedSnapshotsTest-1943862712 tempest-VolumesAssistedSnapshotsTest-1943862712-project] Exception during message handling: KeyError: 'type'
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3849, in volume_snapshot_delete
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Dec 06 07:01:47 user nova-compute[75021]: ERROR oslo_messaging.rpc.server 
Dec 06 07:01:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Acquiring lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:48 user nova-compute[75021]: INFO nova.compute.manager [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Detaching volume a3975c5f-033a-47e8-8554-4b3bd1e1d8c7
Dec 06 07:01:48 user nova-compute[75021]: INFO nova.virt.block_device [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Attempting to driver detach volume a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 from mountpoint /dev/vdb
Dec 06 07:01:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] No BDM found with device name sda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] No VIF found with MAC fa:16:3e:19:71:a3, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:01:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Attempting to detach device vdb from instance 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:01:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] detach device xml: <disk type="block" device="disk">
Dec 06 07:01:48 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:48 user nova-compute[75021]:   <source dev="/dev/sdg"/>
Dec 06 07:01:48 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:01:48 user nova-compute[75021]:   <serial>a3975c5f-033a-47e8-8554-4b3bd1e1d8c7</serial>
Dec 06 07:01:48 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:01:48 user nova-compute[75021]: </disk>
Dec 06 07:01:48 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:01:48 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Successfully detached device vdb from instance 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 from the persistent domain config.
Dec 06 07:01:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:01:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] detach device xml: <disk type="block" device="disk">
Dec 06 07:01:48 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:48 user nova-compute[75021]:   <source dev="/dev/sdg"/>
Dec 06 07:01:48 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:01:48 user nova-compute[75021]:   <serial>a3975c5f-033a-47e8-8554-4b3bd1e1d8c7</serial>
Dec 06 07:01:48 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:01:48 user nova-compute[75021]: </disk>
Dec 06 07:01:48 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:01:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2227985e-358a-490c-a805-2e4d6df74ffc tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.980s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:01:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-b674f50e-324a-4fd2-9698-c9c0dbd4941a req-36f45d40-3c09-41e6-b079-2a1a904d2b77 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received event network-changed-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-b674f50e-324a-4fd2-9698-c9c0dbd4941a req-36f45d40-3c09-41e6-b079-2a1a904d2b77 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Refreshing instance network info cache due to event network-changed-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:01:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b674f50e-324a-4fd2-9698-c9c0dbd4941a req-36f45d40-3c09-41e6-b079-2a1a904d2b77 service nova] Acquiring lock "refresh_cache-d5cd8c5d-acc4-44b8-b240-58f8fea899ec" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:01:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b674f50e-324a-4fd2-9698-c9c0dbd4941a req-36f45d40-3c09-41e6-b079-2a1a904d2b77 service nova] Acquired lock "refresh_cache-d5cd8c5d-acc4-44b8-b240-58f8fea899ec" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:01:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-b674f50e-324a-4fd2-9698-c9c0dbd4941a req-36f45d40-3c09-41e6-b079-2a1a904d2b77 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Refreshing network info cache for port 15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:01:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "b11b4d87-8700-4c0b-9c2c-aac8162def21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:50 user nova-compute[75021]: INFO nova.compute.manager [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Detaching volume f90ea2b4-fbec-42bf-a3b7-a0890c227dea
Dec 06 07:01:50 user nova-compute[75021]: INFO nova.virt.block_device [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Attempting to driver detach volume f90ea2b4-fbec-42bf-a3b7-a0890c227dea from mountpoint /dev/sdc
Dec 06 07:01:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Attempting to detach device sdc from instance b11b4d87-8700-4c0b-9c2c-aac8162def21 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:01:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:01:50 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:50 user nova-compute[75021]:   <source dev="/dev/sdh"/>
Dec 06 07:01:50 user nova-compute[75021]:   <target dev="sdc" bus="scsi"/>
Dec 06 07:01:50 user nova-compute[75021]:   <serial>f90ea2b4-fbec-42bf-a3b7-a0890c227dea</serial>
Dec 06 07:01:50 user nova-compute[75021]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 06 07:01:50 user nova-compute[75021]: </disk>
Dec 06 07:01:50 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:01:50 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Successfully detached device sdc from instance b11b4d87-8700-4c0b-9c2c-aac8162def21 from the persistent domain config.
Dec 06 07:01:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance b11b4d87-8700-4c0b-9c2c-aac8162def21 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:01:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:01:50 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:50 user nova-compute[75021]:   <source dev="/dev/sdh"/>
Dec 06 07:01:50 user nova-compute[75021]:   <target dev="sdc" bus="scsi"/>
Dec 06 07:01:50 user nova-compute[75021]:   <serial>f90ea2b4-fbec-42bf-a3b7-a0890c227dea</serial>
Dec 06 07:01:50 user nova-compute[75021]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 06 07:01:50 user nova-compute[75021]: </disk>
Dec 06 07:01:50 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:01:50 user nova-compute[75021]: DEBUG nova.network.neutron [req-b674f50e-324a-4fd2-9698-c9c0dbd4941a req-36f45d40-3c09-41e6-b079-2a1a904d2b77 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Updated VIF entry in instance network info cache for port 15d5a156-55aa-4946-9ca4-7bb6cc1a07a0. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:01:50 user nova-compute[75021]: DEBUG nova.network.neutron [req-b674f50e-324a-4fd2-9698-c9c0dbd4941a req-36f45d40-3c09-41e6-b079-2a1a904d2b77 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Updating instance_info_cache with network_info: [{"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:01:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b674f50e-324a-4fd2-9698-c9c0dbd4941a req-36f45d40-3c09-41e6-b079-2a1a904d2b77 service nova] Releasing lock "refresh_cache-d5cd8c5d-acc4-44b8-b240-58f8fea899ec" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:01:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance b11b4d87-8700-4c0b-9c2c-aac8162def21 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:01:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:50 user nova-compute[75021]: INFO nova.compute.manager [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Rebuilding instance
Dec 06 07:01:51 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-c222ba9b-298c-4cf0-b345-70684f5c34f3 req-c281ccb0-88dc-435f-89ec-9f7fffff8b33 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received event network-vif-unplugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c222ba9b-298c-4cf0-b345-70684f5c34f3 req-c281ccb0-88dc-435f-89ec-9f7fffff8b33 service nova] Acquiring lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c222ba9b-298c-4cf0-b345-70684f5c34f3 req-c281ccb0-88dc-435f-89ec-9f7fffff8b33 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c222ba9b-298c-4cf0-b345-70684f5c34f3 req-c281ccb0-88dc-435f-89ec-9f7fffff8b33 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-c222ba9b-298c-4cf0-b345-70684f5c34f3 req-c281ccb0-88dc-435f-89ec-9f7fffff8b33 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] No waiting events found dispatching network-vif-unplugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:01:51 user nova-compute[75021]: WARNING nova.compute.manager [req-c222ba9b-298c-4cf0-b345-70684f5c34f3 req-c281ccb0-88dc-435f-89ec-9f7fffff8b33 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received unexpected event network-vif-unplugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 for instance with vm_state active and task_state rebuilding.
Dec 06 07:01:51 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Instance destroyed successfully.
Dec 06 07:01:51 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Instance destroyed successfully.
Dec 06 07:01:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1888906845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1814435056',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiXiD74QqzfgkFXGjJOZvAqeUVo+mq15hHQ8QIS/Wj/WBUADk0S9ETtuL5LG29w5xqYMy6zRLAJsgjvd9bu5CBLpGA3OWWGNin8u/kh+TSTPSCT1+3h0wrNEHGduvVlPw==',key_name='tempest-keypair-139423592',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:00:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71465ef2851b453393044740cb4703a8',ramdisk_id='',reservation_id='r-d3iwgob5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-888472527',owner_user_name='tempest-ServerActionsV293TestJSON-888472527-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:01:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c13c9f93326641e09f763a42c76449f9',uuid=d5cd8c5d-acc4-44b8-b240-58f8fea899ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Converting VIF {"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4e:65,bridge_name='br-int',has_traffic_filtering=True,id=15d5a156-55aa-4946-9ca4-7bb6cc1a07a0,network=Network(48eb6005-fd57-4d35-a701-ac7bed58807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d5a156-55') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG os_vif [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4e:65,bridge_name='br-int',has_traffic_filtering=True,id=15d5a156-55aa-4946-9ca4-7bb6cc1a07a0,network=Network(48eb6005-fd57-4d35-a701-ac7bed58807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d5a156-55') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15d5a156-55, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df1cfa25-0d73-46a9-a305-1dd47b8ded32) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:01:51 user nova-compute[75021]: INFO os_vif [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4e:65,bridge_name='br-int',has_traffic_filtering=True,id=15d5a156-55aa-4946-9ca4-7bb6cc1a07a0,network=Network(48eb6005-fd57-4d35-a701-ac7bed58807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d5a156-55')
Dec 06 07:01:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKNuoOHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:51 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 07:01:51 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb83a76b-af5d-4db9-9481-427631b37055]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:01:51 user nova-compute[75021]: No targets found.
Dec 06 07:01:51 user nova-compute[75021]: iSNS:
Dec 06 07:01:51 user nova-compute[75021]: No targets found.
Dec 06 07:01:51 user nova-compute[75021]: STATIC:
Dec 06 07:01:51 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7
Dec 06 07:01:51 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:51 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:51 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5
Dec 06 07:01:51 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:51 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:51 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3
Dec 06 07:01:51 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:51 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:51 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d
Dec 06 07:01:51 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:51 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:51 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575
Dec 06 07:01:51 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:51 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:51 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea
Dec 06 07:01:51 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:51 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:51 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794
Dec 06 07:01:51 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:51 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:51 user nova-compute[75021]: FIRMWARE:
Dec 06 07:01:51 user nova-compute[75021]: No targets found.
Dec 06 07:01:51 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:01:51 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:01:51 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[050906e6-7f45-4d76-b1cf-91c412e4c64c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[98987a08-5a8b-4a39-ad79-704691458505]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:01:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:01:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b4767eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9737b239-0040-474c-8ad8-20df4523e937]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3c198c-d4a6-44c4-991c-d05b9f90d453]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bfd192-22cb-478d-85c1-b16a110239b8]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1340f9-ac4a-41d1-911d-3a188447fbc8]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9a853dd8-03d759de40a35fa9', '/dev/disk/by-id/scsi-23033643735396465', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9a853dd8') {{(pid=86148) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc9589f-782d-4cca-8bc4-8007d89028e4]: (4, None) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68be11c-9581-491a-af60-2d532c4ef8ae]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf2a9c9-62a3-44b4-879e-c5254cd8067f]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260]
Dec 06 07:01:52 user nova-compute[75021]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260] successful.
Dec 06 07:01:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b088a8f0-8cf9-4f0f-9ebc-631c641f69ae]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] <== disconnect_volume: return (372ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:01:52 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Deleting instance files /opt/stack/data/nova/instances/d5cd8c5d-acc4-44b8-b240-58f8fea899ec_del
Dec 06 07:01:52 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Deletion of /opt/stack/data/nova/instances/d5cd8c5d-acc4-44b8-b240-58f8fea899ec_del complete
Dec 06 07:01:52 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance d5cd8c5d-acc4-44b8-b240-58f8fea899ec could not be found.
Dec 06 07:01:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKNuoOHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:52 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjhoLzny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:01:52 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45ed753-84ea-4924-8155-75fb49ff0c42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:01:52 user nova-compute[75021]: No targets found.
Dec 06 07:01:52 user nova-compute[75021]: iSNS:
Dec 06 07:01:52 user nova-compute[75021]: No targets found.
Dec 06 07:01:52 user nova-compute[75021]: STATIC:
Dec 06 07:01:52 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7
Dec 06 07:01:52 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:52 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:52 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5
Dec 06 07:01:52 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:52 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:52 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3
Dec 06 07:01:52 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:52 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:52 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575
Dec 06 07:01:52 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:52 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:52 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea
Dec 06 07:01:52 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:52 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:52 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794
Dec 06 07:01:52 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:01:52 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:01:52 user nova-compute[75021]: FIRMWARE:
Dec 06 07:01:52 user nova-compute[75021]: No targets found.
Dec 06 07:01:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:01:52 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:01:52 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a50b64-a220-40a0-8719-2cab80f8bd90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe638a0d-13a7-437d-ad97-49533b9824a4]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:01:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:01:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d871c9d0>, {}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Disconnecting from: [] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] <== disconnect_volume: return (72ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.062s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:52 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:01:52 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[699f876a-9f50-47c2-9876-4515cabe4b32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:01:52 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a97cb74-13f6-410e-823c-7145f21fe4dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1] added
Dec 06 07:01:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb9a1b7-f588-4d67-8d90-fdf7534aebbf]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5d2a89-b4ab-466d-af36-9acc8c26401b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjhoLzny {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjhoLzny" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb762735-2c78-480e-9122-b1e5d78161f3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bjhoLzny'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[770718b2-4224-43db-a41f-cdeb8ba46736]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d60d3b8-f739-401d-95f3-feef941bd548]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:01:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:01:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf91e4a-ab44-425c-80af-6303987e98c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1, portal: 172.16.0.220,3260]
Dec 06 07:01:52 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1, portal: 172.16.0.220,3260] successful.
Dec 06 07:01:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89f6842-e6a7-4afd-8c3b-25dca646976b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49cabbe-a310-41b2-b263-8b171746ecaf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:01:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:01:52 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:01:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad995387-2cf5-4cca-b365-3d54d2f9deb0]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjhoLzny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:01:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Preparing to wait for external event volume-reimaged-cc022fa0-75a9-49f7-9908-571e56a19d9d {{(pid=75021) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Dec 06 07:01:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-c1912ab2-2158-4697-949a-807e295db909 req-f0375954-60cf-4688-810a-95302f6c9f23 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received event network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:01:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c1912ab2-2158-4697-949a-807e295db909 req-f0375954-60cf-4688-810a-95302f6c9f23 service nova] Acquiring lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c1912ab2-2158-4697-949a-807e295db909 req-f0375954-60cf-4688-810a-95302f6c9f23 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c1912ab2-2158-4697-949a-807e295db909 req-f0375954-60cf-4688-810a-95302f6c9f23 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-c1912ab2-2158-4697-949a-807e295db909 req-f0375954-60cf-4688-810a-95302f6c9f23 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] No event matching network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 in dict_keys([('volume-reimaged', 'cc022fa0-75a9-49f7-9908-571e56a19d9d')]) {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Dec 06 07:01:53 user nova-compute[75021]: WARNING nova.compute.manager [req-c1912ab2-2158-4697-949a-807e295db909 req-f0375954-60cf-4688-810a-95302f6c9f23 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received unexpected event network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 for instance with vm_state active and task_state rebuilding.
Dec 06 07:01:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:01:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23533346433316635', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:01:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533346433316635', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:01:53 user nova-compute[75021]: DEBUG nova.objects.instance [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lazy-loading 'flavor' on Instance uuid 91eeb5a9-b6de-40c0-bc37-49768cc15c9c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:01:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:01:53 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:53 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:01:53 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:01:53 user nova-compute[75021]:   <serial>ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1</serial>
Dec 06 07:01:53 user nova-compute[75021]: </disk>
Dec 06 07:01:53 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:01:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] No BDM found with device name hda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:01:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] No VIF found with MAC fa:16:3e:91:f2:66, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:01:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-77cbbd22-27e6-4fe0-9869-676d1d093931 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.382s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:01:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:01:55 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:01:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:55 user nova-compute[75021]: INFO nova.compute.manager [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Detaching volume ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1
Dec 06 07:01:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:55 user nova-compute[75021]: INFO nova.virt.block_device [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Attempting to driver detach volume ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 from mountpoint /dev/vdb
Dec 06 07:01:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Attempting to detach device vdb from instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:01:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:01:55 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:55 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:01:55 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:01:55 user nova-compute[75021]:   <serial>ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1</serial>
Dec 06 07:01:55 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 07:01:55 user nova-compute[75021]: </disk>
Dec 06 07:01:55 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:01:55 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Successfully detached device vdb from instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c from the persistent domain config.
Dec 06 07:01:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:01:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:01:55 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:01:55 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:01:55 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:01:55 user nova-compute[75021]:   <serial>ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1</serial>
Dec 06 07:01:55 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 07:01:55 user nova-compute[75021]: </disk>
Dec 06 07:01:55 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:01:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:01:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:01:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:01:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:01:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:01:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:01:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:01:59 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:01:59 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:01:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7272MB free_disk=25.603012084960938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:01:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:01:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:01:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:01:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:01:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:01:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b11b4d87-8700-4c0b-9c2c-aac8162def21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:01:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:01:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:01:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:01:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance d5cd8c5d-acc4-44b8-b240-58f8fea899ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:01:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:01:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance ab907f07-df7b-4d56-baef-f2502b88b622 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:01:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:01:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:01:59 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:02:00 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:02:00 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:02:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:02:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:02:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:02:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:02:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:02:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updating instance_info_cache with network_info: [{"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:02:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:02:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:02:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:02:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:02:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:02:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:02:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:02:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:02 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:02:02 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:02:02 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:02:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-4fc3d0d4-204c-4c8c-9f83-e636ca1f6086 req-0f0292a8-8e2f-4594-a8f1-15ad9846f209 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Received event network-changed-b3867e25-16d1-476e-8ebc-4f8bc95f785d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-4fc3d0d4-204c-4c8c-9f83-e636ca1f6086 req-0f0292a8-8e2f-4594-a8f1-15ad9846f209 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Refreshing instance network info cache due to event network-changed-b3867e25-16d1-476e-8ebc-4f8bc95f785d. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:02:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4fc3d0d4-204c-4c8c-9f83-e636ca1f6086 req-0f0292a8-8e2f-4594-a8f1-15ad9846f209 service nova] Acquiring lock "refresh_cache-b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:02:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4fc3d0d4-204c-4c8c-9f83-e636ca1f6086 req-0f0292a8-8e2f-4594-a8f1-15ad9846f209 service nova] Acquired lock "refresh_cache-b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:02:03 user nova-compute[75021]: DEBUG nova.network.neutron [req-4fc3d0d4-204c-4c8c-9f83-e636ca1f6086 req-0f0292a8-8e2f-4594-a8f1-15ad9846f209 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Refreshing network info cache for port b3867e25-16d1-476e-8ebc-4f8bc95f785d {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:02:03 user nova-compute[75021]: DEBUG nova.network.neutron [req-4fc3d0d4-204c-4c8c-9f83-e636ca1f6086 req-0f0292a8-8e2f-4594-a8f1-15ad9846f209 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Updated VIF entry in instance network info cache for port b3867e25-16d1-476e-8ebc-4f8bc95f785d. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:02:03 user nova-compute[75021]: DEBUG nova.network.neutron [req-4fc3d0d4-204c-4c8c-9f83-e636ca1f6086 req-0f0292a8-8e2f-4594-a8f1-15ad9846f209 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Updating instance_info_cache with network_info: [{"id": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "address": "fa:16:3e:4f:b1:0c", "network": {"id": "8fae4511-0ed6-4cef-af43-c90ede6da761", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2095445360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82fc63d07764525aac64fb2c9377429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3867e25-16", "ovs_interfaceid": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:02:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4fc3d0d4-204c-4c8c-9f83-e636ca1f6086 req-0f0292a8-8e2f-4594-a8f1-15ad9846f209 service nova] Releasing lock "refresh_cache-b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:02:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:07 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a is timed out.
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquiring lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:07 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Successfully detached device vdb from instance 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a from the live domain config.
Dec 06 07:02:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhWEyASf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:02:07 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG nova.objects.instance [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lazy-loading 'flavor' on Instance uuid b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c525a0-350b-4019-b7ac-5cfec3c793b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:02:07 user nova-compute[75021]: No targets found.
Dec 06 07:02:07 user nova-compute[75021]: iSNS:
Dec 06 07:02:07 user nova-compute[75021]: No targets found.
Dec 06 07:02:07 user nova-compute[75021]: STATIC:
Dec 06 07:02:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7
Dec 06 07:02:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5
Dec 06 07:02:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1
Dec 06 07:02:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3
Dec 06 07:02:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d
Dec 06 07:02:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575
Dec 06 07:02:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea
Dec 06 07:02:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794
Dec 06 07:02:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:07 user nova-compute[75021]: FIRMWARE:
Dec 06 07:02:07 user nova-compute[75021]: No targets found.
Dec 06 07:02:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:02:07 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:02:07 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[71658a30-6fa9-448f-a63d-e29f32cda65d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aac1741-6568-49f3-9c75-40f1e3cc5c22]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 (non-flash)
Dec 06 07:02:07 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:02:07 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:07 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:07 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:07 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:02:07 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:02:07 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:02:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 (non-flash)
Dec 06 07:02:07 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:02:07 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:07 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:07 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:07 user nova-compute[75021]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 (non-flash)
Dec 06 07:02:07 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:02:07 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:02:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b4765480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575'): ({'sdd'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Removing single pathed devices sdd {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[571dfffd-7c52-4581-9353-2be3304971dc]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[687a3947-559e-48f1-b912-abdabd9268ba]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Flushing IO for device /dev/sdd {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf24bfb-885b-447a-ba30-087366a5566c]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e46c73f-a51a-4108-b8f1-eb7475d70845]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[354ed439-88ec-4f15-afc3-79af0b2f01ad]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquiring lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:07 user nova-compute[75021]: INFO nova.compute.manager [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Attaching volume f9335bda-2f4e-4758-b9d3-d9784eacafdd to /dev/vdb
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92456eb-6fe5-4369-92fc-cc3ffe21a605]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575, portal: 172.16.0.220,3260]
Dec 06 07:02:07 user nova-compute[75021]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575, portal: 172.16.0.220,3260] successful.
Dec 06 07:02:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2eda485-0c13-422b-8670-722844825575 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a071534c-e3b3-43f8-950a-88815ab7b0e0]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] <== disconnect_volume: return (418ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:02:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG os_brick.utils [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[12edd211-0500-44a9-9ca1-fc0212e594f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac71413-9226-4e19-80e3-cf9b22201512]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a7d56e-a664-40f6-a8c1-8475d3c37fcc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2293e401-12f0-4c59-95c9-1f550a02ed9c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:02:08 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:02:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f538b982-a0fa-4088-9cd2-03b4cca7f445]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG os_brick.utils [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:02:08 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Updating existing volume attachment record: c7427d3c-36b6-4496-b8c2-0ad3884f3663 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG nova.objects.instance [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lazy-loading 'flavor' on Instance uuid 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6c6f4a62-9ec2-44cc-8463-cf26654e748e tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.241s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:09 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 is timed out.
Dec 06 07:02:09 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Successfully detached device vdb from instance 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 from the live domain config.
Dec 06 07:02:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGuNZxMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:02:09 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d36f32-a844-4c30-a783-83054c03e171]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:02:09 user nova-compute[75021]: No targets found.
Dec 06 07:02:09 user nova-compute[75021]: iSNS:
Dec 06 07:02:09 user nova-compute[75021]: No targets found.
Dec 06 07:02:09 user nova-compute[75021]: STATIC:
Dec 06 07:02:09 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7
Dec 06 07:02:09 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:09 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:09 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5
Dec 06 07:02:09 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:09 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:09 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1
Dec 06 07:02:09 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:09 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:09 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3
Dec 06 07:02:09 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:09 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:09 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d
Dec 06 07:02:09 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:09 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:09 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea
Dec 06 07:02:09 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:09 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:09 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794
Dec 06 07:02:09 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:09 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:09 user nova-compute[75021]: FIRMWARE:
Dec 06 07:02:09 user nova-compute[75021]: No targets found.
Dec 06 07:02:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:02:09 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:02:09 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e933fe92-e5e1-46a6-8b7c-29b68c2c81cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69105b1-4fef-463b-b03e-2a11ab93a11f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 (non-flash)
Dec 06 07:02:09 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:02:09 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:09 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:09 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:09 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:02:09 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:02:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 (non-flash)
Dec 06 07:02:09 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:02:09 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:09 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:09 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:09 user nova-compute[75021]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 (non-flash)
Dec 06 07:02:09 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:02:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b476f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7'): ({'sdg'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Removing single pathed devices sdg {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bec9028-37e7-4354-a624-8c185441c442]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcebc289-f739-471d-bdfc-7b513cc73b9a]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Flushing IO for device /dev/sdg {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e6e8a3-bbc0-49a8-b84c-727b90836723]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[499fb8ea-8d34-4137-b278-d852accfb910]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] SCSI volumes sdg have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbf0c61-b916-4df0-8be5-d06b6bf74e98]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51c584d-4bc5-4886-9e5c-d2841173ce13]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7, portal: 172.16.0.220,3260]
Dec 06 07:02:09 user nova-compute[75021]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7, portal: 172.16.0.220,3260] successful.
Dec 06 07:02:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3975c5f-033a-47e8-8554-4b3bd1e1d8c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad08dfb-b98b-4671-a8f8-1a09234b199e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] <== disconnect_volume: return (358ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:02:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG nova.objects.instance [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Lazy-loading 'flavor' on Instance uuid 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:02:10 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance b11b4d87-8700-4c0b-9c2c-aac8162def21 is timed out.
Dec 06 07:02:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Successfully detached device sdc from instance b11b4d87-8700-4c0b-9c2c-aac8162def21 from the live domain config.
Dec 06 07:02:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amchovrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:02:10 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6883e9ec-3da0-4d11-a93b-a486d2823804]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:02:10 user nova-compute[75021]: No targets found.
Dec 06 07:02:10 user nova-compute[75021]: iSNS:
Dec 06 07:02:10 user nova-compute[75021]: No targets found.
Dec 06 07:02:10 user nova-compute[75021]: STATIC:
Dec 06 07:02:10 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5
Dec 06 07:02:10 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:10 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:10 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1
Dec 06 07:02:10 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:10 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:10 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3
Dec 06 07:02:10 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:10 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:10 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d
Dec 06 07:02:10 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:10 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:10 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea
Dec 06 07:02:10 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:10 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:10 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794
Dec 06 07:02:10 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:10 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:10 user nova-compute[75021]: FIRMWARE:
Dec 06 07:02:10 user nova-compute[75021]: No targets found.
Dec 06 07:02:10 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:02:10 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:02:10 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[715b9779-5bd1-4fc0-a876-2c89b54752f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[031915ee-9bd7-46c0-809f-923393e08204]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 (non-flash)
Dec 06 07:02:10 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:02:10 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:10 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:10 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:10 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:02:10 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 (non-flash)
Dec 06 07:02:10 user nova-compute[75021]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:02:10 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:10 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:10 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:10 user nova-compute[75021]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea (non-flash)
Dec 06 07:02:10 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b4773520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea'): ({'sdh'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Removing single pathed devices sdh {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cb5546e7-a6bd-40d4-b659-2855a45160ce tempest-VolumesAssistedSnapshotsTest-2041831135 tempest-VolumesAssistedSnapshotsTest-2041831135-project-admin] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.275s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaef23fa-4572-4f2b-8d79-e57d1520507f]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36b2631-ea09-409d-8e9a-fb92b92e1a33]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Flushing IO for device /dev/sdh {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[17638cbf-f9cf-4ab5-b755-b42f62e94cd3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[742da107-1f74-4e32-8d40-d3bf6e0cac21]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] SCSI volumes sdh have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a474c96b-6abe-4318-a66a-1e036869a53e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:11 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae9d3b8-f681-42f6-868c-c52374f57f79]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:11 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea, portal: 172.16.0.220,3260]
Dec 06 07:02:11 user nova-compute[75021]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea, portal: 172.16.0.220,3260] successful.
Dec 06 07:02:11 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f90ea2b4-fbec-42bf-a3b7-a0890c227dea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:11 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd9a1fa-e48d-4413-ad75-abd179c0d4d9]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:11 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:11 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:02:11 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] <== disconnect_volume: return (373ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:02:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:02:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:12 user nova-compute[75021]: DEBUG nova.objects.instance [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lazy-loading 'flavor' on Instance uuid b11b4d87-8700-4c0b-9c2c-aac8162def21 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:02:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7142d972-433b-4487-a313-1977c7a37a30 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.686s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "b11b4d87-8700-4c0b-9c2c-aac8162def21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "b11b4d87-8700-4c0b-9c2c-aac8162def21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:14 user nova-compute[75021]: INFO nova.compute.manager [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Terminating instance
Dec 06 07:02:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:02:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-915fff11-65a5-42a8-8fc8-57dddd60180d req-93388134-4566-407f-bbf9-231fa826e345 service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Received event network-vif-unplugged-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-915fff11-65a5-42a8-8fc8-57dddd60180d req-93388134-4566-407f-bbf9-231fa826e345 service nova] Acquiring lock "b11b4d87-8700-4c0b-9c2c-aac8162def21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-915fff11-65a5-42a8-8fc8-57dddd60180d req-93388134-4566-407f-bbf9-231fa826e345 service nova] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-915fff11-65a5-42a8-8fc8-57dddd60180d req-93388134-4566-407f-bbf9-231fa826e345 service nova] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-915fff11-65a5-42a8-8fc8-57dddd60180d req-93388134-4566-407f-bbf9-231fa826e345 service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] No waiting events found dispatching network-vif-unplugged-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:02:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-915fff11-65a5-42a8-8fc8-57dddd60180d req-93388134-4566-407f-bbf9-231fa826e345 service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Received event network-vif-unplugged-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:02:15 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Instance destroyed successfully.
Dec 06 07:02:15 user nova-compute[75021]: DEBUG nova.objects.instance [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lazy-loading 'resources' on Instance uuid b11b4d87-8700-4c0b-9c2c-aac8162def21 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T06:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1065708926',display_name='tempest-AttachSCSIVolumeTestJSON-server-1065708926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1065708926',id=6,image_ref='7c5b2855-602b-4532-81af-6a9300136ead',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuJbaAlOmefID2TKu5+2cXdv8csMmSWXsq1RIrdShPetbGgNSdC/zVXm3xWuDwYeDcAHbKMzNixfin1QqpKhqw0nSSsWvsS/rTlhBQGEUeDVeqkYFjdH693UqV0GPF8kA==',key_name='tempest-keypair-2094782411',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63b08a5dd15241a39287b6c00de8f344',ramdisk_id='',reservation_id='r-h5w63zmk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7c5b2855-602b-4532-81af-6a9300136ead',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-588244651',owner_user_name='tempest-AttachSCSIVolumeTestJSON-588244651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T06:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35b5bf2dea0b4d3ca9641dbedff96bf6',uuid=b11b4d87-8700-4c0b-9c2c-aac8162def21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "address": "fa:16:3e:19:71:a3", "network": {"id": "c9847c4f-b306-45d5-8b2a-2254d491735c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571792892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b08a5dd15241a39287b6c00de8f344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7af4eb9-d3", "ovs_interfaceid": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Converting VIF {"id": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "address": "fa:16:3e:19:71:a3", "network": {"id": "c9847c4f-b306-45d5-8b2a-2254d491735c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1571792892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b08a5dd15241a39287b6c00de8f344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7af4eb9-d3", "ovs_interfaceid": "f7af4eb9-d30e-4abd-988e-3ac2fc3434d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:71:a3,bridge_name='br-int',has_traffic_filtering=True,id=f7af4eb9-d30e-4abd-988e-3ac2fc3434d5,network=Network(c9847c4f-b306-45d5-8b2a-2254d491735c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7af4eb9-d3') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG os_vif [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:71:a3,bridge_name='br-int',has_traffic_filtering=True,id=f7af4eb9-d30e-4abd-988e-3ac2fc3434d5,network=Network(c9847c4f-b306-45d5-8b2a-2254d491735c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7af4eb9-d3') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7af4eb9-d3, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b334e4f9-96a4-4fb7-8877-7c0be300d295) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:15 user nova-compute[75021]: INFO os_vif [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:71:a3,bridge_name='br-int',has_traffic_filtering=True,id=f7af4eb9-d30e-4abd-988e-3ac2fc3434d5,network=Network(c9847c4f-b306-45d5-8b2a-2254d491735c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7af4eb9-d3')
Dec 06 07:02:15 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Deleting instance files /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21_del
Dec 06 07:02:15 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Deletion of /opt/stack/data/nova/instances/b11b4d87-8700-4c0b-9c2c-aac8162def21_del complete
Dec 06 07:02:15 user nova-compute[75021]: INFO nova.compute.manager [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Took 0.90 seconds to destroy the instance on the hypervisor.
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 req-277ad0f5-772f-4d2c-a48f-924cfb8d9a07 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received event volume-reimaged-cc022fa0-75a9-49f7-9908-571e56a19d9d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 req-277ad0f5-772f-4d2c-a48f-924cfb8d9a07 service nova] Acquiring lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 req-277ad0f5-772f-4d2c-a48f-924cfb8d9a07 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 req-277ad0f5-772f-4d2c-a48f-924cfb8d9a07 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 req-277ad0f5-772f-4d2c-a48f-924cfb8d9a07 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Processing event volume-reimaged-cc022fa0-75a9-49f7-9908-571e56a19d9d {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Instance event wait completed in 21 seconds for volume-reimaged {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:02:15 user nova-compute[75021]: INFO nova.virt.block_device [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Booting with volume cc022fa0-75a9-49f7-9908-571e56a19d9d at /dev/vda
Dec 06 07:02:15 user nova-compute[75021]: DEBUG os_brick.utils [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee57826a-2f69-4b1a-8f2d-4d3f53aaae62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.072s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dadb48-b35c-4b5f-9274-c901cbab2a86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fa92ac-de58-42cc-aee1-48354752fb1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f354d8-e0f2-49d3-9322-290e0c2d2980]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:02:15 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:02:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf847e2-1911-465e-831a-8ad45df70d34]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG os_brick.utils [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:02:15 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Updating existing volume attachment record: 2b12f071-f17b-4f31-b8f5-5d249499ca7f {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:02:16 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c is timed out.
Dec 06 07:02:16 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Successfully detached device vdb from instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c from the live domain config.
Dec 06 07:02:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjhoLzny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:02:16 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6596ed-faa2-492a-a13d-e19c651a91b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:02:16 user nova-compute[75021]: No targets found.
Dec 06 07:02:16 user nova-compute[75021]: iSNS:
Dec 06 07:02:16 user nova-compute[75021]: No targets found.
Dec 06 07:02:16 user nova-compute[75021]: STATIC:
Dec 06 07:02:16 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5
Dec 06 07:02:16 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:16 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:16 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1
Dec 06 07:02:16 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:16 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:16 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3
Dec 06 07:02:16 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:16 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:16 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794
Dec 06 07:02:16 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:16 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:16 user nova-compute[75021]: FIRMWARE:
Dec 06 07:02:16 user nova-compute[75021]: No targets found.
Dec 06 07:02:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:02:16 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:02:16 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2726937f-b2cf-453e-91b9-04be612ac67d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[28029db7-536c-4158-8795-0bd6ad0909e9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 (non-flash)
Dec 06 07:02:16 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:16 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:16 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 (non-flash)
Dec 06 07:02:16 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:16 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:16 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b4764040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:02:16 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Took 1.34 seconds to deallocate network for instance.
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae4d8b9-3abd-450e-8f17-b78a8ecbb420]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dd2b3d-bf77-4f78-8659-2361a0379f08]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67e64cc-f90d-4375-8d3c-32f1cd8baa3e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d5c5ba-48fc-4672-b4a4-87a962be0e81]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba93ad7-85f0-4bfe-9a5a-bbd8f33f18d1]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-d027e6b7-f4dc-4e43-8bb0-7e27a18822d2 req-f6b6502d-5ba6-42d1-85ee-c5c95bd72e6d service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Received event network-vif-plugged-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d027e6b7-f4dc-4e43-8bb0-7e27a18822d2 req-f6b6502d-5ba6-42d1-85ee-c5c95bd72e6d service nova] Acquiring lock "b11b4d87-8700-4c0b-9c2c-aac8162def21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d027e6b7-f4dc-4e43-8bb0-7e27a18822d2 req-f6b6502d-5ba6-42d1-85ee-c5c95bd72e6d service nova] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d027e6b7-f4dc-4e43-8bb0-7e27a18822d2 req-f6b6502d-5ba6-42d1-85ee-c5c95bd72e6d service nova] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-d027e6b7-f4dc-4e43-8bb0-7e27a18822d2 req-f6b6502d-5ba6-42d1-85ee-c5c95bd72e6d service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] No waiting events found dispatching network-vif-plugged-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:02:16 user nova-compute[75021]: WARNING nova.compute.manager [req-d027e6b7-f4dc-4e43-8bb0-7e27a18822d2 req-f6b6502d-5ba6-42d1-85ee-c5c95bd72e6d service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Received unexpected event network-vif-plugged-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 for instance with vm_state deleted and task_state None.
Dec 06 07:02:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-d027e6b7-f4dc-4e43-8bb0-7e27a18822d2 req-f6b6502d-5ba6-42d1-85ee-c5c95bd72e6d service nova] [instance: b11b4d87-8700-4c0b-9c2c-aac8162def21] Received event network-vif-deleted-f7af4eb9-d30e-4abd-988e-3ac2fc3434d5 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc89d68-77ce-44bf-af7e-0778340f098b]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1, portal: 172.16.0.220,3260]
Dec 06 07:02:16 user nova-compute[75021]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1, portal: 172.16.0.220,3260] successful.
Dec 06 07:02:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5e4fa1-9c49-424e-8a9e-9caa0dab75b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08b0035-8928-4c96-a141-29f8827bb400]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] <== disconnect_volume: return (392ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:02:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:17 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Deleted allocations for instance b11b4d87-8700-4c0b-9c2c-aac8162def21
Dec 06 07:02:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f1c343db-cc32-4857-80a3-38e3c9655d27 tempest-AttachSCSIVolumeTestJSON-588244651 tempest-AttachSCSIVolumeTestJSON-588244651-project-member] Lock "b11b4d87-8700-4c0b-9c2c-aac8162def21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.948s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:17 user nova-compute[75021]: DEBUG nova.objects.instance [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lazy-loading 'flavor' on Instance uuid 91eeb5a9-b6de-40c0-bc37-49768cc15c9c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:02:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cd940f46-074a-41dc-96b1-8c7795a64889 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.197s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "interface-91eeb5a9-b6de-40c0-bc37-49768cc15c9c-0e389dcb-c0a8-47b6-997f-8af8932019e0" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "interface-91eeb5a9-b6de-40c0-bc37-49768cc15c9c-0e389dcb-c0a8-47b6-997f-8af8932019e0" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG nova.objects.instance [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lazy-loading 'flavor' on Instance uuid 91eeb5a9-b6de-40c0-bc37-49768cc15c9c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T06:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9053064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9053064',id=8,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfxPXtIc47E18m6Z4qikWqTz2rTTY3bjnRhlRvdXGj9tpXYrXf76otmdZT3oE+W47oRVEPxUwhFLz0Caec3zbc1/KigN/WcfjgJ+3ELWkAH6KQ8DaAIyV9KAyPj8VZgwQ==',key_name='tempest-keypair-399869130',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb6fd76416e04d298f16ae4dffbb2191',ramdisk_id='',reservation_id='r-21w39m30',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1423166060',owner_user_name='tempest-TaggedAttachmentsTest-1423166060-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T06:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2de88a1aa57403e8c6614458998b059',uuid=91eeb5a9-b6de-40c0-bc37-49768cc15c9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "address": "fa:16:3e:6a:99:11", "network": {"id": "b25b1d3d-788d-4093-9933-d13031e93c63", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-721588809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e389dcb-c0", "ovs_interfaceid": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Converting VIF {"id": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "address": "fa:16:3e:6a:99:11", "network": {"id": "b25b1d3d-788d-4093-9933-d13031e93c63", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-721588809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e389dcb-c0", "ovs_interfaceid": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:99:11,bridge_name='br-int',has_traffic_filtering=True,id=0e389dcb-c0a8-47b6-997f-8af8932019e0,network=Network(b25b1d3d-788d-4093-9933-d13031e93c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e389dcb-c0') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6a:99:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap0e389dcb-c0"/></interface> {{(pid=75021) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6a:99:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap0e389dcb-c0"/></interface> {{(pid=75021) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Attempting to detach device tap0e389dcb-c0 from instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] detach device xml: <interface type="ethernet">
Dec 06 07:02:18 user nova-compute[75021]:   <mac address="fa:16:3e:6a:99:11"/>
Dec 06 07:02:18 user nova-compute[75021]:   <model type="virtio"/>
Dec 06 07:02:18 user nova-compute[75021]:   <mtu size="1442"/>
Dec 06 07:02:18 user nova-compute[75021]:   <target dev="tap0e389dcb-c0"/>
Dec 06 07:02:18 user nova-compute[75021]: </interface>
Dec 06 07:02:18 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6a:99:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap0e389dcb-c0"/></interface> {{(pid=75021) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6a:99:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap0e389dcb-c0"/></interface>not found in domain: <domain type='kvm' id='9'>
Dec 06 07:02:18 user nova-compute[75021]:   <name>instance-00000008</name>
Dec 06 07:02:18 user nova-compute[75021]:   <uuid>91eeb5a9-b6de-40c0-bc37-49768cc15c9c</uuid>
Dec 06 07:02:18 user nova-compute[75021]:   <metadata>
Dec 06 07:02:18 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:02:18 user nova-compute[75021]:   <nova:package version="0.0.0"/>
Dec 06 07:02:18 user nova-compute[75021]:   <nova:name>tempest-device-tagging-server-9053064</nova:name>
Dec 06 07:02:18 user nova-compute[75021]:   <nova:creationTime>2023-12-06 07:01:36</nova:creationTime>
Dec 06 07:02:18 user nova-compute[75021]:   <nova:flavor name="m1.tiny">
Dec 06 07:02:18 user nova-compute[75021]:     <nova:memory>512</nova:memory>
Dec 06 07:02:18 user nova-compute[75021]:     <nova:disk>1</nova:disk>
Dec 06 07:02:18 user nova-compute[75021]:     <nova:swap>0</nova:swap>
Dec 06 07:02:18 user nova-compute[75021]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:02:18 user nova-compute[75021]:     <nova:vcpus>1</nova:vcpus>
Dec 06 07:02:18 user nova-compute[75021]:   </nova:flavor>
Dec 06 07:02:18 user nova-compute[75021]:   <nova:owner>
Dec 06 07:02:18 user nova-compute[75021]:     <nova:user uuid="f2de88a1aa57403e8c6614458998b059">tempest-TaggedAttachmentsTest-1423166060-project-member</nova:user>
Dec 06 07:02:18 user nova-compute[75021]:     <nova:project uuid="eb6fd76416e04d298f16ae4dffbb2191">tempest-TaggedAttachmentsTest-1423166060</nova:project>
Dec 06 07:02:18 user nova-compute[75021]:   </nova:owner>
Dec 06 07:02:18 user nova-compute[75021]:   <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:02:18 user nova-compute[75021]:   <nova:ports>
Dec 06 07:02:18 user nova-compute[75021]:     <nova:port uuid="94173bea-6e40-4bcc-afe0-031fb7fde7fa">
Dec 06 07:02:18 user nova-compute[75021]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 07:02:18 user nova-compute[75021]:     </nova:port>
Dec 06 07:02:18 user nova-compute[75021]:     <nova:port uuid="0e389dcb-c0a8-47b6-997f-8af8932019e0">
Dec 06 07:02:18 user nova-compute[75021]:       <nova:ip type="fixed" address="10.10.10.117" ipVersion="4"/>
Dec 06 07:02:18 user nova-compute[75021]:     </nova:port>
Dec 06 07:02:18 user nova-compute[75021]:   </nova:ports>
Dec 06 07:02:18 user nova-compute[75021]: </nova:instance>
Dec 06 07:02:18 user nova-compute[75021]:   </metadata>
Dec 06 07:02:18 user nova-compute[75021]:   <memory unit='KiB'>524288</memory>
Dec 06 07:02:18 user nova-compute[75021]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 06 07:02:18 user nova-compute[75021]:   <vcpu placement='static'>1</vcpu>
Dec 06 07:02:18 user nova-compute[75021]:   <resource>
Dec 06 07:02:18 user nova-compute[75021]:     <partition>/machine</partition>
Dec 06 07:02:18 user nova-compute[75021]:   </resource>
Dec 06 07:02:18 user nova-compute[75021]:   <sysinfo type='smbios'>
Dec 06 07:02:18 user nova-compute[75021]:     <system>
Dec 06 07:02:18 user nova-compute[75021]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 06 07:02:18 user nova-compute[75021]:       <entry name='product'>OpenStack Nova</entry>
Dec 06 07:02:18 user nova-compute[75021]:       <entry name='version'>0.0.0</entry>
Dec 06 07:02:18 user nova-compute[75021]:       <entry name='serial'>91eeb5a9-b6de-40c0-bc37-49768cc15c9c</entry>
Dec 06 07:02:18 user nova-compute[75021]:       <entry name='uuid'>91eeb5a9-b6de-40c0-bc37-49768cc15c9c</entry>
Dec 06 07:02:18 user nova-compute[75021]:       <entry name='family'>Virtual Machine</entry>
Dec 06 07:02:18 user nova-compute[75021]:     </system>
Dec 06 07:02:18 user nova-compute[75021]:   </sysinfo>
Dec 06 07:02:18 user nova-compute[75021]:   <os>
Dec 06 07:02:18 user nova-compute[75021]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 06 07:02:18 user nova-compute[75021]:     <boot dev='hd'/>
Dec 06 07:02:18 user nova-compute[75021]:     <smbios mode='sysinfo'/>
Dec 06 07:02:18 user nova-compute[75021]:   </os>
Dec 06 07:02:18 user nova-compute[75021]:   <features>
Dec 06 07:02:18 user nova-compute[75021]:     <acpi/>
Dec 06 07:02:18 user nova-compute[75021]:     <apic/>
Dec 06 07:02:18 user nova-compute[75021]:     <vmcoreinfo state='on'/>
Dec 06 07:02:18 user nova-compute[75021]:   </features>
Dec 06 07:02:18 user nova-compute[75021]:   <cpu mode='custom' match='exact' check='full'>
Dec 06 07:02:18 user nova-compute[75021]:     <model fallback='forbid'>Nehalem</model>
Dec 06 07:02:18 user nova-compute[75021]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 06 07:02:18 user nova-compute[75021]:     <feature policy='require' name='vme'/>
Dec 06 07:02:18 user nova-compute[75021]:     <feature policy='require' name='x2apic'/>
Dec 06 07:02:18 user nova-compute[75021]:     <feature policy='require' name='hypervisor'/>
Dec 06 07:02:18 user nova-compute[75021]:   </cpu>
Dec 06 07:02:18 user nova-compute[75021]:   <clock offset='utc'>
Dec 06 07:02:18 user nova-compute[75021]:     <timer name='pit' tickpolicy='delay'/>
Dec 06 07:02:18 user nova-compute[75021]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 06 07:02:18 user nova-compute[75021]:     <timer name='hpet' present='no'/>
Dec 06 07:02:18 user nova-compute[75021]:   </clock>
Dec 06 07:02:18 user nova-compute[75021]:   <on_poweroff>destroy</on_poweroff>
Dec 06 07:02:18 user nova-compute[75021]:   <on_reboot>restart</on_reboot>
Dec 06 07:02:18 user nova-compute[75021]:   <on_crash>destroy</on_crash>
Dec 06 07:02:18 user nova-compute[75021]:   <devices>
Dec 06 07:02:18 user nova-compute[75021]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 06 07:02:18 user nova-compute[75021]:     <disk type='file' device='disk'>
Dec 06 07:02:18 user nova-compute[75021]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 06 07:02:18 user nova-compute[75021]:       <source file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk' index='2'/>
Dec 06 07:02:18 user nova-compute[75021]:       <backingStore type='file' index='3'>
Dec 06 07:02:18 user nova-compute[75021]:         <format type='raw'/>
Dec 06 07:02:18 user nova-compute[75021]:         <source file='/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe'/>
Dec 06 07:02:18 user nova-compute[75021]:         <backingStore/>
Dec 06 07:02:18 user nova-compute[75021]:       </backingStore>
Dec 06 07:02:18 user nova-compute[75021]:       <target dev='vda' bus='virtio'/>
Dec 06 07:02:18 user nova-compute[75021]:       <alias name='virtio-disk0'/>
Dec 06 07:02:18 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 06 07:02:18 user nova-compute[75021]:     </disk>
Dec 06 07:02:18 user nova-compute[75021]:     <disk type='file' device='cdrom'>
Dec 06 07:02:18 user nova-compute[75021]:       <driver name='qemu' type='raw' cache='none'/>
Dec 06 07:02:18 user nova-compute[75021]:       <source file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk.config' index='1'/>
Dec 06 07:02:18 user nova-compute[75021]:       <backingStore/>
Dec 06 07:02:18 user nova-compute[75021]:       <target dev='hda' bus='ide'/>
Dec 06 07:02:18 user nova-compute[75021]:       <readonly/>
Dec 06 07:02:18 user nova-compute[75021]:       <alias name='ide0-0-0'/>
Dec 06 07:02:18 user nova-compute[75021]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 06 07:02:18 user nova-compute[75021]:     </disk>
Dec 06 07:02:18 user nova-compute[75021]:     <controller type='usb' index='0' model='none'>
Dec 06 07:02:18 user nova-compute[75021]:       <alias name='usb'/>
Dec 06 07:02:18 user nova-compute[75021]:     </controller>
Dec 06 07:02:18 user nova-compute[75021]:     <controller type='pci' index='0' model='pci-root'>
Dec 06 07:02:18 user nova-compute[75021]:       <alias name='pci.0'/>
Dec 06 07:02:18 user nova-compute[75021]:     </controller>
Dec 06 07:02:18 user nova-compute[75021]:     <controller type='ide' index='0'>
Dec 06 07:02:18 user nova-compute[75021]:       <alias name='ide'/>
Dec 06 07:02:18 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 06 07:02:18 user nova-compute[75021]:     </controller>
Dec 06 07:02:18 user nova-compute[75021]:     <interface type='ethernet'>
Dec 06 07:02:18 user nova-compute[75021]:       <mac address='fa:16:3e:91:f2:66'/>
Dec 06 07:02:18 user nova-compute[75021]:       <target dev='tap94173bea-6e'/>
Dec 06 07:02:18 user nova-compute[75021]:       <model type='virtio'/>
Dec 06 07:02:18 user nova-compute[75021]:       <mtu size='1442'/>
Dec 06 07:02:18 user nova-compute[75021]:       <alias name='net0'/>
Dec 06 07:02:18 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 06 07:02:18 user nova-compute[75021]:     </interface>
Dec 06 07:02:18 user nova-compute[75021]:     <interface type='ethernet'>
Dec 06 07:02:18 user nova-compute[75021]:       <mac address='fa:16:3e:6a:99:11'/>
Dec 06 07:02:18 user nova-compute[75021]:       <target dev='tap0e389dcb-c0'/>
Dec 06 07:02:18 user nova-compute[75021]:       <model type='virtio'/>
Dec 06 07:02:18 user nova-compute[75021]:       <mtu size='1442'/>
Dec 06 07:02:18 user nova-compute[75021]:       <alias name='net1'/>
Dec 06 07:02:18 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Dec 06 07:02:18 user nova-compute[75021]:     </interface>
Dec 06 07:02:18 user nova-compute[75021]:     <serial type='pty'>
Dec 06 07:02:18 user nova-compute[75021]:       <source path='/dev/pts/8'/>
Dec 06 07:02:18 user nova-compute[75021]:       <log file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/console.log' append='off'/>
Dec 06 07:02:18 user nova-compute[75021]:       <target type='isa-serial' port='0'>
Dec 06 07:02:18 user nova-compute[75021]:         <model name='isa-serial'/>
Dec 06 07:02:18 user nova-compute[75021]:       </target>
Dec 06 07:02:18 user nova-compute[75021]:       <alias name='serial0'/>
Dec 06 07:02:18 user nova-compute[75021]:     </serial>
Dec 06 07:02:18 user nova-compute[75021]:     <console type='pty' tty='/dev/pts/8'>
Dec 06 07:02:18 user nova-compute[75021]:       <source path='/dev/pts/8'/>
Dec 06 07:02:18 user nova-compute[75021]:       <log file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/console.log' append='off'/>
Dec 06 07:02:18 user nova-compute[75021]:       <target type='serial' port='0'/>
Dec 06 07:02:18 user nova-compute[75021]:       <alias name='serial0'/>
Dec 06 07:02:18 user nova-compute[75021]:     </console>
Dec 06 07:02:18 user nova-compute[75021]:     <input type='mouse' bus='ps2'>
Dec 06 07:02:18 user nova-compute[75021]:       <alias name='input0'/>
Dec 06 07:02:18 user nova-compute[75021]:     </input>
Dec 06 07:02:18 user nova-compute[75021]:     <input type='keyboard' bus='ps2'>
Dec 06 07:02:18 user nova-compute[75021]:       <alias name='input1'/>
Dec 06 07:02:18 user nova-compute[75021]:     </input>
Dec 06 07:02:18 user nova-compute[75021]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Dec 06 07:02:18 user nova-compute[75021]:       <listen type='address' address='0.0.0.0'/>
Dec 06 07:02:18 user nova-compute[75021]:     </graphics>
Dec 06 07:02:18 user nova-compute[75021]:     <audio id='1' type='none'/>
Dec 06 07:02:18 user nova-compute[75021]:     <video>
Dec 06 07:02:18 user nova-compute[75021]:       <model type='virtio' heads='1' primary='yes'/>
Dec 06 07:02:18 user nova-compute[75021]:       <alias name='video0'/>
Dec 06 07:02:18 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 06 07:02:18 user nova-compute[75021]:     </video>
Dec 06 07:02:18 user nova-compute[75021]:     <memballoon model='virtio'>
Dec 06 07:02:18 user nova-compute[75021]:       <stats period='10'/>
Dec 06 07:02:18 user nova-compute[75021]:       <alias name='balloon0'/>
Dec 06 07:02:18 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 06 07:02:18 user nova-compute[75021]:     </memballoon>
Dec 06 07:02:18 user nova-compute[75021]:     <rng model='virtio'>
Dec 06 07:02:18 user nova-compute[75021]:       <backend model='random'>/dev/urandom</backend>
Dec 06 07:02:18 user nova-compute[75021]:       <alias name='rng0'/>
Dec 06 07:02:18 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 06 07:02:18 user nova-compute[75021]:     </rng>
Dec 06 07:02:18 user nova-compute[75021]:   </devices>
Dec 06 07:02:18 user nova-compute[75021]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 06 07:02:18 user nova-compute[75021]:     <label>libvirt-91eeb5a9-b6de-40c0-bc37-49768cc15c9c</label>
Dec 06 07:02:18 user nova-compute[75021]:     <imagelabel>libvirt-91eeb5a9-b6de-40c0-bc37-49768cc15c9c</imagelabel>
Dec 06 07:02:18 user nova-compute[75021]:   </seclabel>
Dec 06 07:02:18 user nova-compute[75021]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 06 07:02:18 user nova-compute[75021]:     <label>+64055:+108</label>
Dec 06 07:02:18 user nova-compute[75021]:     <imagelabel>+64055:+108</imagelabel>
Dec 06 07:02:18 user nova-compute[75021]:   </seclabel>
Dec 06 07:02:18 user nova-compute[75021]: </domain>
Dec 06 07:02:18 user nova-compute[75021]:  {{(pid=75021) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 06 07:02:18 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Successfully detached device tap0e389dcb-c0 from instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c from the persistent domain config.
Dec 06 07:02:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] (1/8): Attempting to detach device tap0e389dcb-c0 with device alias net1 from instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] detach device xml: <interface type="ethernet">
Dec 06 07:02:18 user nova-compute[75021]:   <mac address="fa:16:3e:6a:99:11"/>
Dec 06 07:02:18 user nova-compute[75021]:   <model type="virtio"/>
Dec 06 07:02:18 user nova-compute[75021]:   <mtu size="1442"/>
Dec 06 07:02:18 user nova-compute[75021]:   <target dev="tap0e389dcb-c0"/>
Dec 06 07:02:18 user nova-compute[75021]: </interface>
Dec 06 07:02:18 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Start waiting for the detach event from libvirt for device tap0e389dcb-c0 with device alias net1 for instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-6b236a6d-28fe-4e1d-a5d9-8775ae974876 req-b47cc011-8973-4383-a7a1-861be68dd1c0 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received event network-vif-unplugged-0e389dcb-c0a8-47b6-997f-8af8932019e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6b236a6d-28fe-4e1d-a5d9-8775ae974876 req-b47cc011-8973-4383-a7a1-861be68dd1c0 service nova] Acquiring lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6b236a6d-28fe-4e1d-a5d9-8775ae974876 req-b47cc011-8973-4383-a7a1-861be68dd1c0 service nova] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6b236a6d-28fe-4e1d-a5d9-8775ae974876 req-b47cc011-8973-4383-a7a1-861be68dd1c0 service nova] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-6b236a6d-28fe-4e1d-a5d9-8775ae974876 req-b47cc011-8973-4383-a7a1-861be68dd1c0 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] No waiting events found dispatching network-vif-unplugged-0e389dcb-c0a8-47b6-997f-8af8932019e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:02:18 user nova-compute[75021]: WARNING nova.compute.manager [req-6b236a6d-28fe-4e1d-a5d9-8775ae974876 req-b47cc011-8973-4383-a7a1-861be68dd1c0 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received unexpected event network-vif-unplugged-0e389dcb-c0a8-47b6-997f-8af8932019e0 for instance with vm_state active and task_state None.
Dec 06 07:02:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlsJUqSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:02:20 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:02:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:02:20 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:02:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:02:20 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7e1bba-d471-4b38-b81c-b4a043836943]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:02:20 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d95ebf8-526f-4b02-997c-b5e0ae5f6447]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd] added
Dec 06 07:02:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3d0523-73e0-4c58-8093-973fcfb26d90]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedca272-5e99-483b-9eb5-c07c1d6fb0ac]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlsJUqSA {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlsJUqSA" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4497b771-a886-4d9f-8d76-1b7005bab021]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZlsJUqSA'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[42263f7d-d070-42cc-94c8-8bfcabbede1f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c5b182-6e9d-4a5e-83fb-da2450650274]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:20 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:20 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:20 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:20 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0c8c8e-106f-4a84-953c-71243b65ac76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd, portal: 172.16.0.220,3260]
Dec 06 07:02:20 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd, portal: 172.16.0.220,3260] successful.
Dec 06 07:02:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-64add539-5899-46b3-b76d-db6066929baf req-43a84927-3e26-4771-bd12-3ea329e6f1dc service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received event network-vif-plugged-0e389dcb-c0a8-47b6-997f-8af8932019e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-64add539-5899-46b3-b76d-db6066929baf req-43a84927-3e26-4771-bd12-3ea329e6f1dc service nova] Acquiring lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-64add539-5899-46b3-b76d-db6066929baf req-43a84927-3e26-4771-bd12-3ea329e6f1dc service nova] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-64add539-5899-46b3-b76d-db6066929baf req-43a84927-3e26-4771-bd12-3ea329e6f1dc service nova] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-64add539-5899-46b3-b76d-db6066929baf req-43a84927-3e26-4771-bd12-3ea329e6f1dc service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] No waiting events found dispatching network-vif-plugged-0e389dcb-c0a8-47b6-997f-8af8932019e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:02:20 user nova-compute[75021]: WARNING nova.compute.manager [req-64add539-5899-46b3-b76d-db6066929baf req-43a84927-3e26-4771-bd12-3ea329e6f1dc service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received unexpected event network-vif-plugged-0e389dcb-c0a8-47b6-997f-8af8932019e0 for instance with vm_state active and task_state None.
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51e534c-505d-4be3-95a9-8f0596fd5d9b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7533b18e-a0ca-4784-a824-9c5ab87ee8ee]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd (non-flash)
Dec 06 07:02:21 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:21 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:21 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:21 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:02:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd (non-flash)
Dec 06 07:02:21 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:21 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:21 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:21 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:02:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:02:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:02:21 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:02:21 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:02:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3731b2-f16b-4457-958c-90f2c9ac6b12]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:21 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:02:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:22 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:02:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlsJUqSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:02:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:02:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26437636362346364', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:02:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437636362346364', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:02:22 user nova-compute[75021]: DEBUG nova.objects.instance [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lazy-loading 'flavor' on Instance uuid b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:02:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:02:22 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:02:22 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:02:22 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:02:22 user nova-compute[75021]:   <serial>f9335bda-2f4e-4758-b9d3-d9784eacafdd</serial>
Dec 06 07:02:22 user nova-compute[75021]: </disk>
Dec 06 07:02:22 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:02:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:02:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:02:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] No VIF found with MAC fa:16:3e:4f:b1:0c, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:02:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4bcfd60f-61df-4506-a97a-286c8b500f22 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.870s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquiring lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:25 user nova-compute[75021]: INFO nova.compute.manager [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Detaching volume f9335bda-2f4e-4758-b9d3-d9784eacafdd
Dec 06 07:02:25 user nova-compute[75021]: INFO nova.virt.block_device [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Attempting to driver detach volume f9335bda-2f4e-4758-b9d3-d9784eacafdd from mountpoint /dev/vdb
Dec 06 07:02:25 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Attempting to detach device vdb from instance b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:02:25 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:02:25 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:02:25 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:02:25 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:02:25 user nova-compute[75021]:   <serial>f9335bda-2f4e-4758-b9d3-d9784eacafdd</serial>
Dec 06 07:02:25 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:02:25 user nova-compute[75021]: </disk>
Dec 06 07:02:25 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:02:25 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Successfully detached device vdb from instance b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c from the persistent domain config.
Dec 06 07:02:25 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:02:25 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:02:25 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:02:25 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:02:25 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:02:25 user nova-compute[75021]:   <serial>f9335bda-2f4e-4758-b9d3-d9784eacafdd</serial>
Dec 06 07:02:25 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:02:25 user nova-compute[75021]: </disk>
Dec 06 07:02:25 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:02:25 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:02:26 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Creating image(s)
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Ensure instance console log exists: /opt/stack/data/nova/instances/d5cd8c5d-acc4-44b8-b240-58f8fea899ec/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Start _get_guest_xml network_info=[{"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2b12f071-f17b-4f31-b8f5-5d249499ca7f', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKNuoOHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd5cd8c5d-acc4-44b8-b240-58f8fea899ec', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc022fa0-75a9-49f7-9908-571e56a19d9d', 'serial': 'cc022fa0-75a9-49f7-9908-571e56a19d9d'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:02:26 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 06 07:02:26 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.objects.instance [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lazy-loading 'vcpu_model' on Instance uuid d5cd8c5d-acc4-44b8-b240-58f8fea899ec {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKNuoOHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:02:26 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 07:02:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:02:26 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 07:02:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:02:26 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4829b3-0000-4d34-b4df-62cf754cfbc1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:02:26 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59ecc5b-3f07-48e8-b802-4db508f2ec35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d] added
Dec 06 07:02:26 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbaf78f-2916-497e-8d56-52abe619153e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c1cffd-5014-476d-bf89-b4fad05f7761]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SKNuoOHB {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SKNuoOHB" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab276a12-fbdd-43e6-91c0-9bed322e5ca1]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SKNuoOHB'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b010811a-9a66-474c-979e-c0098763c477]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[176e24ca-37e0-4e7a-baef-12321312894c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd (non-flash)
Dec 06 07:02:26 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:26 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:26 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:26 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd (non-flash)
Dec 06 07:02:26 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:26 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:26 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:26 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[98527e13-3b73-4c3b-a61b-2d588f409603]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260]
Dec 06 07:02:26 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260] successful.
Dec 06 07:02:26 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dfd100-b91f-4e67-bda1-2b57b8226fb3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b4200b-8f90-409d-ab1d-a53b8b5ffa0f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd (non-flash)
Dec 06 07:02:27 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:02:27 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:27 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:27 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:02:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd (non-flash)
Dec 06 07:02:27 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:02:27 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:27 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:27 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:02:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:02:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:02:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:02:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:02:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f730327-cba7-46cb-9362-72e0dffbf856]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:02:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKNuoOHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:02:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23033643735396465', 'path': '/dev/sdd'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033643735396465', 'path': '/dev/sdd'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T06:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1888906845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1814435056',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiXiD74QqzfgkFXGjJOZvAqeUVo+mq15hHQ8QIS/Wj/WBUADk0S9ETtuL5LG29w5xqYMy6zRLAJsgjvd9bu5CBLpGA3OWWGNin8u/kh+TSTPSCT1+3h0wrNEHGduvVlPw==',key_name='tempest-keypair-139423592',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:00:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71465ef2851b453393044740cb4703a8',ramdisk_id='',reservation_id='r-d3iwgob5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-888472527',owner_user_name='tempest-ServerActionsV293TestJSON-888472527-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:02:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c13c9f93326641e09f763a42c76449f9',uuid=d5cd8c5d-acc4-44b8-b240-58f8fea899ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Converting VIF {"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4e:65,bridge_name='br-int',has_traffic_filtering=True,id=15d5a156-55aa-4946-9ca4-7bb6cc1a07a0,network=Network(48eb6005-fd57-4d35-a701-ac7bed58807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d5a156-55') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:02:28 user nova-compute[75021]:   <uuid>d5cd8c5d-acc4-44b8-b240-58f8fea899ec</uuid>
Dec 06 07:02:28 user nova-compute[75021]:   <name>instance-0000000a</name>
Dec 06 07:02:28 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:02:28 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:02:28 user nova-compute[75021]:   <metadata>
Dec 06 07:02:28 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:02:28 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:02:28 user nova-compute[75021]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1888906845</nova:name>
Dec 06 07:02:28 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:02:26</nova:creationTime>
Dec 06 07:02:28 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:02:28 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:02:28 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:02:28 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:02:28 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:02:28 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:02:28 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:02:28 user nova-compute[75021]:       <nova:owner>
Dec 06 07:02:28 user nova-compute[75021]:         <nova:user uuid="c13c9f93326641e09f763a42c76449f9">tempest-ServerActionsV293TestJSON-888472527-project-member</nova:user>
Dec 06 07:02:28 user nova-compute[75021]:         <nova:project uuid="71465ef2851b453393044740cb4703a8">tempest-ServerActionsV293TestJSON-888472527</nova:project>
Dec 06 07:02:28 user nova-compute[75021]:       </nova:owner>
Dec 06 07:02:28 user nova-compute[75021]:       <nova:ports>
Dec 06 07:02:28 user nova-compute[75021]:         <nova:port uuid="15d5a156-55aa-4946-9ca4-7bb6cc1a07a0">
Dec 06 07:02:28 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 07:02:28 user nova-compute[75021]:         </nova:port>
Dec 06 07:02:28 user nova-compute[75021]:       </nova:ports>
Dec 06 07:02:28 user nova-compute[75021]:     </nova:instance>
Dec 06 07:02:28 user nova-compute[75021]:   </metadata>
Dec 06 07:02:28 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:02:28 user nova-compute[75021]:     <system>
Dec 06 07:02:28 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:02:28 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:02:28 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:02:28 user nova-compute[75021]:       <entry name="serial">d5cd8c5d-acc4-44b8-b240-58f8fea899ec</entry>
Dec 06 07:02:28 user nova-compute[75021]:       <entry name="uuid">d5cd8c5d-acc4-44b8-b240-58f8fea899ec</entry>
Dec 06 07:02:28 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:02:28 user nova-compute[75021]:     </system>
Dec 06 07:02:28 user nova-compute[75021]:   </sysinfo>
Dec 06 07:02:28 user nova-compute[75021]:   <os>
Dec 06 07:02:28 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:02:28 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:02:28 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:02:28 user nova-compute[75021]:   </os>
Dec 06 07:02:28 user nova-compute[75021]:   <features>
Dec 06 07:02:28 user nova-compute[75021]:     <acpi/>
Dec 06 07:02:28 user nova-compute[75021]:     <apic/>
Dec 06 07:02:28 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:02:28 user nova-compute[75021]:   </features>
Dec 06 07:02:28 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:02:28 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:02:28 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:02:28 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:02:28 user nova-compute[75021]:   </clock>
Dec 06 07:02:28 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:02:28 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:02:28 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:02:28 user nova-compute[75021]:   </cpu>
Dec 06 07:02:28 user nova-compute[75021]:   <devices>
Dec 06 07:02:28 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:02:28 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:02:28 user nova-compute[75021]:       <source dev="/dev/sdd"/>
Dec 06 07:02:28 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:02:28 user nova-compute[75021]:       <serial>cc022fa0-75a9-49f7-9908-571e56a19d9d</serial>
Dec 06 07:02:28 user nova-compute[75021]:     </disk>
Dec 06 07:02:28 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:02:28 user nova-compute[75021]:       <mac address="fa:16:3e:2a:4e:65"/>
Dec 06 07:02:28 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:02:28 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:02:28 user nova-compute[75021]:       <target dev="tap15d5a156-55"/>
Dec 06 07:02:28 user nova-compute[75021]:     </interface>
Dec 06 07:02:28 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:02:28 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/d5cd8c5d-acc4-44b8-b240-58f8fea899ec/console.log" append="off"/>
Dec 06 07:02:28 user nova-compute[75021]:     </serial>
Dec 06 07:02:28 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:02:28 user nova-compute[75021]:     <video>
Dec 06 07:02:28 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:02:28 user nova-compute[75021]:     </video>
Dec 06 07:02:28 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:02:28 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:02:28 user nova-compute[75021]:     </rng>
Dec 06 07:02:28 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:02:28 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:02:28 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:02:28 user nova-compute[75021]:     </memballoon>
Dec 06 07:02:28 user nova-compute[75021]:   </devices>
Dec 06 07:02:28 user nova-compute[75021]: </domain>
Dec 06 07:02:28 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T06:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1888906845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1814435056',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiXiD74QqzfgkFXGjJOZvAqeUVo+mq15hHQ8QIS/Wj/WBUADk0S9ETtuL5LG29w5xqYMy6zRLAJsgjvd9bu5CBLpGA3OWWGNin8u/kh+TSTPSCT1+3h0wrNEHGduvVlPw==',key_name='tempest-keypair-139423592',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:00:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='71465ef2851b453393044740cb4703a8',ramdisk_id='',reservation_id='r-d3iwgob5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-888472527',owner_user_name='tempest-ServerActionsV293TestJSON-888472527-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:02:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c13c9f93326641e09f763a42c76449f9',uuid=d5cd8c5d-acc4-44b8-b240-58f8fea899ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Converting VIF {"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4e:65,bridge_name='br-int',has_traffic_filtering=True,id=15d5a156-55aa-4946-9ca4-7bb6cc1a07a0,network=Network(48eb6005-fd57-4d35-a701-ac7bed58807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d5a156-55') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG os_vif [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4e:65,bridge_name='br-int',has_traffic_filtering=True,id=15d5a156-55aa-4946-9ca4-7bb6cc1a07a0,network=Network(48eb6005-fd57-4d35-a701-ac7bed58807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d5a156-55') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '803a94f6-3431-5b3c-8776-4bf9d1aa973b', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15d5a156-55, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15d5a156-55, col_values=(('qos', UUID('55302a14-84f2-423a-a834-5ef7e2592d08')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15d5a156-55, col_values=(('external_ids', {'iface-id': '15d5a156-55aa-4946-9ca4-7bb6cc1a07a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:4e:65', 'vm-uuid': 'd5cd8c5d-acc4-44b8-b240-58f8fea899ec'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:28 user nova-compute[75021]: INFO os_vif [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4e:65,bridge_name='br-int',has_traffic_filtering=True,id=15d5a156-55aa-4946-9ca4-7bb6cc1a07a0,network=Network(48eb6005-fd57-4d35-a701-ac7bed58807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d5a156-55')
Dec 06 07:02:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:02:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] No VIF found with MAC fa:16:3e:2a:4e:65, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:02:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-42821277-1ad8-4a63-be71-af94113be152 req-80e15ac6-9954-4813-8260-baff6af4ef23 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received event network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42821277-1ad8-4a63-be71-af94113be152 req-80e15ac6-9954-4813-8260-baff6af4ef23 service nova] Acquiring lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42821277-1ad8-4a63-be71-af94113be152 req-80e15ac6-9954-4813-8260-baff6af4ef23 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42821277-1ad8-4a63-be71-af94113be152 req-80e15ac6-9954-4813-8260-baff6af4ef23 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-42821277-1ad8-4a63-be71-af94113be152 req-80e15ac6-9954-4813-8260-baff6af4ef23 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] No waiting events found dispatching network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:02:29 user nova-compute[75021]: WARNING nova.compute.manager [req-42821277-1ad8-4a63-be71-af94113be152 req-80e15ac6-9954-4813-8260-baff6af4ef23 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received unexpected event network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 for instance with vm_state active and task_state rebuild_spawning.
Dec 06 07:02:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:02:31 user nova-compute[75021]: INFO nova.compute.claims [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Claim successful on node user
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-2b13528a-7e52-4783-9bf2-a4aac0f77e84 req-0dd1905a-8826-4d1b-9007-1479bd0f5495 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received event network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2b13528a-7e52-4783-9bf2-a4aac0f77e84 req-0dd1905a-8826-4d1b-9007-1479bd0f5495 service nova] Acquiring lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2b13528a-7e52-4783-9bf2-a4aac0f77e84 req-0dd1905a-8826-4d1b-9007-1479bd0f5495 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2b13528a-7e52-4783-9bf2-a4aac0f77e84 req-0dd1905a-8826-4d1b-9007-1479bd0f5495 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-2b13528a-7e52-4783-9bf2-a4aac0f77e84 req-0dd1905a-8826-4d1b-9007-1479bd0f5495 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] No waiting events found dispatching network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:02:31 user nova-compute[75021]: WARNING nova.compute.manager [req-2b13528a-7e52-4783-9bf2-a4aac0f77e84 req-0dd1905a-8826-4d1b-9007-1479bd0f5495 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received unexpected event network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 for instance with vm_state active and task_state rebuild_spawning.
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:02:31 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Instance spawned successfully.
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.network.neutron [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:02:31 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG nova.policy [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bec5e110057b47ac89c85ca77aaa56ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70aa47164bdf43a78448ce550774cc70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:02:32 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Creating image(s)
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "/opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "/opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG nova.objects.instance [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75021) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a4e89875-d288-4a0a-a143-5c1fda04b9b2 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.119s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG nova.network.neutron [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Successfully created port: f48add70-d28e-43ed-8bc8-cdb69f2b3cee {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk 1073741824" returned: 0 in 0.059s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Cannot resize image /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Ensure instance console log exists: /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Successfully updated port: f48add70-d28e-43ed-8bc8-cdb69f2b3cee {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "refresh_cache-7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquired lock "refresh_cache-7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Updating instance_info_cache with network_info: [{"id": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "address": "fa:16:3e:af:d4:e8", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48add70-d2", "ovs_interfaceid": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Releasing lock "refresh_cache-7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Instance network_info: |[{"id": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "address": "fa:16:3e:af:d4:e8", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48add70-d2", "ovs_interfaceid": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Start _get_guest_xml network_info=[{"id": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "address": "fa:16:3e:af:d4:e8", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48add70-d2", "ovs_interfaceid": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:02:33 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:02:33 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1597141069',display_name='tempest-ServersNegativeTestJSON-server-1597141069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1597141069',id=13,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70aa47164bdf43a78448ce550774cc70',ramdisk_id='',reservation_id='r-n6mzvwwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1406242964',owner_user_name='tempest-ServersNegativeTestJSON-1406242964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:02:32Z,user_data=None,user_id='bec5e110057b47ac89c85ca77aaa56ec',uuid=7d58e89e-b41f-4eb8-9e92-02e0d017d3fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "address": "fa:16:3e:af:d4:e8", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48add70-d2", "ovs_interfaceid": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Converting VIF {"id": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "address": "fa:16:3e:af:d4:e8", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48add70-d2", "ovs_interfaceid": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:d4:e8,bridge_name='br-int',has_traffic_filtering=True,id=f48add70-d28e-43ed-8bc8-cdb69f2b3cee,network=Network(ab7aa0ea-4c08-4d4a-b74c-c47298834061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48add70-d2') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.objects.instance [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.compute.manager [req-edbaac1c-21e6-4115-b2be-2b50c06c88b3 req-910bc500-5938-4477-ab09-d9a3dcd32da1 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Received event network-changed-f48add70-d28e-43ed-8bc8-cdb69f2b3cee {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.compute.manager [req-edbaac1c-21e6-4115-b2be-2b50c06c88b3 req-910bc500-5938-4477-ab09-d9a3dcd32da1 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Refreshing instance network info cache due to event network-changed-f48add70-d28e-43ed-8bc8-cdb69f2b3cee. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-edbaac1c-21e6-4115-b2be-2b50c06c88b3 req-910bc500-5938-4477-ab09-d9a3dcd32da1 service nova] Acquiring lock "refresh_cache-7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-edbaac1c-21e6-4115-b2be-2b50c06c88b3 req-910bc500-5938-4477-ab09-d9a3dcd32da1 service nova] Acquired lock "refresh_cache-7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.network.neutron [req-edbaac1c-21e6-4115-b2be-2b50c06c88b3 req-910bc500-5938-4477-ab09-d9a3dcd32da1 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Refreshing network info cache for port f48add70-d28e-43ed-8bc8-cdb69f2b3cee {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:02:33 user nova-compute[75021]:   <uuid>7d58e89e-b41f-4eb8-9e92-02e0d017d3fc</uuid>
Dec 06 07:02:33 user nova-compute[75021]:   <name>instance-0000000d</name>
Dec 06 07:02:33 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:02:33 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:02:33 user nova-compute[75021]:   <metadata>
Dec 06 07:02:33 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:02:33 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:02:33 user nova-compute[75021]:       <nova:name>tempest-ServersNegativeTestJSON-server-1597141069</nova:name>
Dec 06 07:02:33 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:02:33</nova:creationTime>
Dec 06 07:02:33 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:02:33 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:02:33 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:02:33 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:02:33 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:02:33 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:02:33 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:02:33 user nova-compute[75021]:       <nova:owner>
Dec 06 07:02:33 user nova-compute[75021]:         <nova:user uuid="bec5e110057b47ac89c85ca77aaa56ec">tempest-ServersNegativeTestJSON-1406242964-project-member</nova:user>
Dec 06 07:02:33 user nova-compute[75021]:         <nova:project uuid="70aa47164bdf43a78448ce550774cc70">tempest-ServersNegativeTestJSON-1406242964</nova:project>
Dec 06 07:02:33 user nova-compute[75021]:       </nova:owner>
Dec 06 07:02:33 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:02:33 user nova-compute[75021]:       <nova:ports>
Dec 06 07:02:33 user nova-compute[75021]:         <nova:port uuid="f48add70-d28e-43ed-8bc8-cdb69f2b3cee">
Dec 06 07:02:33 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 07:02:33 user nova-compute[75021]:         </nova:port>
Dec 06 07:02:33 user nova-compute[75021]:       </nova:ports>
Dec 06 07:02:33 user nova-compute[75021]:     </nova:instance>
Dec 06 07:02:33 user nova-compute[75021]:   </metadata>
Dec 06 07:02:33 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:02:33 user nova-compute[75021]:     <system>
Dec 06 07:02:33 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:02:33 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:02:33 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:02:33 user nova-compute[75021]:       <entry name="serial">7d58e89e-b41f-4eb8-9e92-02e0d017d3fc</entry>
Dec 06 07:02:33 user nova-compute[75021]:       <entry name="uuid">7d58e89e-b41f-4eb8-9e92-02e0d017d3fc</entry>
Dec 06 07:02:33 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:02:33 user nova-compute[75021]:     </system>
Dec 06 07:02:33 user nova-compute[75021]:   </sysinfo>
Dec 06 07:02:33 user nova-compute[75021]:   <os>
Dec 06 07:02:33 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:02:33 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:02:33 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:02:33 user nova-compute[75021]:   </os>
Dec 06 07:02:33 user nova-compute[75021]:   <features>
Dec 06 07:02:33 user nova-compute[75021]:     <acpi/>
Dec 06 07:02:33 user nova-compute[75021]:     <apic/>
Dec 06 07:02:33 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:02:33 user nova-compute[75021]:   </features>
Dec 06 07:02:33 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:02:33 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:02:33 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:02:33 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:02:33 user nova-compute[75021]:   </clock>
Dec 06 07:02:33 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:02:33 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:02:33 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:02:33 user nova-compute[75021]:   </cpu>
Dec 06 07:02:33 user nova-compute[75021]:   <devices>
Dec 06 07:02:33 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:02:33 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:02:33 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk"/>
Dec 06 07:02:33 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:02:33 user nova-compute[75021]:     </disk>
Dec 06 07:02:33 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:02:33 user nova-compute[75021]:       <mac address="fa:16:3e:af:d4:e8"/>
Dec 06 07:02:33 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:02:33 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:02:33 user nova-compute[75021]:       <target dev="tapf48add70-d2"/>
Dec 06 07:02:33 user nova-compute[75021]:     </interface>
Dec 06 07:02:33 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:02:33 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/console.log" append="off"/>
Dec 06 07:02:33 user nova-compute[75021]:     </serial>
Dec 06 07:02:33 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:02:33 user nova-compute[75021]:     <video>
Dec 06 07:02:33 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:02:33 user nova-compute[75021]:     </video>
Dec 06 07:02:33 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:02:33 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:02:33 user nova-compute[75021]:     </rng>
Dec 06 07:02:33 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:02:33 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:02:33 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:02:33 user nova-compute[75021]:     </memballoon>
Dec 06 07:02:33 user nova-compute[75021]:   </devices>
Dec 06 07:02:33 user nova-compute[75021]: </domain>
Dec 06 07:02:33 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1597141069',display_name='tempest-ServersNegativeTestJSON-server-1597141069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1597141069',id=13,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70aa47164bdf43a78448ce550774cc70',ramdisk_id='',reservation_id='r-n6mzvwwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1406242964',owner_user_name='tempest-ServersNegativeTestJSON-1406242964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:02:32Z,user_data=None,user_id='bec5e110057b47ac89c85ca77aaa56ec',uuid=7d58e89e-b41f-4eb8-9e92-02e0d017d3fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "address": "fa:16:3e:af:d4:e8", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48add70-d2", "ovs_interfaceid": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Converting VIF {"id": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "address": "fa:16:3e:af:d4:e8", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48add70-d2", "ovs_interfaceid": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:d4:e8,bridge_name='br-int',has_traffic_filtering=True,id=f48add70-d28e-43ed-8bc8-cdb69f2b3cee,network=Network(ab7aa0ea-4c08-4d4a-b74c-c47298834061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48add70-d2') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG os_vif [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:d4:e8,bridge_name='br-int',has_traffic_filtering=True,id=f48add70-d28e-43ed-8bc8-cdb69f2b3cee,network=Network(ab7aa0ea-4c08-4d4a-b74c-c47298834061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48add70-d2') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ce50b1b-2133-5e63-b43b-92087c320bf4', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf48add70-d2, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf48add70-d2, col_values=(('qos', UUID('b0b29615-fb8c-405a-948e-695ee424a8ab')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf48add70-d2, col_values=(('external_ids', {'iface-id': 'f48add70-d28e-43ed-8bc8-cdb69f2b3cee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:d4:e8', 'vm-uuid': '7d58e89e-b41f-4eb8-9e92-02e0d017d3fc'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:02:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:33 user nova-compute[75021]: INFO os_vif [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:d4:e8,bridge_name='br-int',has_traffic_filtering=True,id=f48add70-d28e-43ed-8bc8-cdb69f2b3cee,network=Network(ab7aa0ea-4c08-4d4a-b74c-c47298834061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48add70-d2')
Dec 06 07:02:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:02:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] No VIF found with MAC fa:16:3e:af:d4:e8, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:02:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-edbaac1c-21e6-4115-b2be-2b50c06c88b3 req-910bc500-5938-4477-ab09-d9a3dcd32da1 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Updated VIF entry in instance network info cache for port f48add70-d28e-43ed-8bc8-cdb69f2b3cee. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:02:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-edbaac1c-21e6-4115-b2be-2b50c06c88b3 req-910bc500-5938-4477-ab09-d9a3dcd32da1 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Updating instance_info_cache with network_info: [{"id": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "address": "fa:16:3e:af:d4:e8", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48add70-d2", "ovs_interfaceid": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:02:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-edbaac1c-21e6-4115-b2be-2b50c06c88b3 req-910bc500-5938-4477-ab09-d9a3dcd32da1 service nova] Releasing lock "refresh_cache-7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:02:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-225253c6-454a-496b-bbdf-d3942da649fd req-a4a0ac5a-ae64-417d-98fc-9d40696df069 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Received event network-vif-plugged-f48add70-d28e-43ed-8bc8-cdb69f2b3cee {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-225253c6-454a-496b-bbdf-d3942da649fd req-a4a0ac5a-ae64-417d-98fc-9d40696df069 service nova] Acquiring lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-225253c6-454a-496b-bbdf-d3942da649fd req-a4a0ac5a-ae64-417d-98fc-9d40696df069 service nova] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-225253c6-454a-496b-bbdf-d3942da649fd req-a4a0ac5a-ae64-417d-98fc-9d40696df069 service nova] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-225253c6-454a-496b-bbdf-d3942da649fd req-a4a0ac5a-ae64-417d-98fc-9d40696df069 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] No waiting events found dispatching network-vif-plugged-f48add70-d28e-43ed-8bc8-cdb69f2b3cee {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:02:35 user nova-compute[75021]: WARNING nova.compute.manager [req-225253c6-454a-496b-bbdf-d3942da649fd req-a4a0ac5a-ae64-417d-98fc-9d40696df069 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Received unexpected event network-vif-plugged-f48add70-d28e-43ed-8bc8-cdb69f2b3cee for instance with vm_state building and task_state spawning.
Dec 06 07:02:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:37 user nova-compute[75021]: DEBUG nova.compute.manager [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:02:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:02:37 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Instance spawned successfully.
Dec 06 07:02:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:02:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:37 user nova-compute[75021]: INFO nova.compute.manager [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Took 5.71 seconds to spawn the instance on the hypervisor.
Dec 06 07:02:37 user nova-compute[75021]: DEBUG nova.compute.manager [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:02:37 user nova-compute[75021]: INFO nova.compute.manager [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Took 6.61 seconds to build instance.
Dec 06 07:02:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-724d3ed0-75a1-4ffd-9f9c-e025af4bc57b tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.726s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-1cf202cf-e66e-49a1-b605-b66aaed483bc req-e61648d5-adf6-48e6-976e-9f9bc686cc12 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Received event network-vif-plugged-f48add70-d28e-43ed-8bc8-cdb69f2b3cee {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1cf202cf-e66e-49a1-b605-b66aaed483bc req-e61648d5-adf6-48e6-976e-9f9bc686cc12 service nova] Acquiring lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1cf202cf-e66e-49a1-b605-b66aaed483bc req-e61648d5-adf6-48e6-976e-9f9bc686cc12 service nova] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1cf202cf-e66e-49a1-b605-b66aaed483bc req-e61648d5-adf6-48e6-976e-9f9bc686cc12 service nova] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-1cf202cf-e66e-49a1-b605-b66aaed483bc req-e61648d5-adf6-48e6-976e-9f9bc686cc12 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] No waiting events found dispatching network-vif-plugged-f48add70-d28e-43ed-8bc8-cdb69f2b3cee {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:02:37 user nova-compute[75021]: WARNING nova.compute.manager [req-1cf202cf-e66e-49a1-b605-b66aaed483bc req-e61648d5-adf6-48e6-976e-9f9bc686cc12 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Received unexpected event network-vif-plugged-f48add70-d28e-43ed-8bc8-cdb69f2b3cee for instance with vm_state active and task_state None.
Dec 06 07:02:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:02:38 user nova-compute[75021]: INFO nova.compute.claims [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Claim successful on node user
Dec 06 07:02:38 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Waiting for libvirt event about the detach of device tap0e389dcb-c0 with device alias net1 from instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c is timed out.
Dec 06 07:02:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6a:99:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap0e389dcb-c0"/></interface> {{(pid=75021) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6a:99:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap0e389dcb-c0"/></interface>not found in domain: <domain type='kvm' id='9'>
Dec 06 07:02:38 user nova-compute[75021]:   <name>instance-00000008</name>
Dec 06 07:02:38 user nova-compute[75021]:   <uuid>91eeb5a9-b6de-40c0-bc37-49768cc15c9c</uuid>
Dec 06 07:02:38 user nova-compute[75021]:   <metadata>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:02:38 user nova-compute[75021]:   <nova:package version="0.0.0"/>
Dec 06 07:02:38 user nova-compute[75021]:   <nova:name>tempest-device-tagging-server-9053064</nova:name>
Dec 06 07:02:38 user nova-compute[75021]:   <nova:creationTime>2023-12-06 07:01:36</nova:creationTime>
Dec 06 07:02:38 user nova-compute[75021]:   <nova:flavor name="m1.tiny">
Dec 06 07:02:38 user nova-compute[75021]:     <nova:memory>512</nova:memory>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:disk>1</nova:disk>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:swap>0</nova:swap>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:vcpus>1</nova:vcpus>
Dec 06 07:02:38 user nova-compute[75021]:   </nova:flavor>
Dec 06 07:02:38 user nova-compute[75021]:   <nova:owner>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:user uuid="f2de88a1aa57403e8c6614458998b059">tempest-TaggedAttachmentsTest-1423166060-project-member</nova:user>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:project uuid="eb6fd76416e04d298f16ae4dffbb2191">tempest-TaggedAttachmentsTest-1423166060</nova:project>
Dec 06 07:02:38 user nova-compute[75021]:   </nova:owner>
Dec 06 07:02:38 user nova-compute[75021]:   <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:02:38 user nova-compute[75021]:   <nova:ports>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:port uuid="94173bea-6e40-4bcc-afe0-031fb7fde7fa">
Dec 06 07:02:38 user nova-compute[75021]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 07:02:38 user nova-compute[75021]:     </nova:port>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:port uuid="0e389dcb-c0a8-47b6-997f-8af8932019e0">
Dec 06 07:02:38 user nova-compute[75021]:       <nova:ip type="fixed" address="10.10.10.117" ipVersion="4"/>
Dec 06 07:02:38 user nova-compute[75021]:     </nova:port>
Dec 06 07:02:38 user nova-compute[75021]:   </nova:ports>
Dec 06 07:02:38 user nova-compute[75021]: </nova:instance>
Dec 06 07:02:38 user nova-compute[75021]:   </metadata>
Dec 06 07:02:38 user nova-compute[75021]:   <memory unit='KiB'>524288</memory>
Dec 06 07:02:38 user nova-compute[75021]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 06 07:02:38 user nova-compute[75021]:   <vcpu placement='static'>1</vcpu>
Dec 06 07:02:38 user nova-compute[75021]:   <resource>
Dec 06 07:02:38 user nova-compute[75021]:     <partition>/machine</partition>
Dec 06 07:02:38 user nova-compute[75021]:   </resource>
Dec 06 07:02:38 user nova-compute[75021]:   <sysinfo type='smbios'>
Dec 06 07:02:38 user nova-compute[75021]:     <system>
Dec 06 07:02:38 user nova-compute[75021]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 06 07:02:38 user nova-compute[75021]:       <entry name='product'>OpenStack Nova</entry>
Dec 06 07:02:38 user nova-compute[75021]:       <entry name='version'>0.0.0</entry>
Dec 06 07:02:38 user nova-compute[75021]:       <entry name='serial'>91eeb5a9-b6de-40c0-bc37-49768cc15c9c</entry>
Dec 06 07:02:38 user nova-compute[75021]:       <entry name='uuid'>91eeb5a9-b6de-40c0-bc37-49768cc15c9c</entry>
Dec 06 07:02:38 user nova-compute[75021]:       <entry name='family'>Virtual Machine</entry>
Dec 06 07:02:38 user nova-compute[75021]:     </system>
Dec 06 07:02:38 user nova-compute[75021]:   </sysinfo>
Dec 06 07:02:38 user nova-compute[75021]:   <os>
Dec 06 07:02:38 user nova-compute[75021]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 06 07:02:38 user nova-compute[75021]:     <boot dev='hd'/>
Dec 06 07:02:38 user nova-compute[75021]:     <smbios mode='sysinfo'/>
Dec 06 07:02:38 user nova-compute[75021]:   </os>
Dec 06 07:02:38 user nova-compute[75021]:   <features>
Dec 06 07:02:38 user nova-compute[75021]:     <acpi/>
Dec 06 07:02:38 user nova-compute[75021]:     <apic/>
Dec 06 07:02:38 user nova-compute[75021]:     <vmcoreinfo state='on'/>
Dec 06 07:02:38 user nova-compute[75021]:   </features>
Dec 06 07:02:38 user nova-compute[75021]:   <cpu mode='custom' match='exact' check='full'>
Dec 06 07:02:38 user nova-compute[75021]:     <model fallback='forbid'>Nehalem</model>
Dec 06 07:02:38 user nova-compute[75021]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 06 07:02:38 user nova-compute[75021]:     <feature policy='require' name='vme'/>
Dec 06 07:02:38 user nova-compute[75021]:     <feature policy='require' name='x2apic'/>
Dec 06 07:02:38 user nova-compute[75021]:     <feature policy='require' name='hypervisor'/>
Dec 06 07:02:38 user nova-compute[75021]:   </cpu>
Dec 06 07:02:38 user nova-compute[75021]:   <clock offset='utc'>
Dec 06 07:02:38 user nova-compute[75021]:     <timer name='pit' tickpolicy='delay'/>
Dec 06 07:02:38 user nova-compute[75021]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 06 07:02:38 user nova-compute[75021]:     <timer name='hpet' present='no'/>
Dec 06 07:02:38 user nova-compute[75021]:   </clock>
Dec 06 07:02:38 user nova-compute[75021]:   <on_poweroff>destroy</on_poweroff>
Dec 06 07:02:38 user nova-compute[75021]:   <on_reboot>restart</on_reboot>
Dec 06 07:02:38 user nova-compute[75021]:   <on_crash>destroy</on_crash>
Dec 06 07:02:38 user nova-compute[75021]:   <devices>
Dec 06 07:02:38 user nova-compute[75021]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 06 07:02:38 user nova-compute[75021]:     <disk type='file' device='disk'>
Dec 06 07:02:38 user nova-compute[75021]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 06 07:02:38 user nova-compute[75021]:       <source file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk' index='2'/>
Dec 06 07:02:38 user nova-compute[75021]:       <backingStore type='file' index='3'>
Dec 06 07:02:38 user nova-compute[75021]:         <format type='raw'/>
Dec 06 07:02:38 user nova-compute[75021]:         <source file='/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe'/>
Dec 06 07:02:38 user nova-compute[75021]:         <backingStore/>
Dec 06 07:02:38 user nova-compute[75021]:       </backingStore>
Dec 06 07:02:38 user nova-compute[75021]:       <target dev='vda' bus='virtio'/>
Dec 06 07:02:38 user nova-compute[75021]:       <alias name='virtio-disk0'/>
Dec 06 07:02:38 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 06 07:02:38 user nova-compute[75021]:     </disk>
Dec 06 07:02:38 user nova-compute[75021]:     <disk type='file' device='cdrom'>
Dec 06 07:02:38 user nova-compute[75021]:       <driver name='qemu' type='raw' cache='none'/>
Dec 06 07:02:38 user nova-compute[75021]:       <source file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk.config' index='1'/>
Dec 06 07:02:38 user nova-compute[75021]:       <backingStore/>
Dec 06 07:02:38 user nova-compute[75021]:       <target dev='hda' bus='ide'/>
Dec 06 07:02:38 user nova-compute[75021]:       <readonly/>
Dec 06 07:02:38 user nova-compute[75021]:       <alias name='ide0-0-0'/>
Dec 06 07:02:38 user nova-compute[75021]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 06 07:02:38 user nova-compute[75021]:     </disk>
Dec 06 07:02:38 user nova-compute[75021]:     <controller type='usb' index='0' model='none'>
Dec 06 07:02:38 user nova-compute[75021]:       <alias name='usb'/>
Dec 06 07:02:38 user nova-compute[75021]:     </controller>
Dec 06 07:02:38 user nova-compute[75021]:     <controller type='pci' index='0' model='pci-root'>
Dec 06 07:02:38 user nova-compute[75021]:       <alias name='pci.0'/>
Dec 06 07:02:38 user nova-compute[75021]:     </controller>
Dec 06 07:02:38 user nova-compute[75021]:     <controller type='ide' index='0'>
Dec 06 07:02:38 user nova-compute[75021]:       <alias name='ide'/>
Dec 06 07:02:38 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 06 07:02:38 user nova-compute[75021]:     </controller>
Dec 06 07:02:38 user nova-compute[75021]:     <interface type='ethernet'>
Dec 06 07:02:38 user nova-compute[75021]:       <mac address='fa:16:3e:91:f2:66'/>
Dec 06 07:02:38 user nova-compute[75021]:       <target dev='tap94173bea-6e'/>
Dec 06 07:02:38 user nova-compute[75021]:       <model type='virtio'/>
Dec 06 07:02:38 user nova-compute[75021]:       <mtu size='1442'/>
Dec 06 07:02:38 user nova-compute[75021]:       <alias name='net0'/>
Dec 06 07:02:38 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 06 07:02:38 user nova-compute[75021]:     </interface>
Dec 06 07:02:38 user nova-compute[75021]:     <serial type='pty'>
Dec 06 07:02:38 user nova-compute[75021]:       <source path='/dev/pts/8'/>
Dec 06 07:02:38 user nova-compute[75021]:       <log file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/console.log' append='off'/>
Dec 06 07:02:38 user nova-compute[75021]:       <target type='isa-serial' port='0'>
Dec 06 07:02:38 user nova-compute[75021]:         <model name='isa-serial'/>
Dec 06 07:02:38 user nova-compute[75021]:       </target>
Dec 06 07:02:38 user nova-compute[75021]:       <alias name='serial0'/>
Dec 06 07:02:38 user nova-compute[75021]:     </serial>
Dec 06 07:02:38 user nova-compute[75021]:     <console type='pty' tty='/dev/pts/8'>
Dec 06 07:02:38 user nova-compute[75021]:       <source path='/dev/pts/8'/>
Dec 06 07:02:38 user nova-compute[75021]:       <log file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/console.log' append='off'/>
Dec 06 07:02:38 user nova-compute[75021]:       <target type='serial' port='0'/>
Dec 06 07:02:38 user nova-compute[75021]:       <alias name='serial0'/>
Dec 06 07:02:38 user nova-compute[75021]:     </console>
Dec 06 07:02:38 user nova-compute[75021]:     <input type='mouse' bus='ps2'>
Dec 06 07:02:38 user nova-compute[75021]:       <alias name='input0'/>
Dec 06 07:02:38 user nova-compute[75021]:     </input>
Dec 06 07:02:38 user nova-compute[75021]:     <input type='keyboard' bus='ps2'>
Dec 06 07:02:38 user nova-compute[75021]:       <alias name='input1'/>
Dec 06 07:02:38 user nova-compute[75021]:     </input>
Dec 06 07:02:38 user nova-compute[75021]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Dec 06 07:02:38 user nova-compute[75021]:       <listen type='address' address='0.0.0.0'/>
Dec 06 07:02:38 user nova-compute[75021]:     </graphics>
Dec 06 07:02:38 user nova-compute[75021]:     <audio id='1' type='none'/>
Dec 06 07:02:38 user nova-compute[75021]:     <video>
Dec 06 07:02:38 user nova-compute[75021]:       <model type='virtio' heads='1' primary='yes'/>
Dec 06 07:02:38 user nova-compute[75021]:       <alias name='video0'/>
Dec 06 07:02:38 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 06 07:02:38 user nova-compute[75021]:     </video>
Dec 06 07:02:38 user nova-compute[75021]:     <memballoon model='virtio'>
Dec 06 07:02:38 user nova-compute[75021]:       <stats period='10'/>
Dec 06 07:02:38 user nova-compute[75021]:       <alias name='balloon0'/>
Dec 06 07:02:38 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 06 07:02:38 user nova-compute[75021]:     </memballoon>
Dec 06 07:02:38 user nova-compute[75021]:     <rng model='virtio'>
Dec 06 07:02:38 user nova-compute[75021]:       <backend model='random'>/dev/urandom</backend>
Dec 06 07:02:38 user nova-compute[75021]:       <alias name='rng0'/>
Dec 06 07:02:38 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 06 07:02:38 user nova-compute[75021]:     </rng>
Dec 06 07:02:38 user nova-compute[75021]:   </devices>
Dec 06 07:02:38 user nova-compute[75021]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 06 07:02:38 user nova-compute[75021]:     <label>libvirt-91eeb5a9-b6de-40c0-bc37-49768cc15c9c</label>
Dec 06 07:02:38 user nova-compute[75021]:     <imagelabel>libvirt-91eeb5a9-b6de-40c0-bc37-49768cc15c9c</imagelabel>
Dec 06 07:02:38 user nova-compute[75021]:   </seclabel>
Dec 06 07:02:38 user nova-compute[75021]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 06 07:02:38 user nova-compute[75021]:     <label>+64055:+108</label>
Dec 06 07:02:38 user nova-compute[75021]:     <imagelabel>+64055:+108</imagelabel>
Dec 06 07:02:38 user nova-compute[75021]:   </seclabel>
Dec 06 07:02:38 user nova-compute[75021]: </domain>
Dec 06 07:02:38 user nova-compute[75021]:  {{(pid=75021) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 06 07:02:38 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Successfully detached device tap0e389dcb-c0 from instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c from the live domain config.
Dec 06 07:02:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T06:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9053064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9053064',id=8,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfxPXtIc47E18m6Z4qikWqTz2rTTY3bjnRhlRvdXGj9tpXYrXf76otmdZT3oE+W47oRVEPxUwhFLz0Caec3zbc1/KigN/WcfjgJ+3ELWkAH6KQ8DaAIyV9KAyPj8VZgwQ==',key_name='tempest-keypair-399869130',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb6fd76416e04d298f16ae4dffbb2191',ramdisk_id='',reservation_id='r-21w39m30',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1423166060',owner_user_name='tempest-TaggedAttachmentsTest-1423166060-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T06:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2de88a1aa57403e8c6614458998b059',uuid=91eeb5a9-b6de-40c0-bc37-49768cc15c9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "address": "fa:16:3e:6a:99:11", "network": {"id": "b25b1d3d-788d-4093-9933-d13031e93c63", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-721588809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e389dcb-c0", "ovs_interfaceid": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Converting VIF {"id": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "address": "fa:16:3e:6a:99:11", "network": {"id": "b25b1d3d-788d-4093-9933-d13031e93c63", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-721588809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e389dcb-c0", "ovs_interfaceid": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:99:11,bridge_name='br-int',has_traffic_filtering=True,id=0e389dcb-c0a8-47b6-997f-8af8932019e0,network=Network(b25b1d3d-788d-4093-9933-d13031e93c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e389dcb-c0') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG os_vif [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:99:11,bridge_name='br-int',has_traffic_filtering=True,id=0e389dcb-c0a8-47b6-997f-8af8932019e0,network=Network(b25b1d3d-788d-4093-9933-d13031e93c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e389dcb-c0') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e389dcb-c0, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93ecf498-d226-4e24-b329-57ef77d582d9) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:02:38 user nova-compute[75021]: INFO os_vif [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:99:11,bridge_name='br-int',has_traffic_filtering=True,id=0e389dcb-c0a8-47b6-997f-8af8932019e0,network=Network(b25b1d3d-788d-4093-9933-d13031e93c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e389dcb-c0')
Dec 06 07:02:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:02:38 user nova-compute[75021]:   <nova:package version="0.0.0"/>
Dec 06 07:02:38 user nova-compute[75021]:   <nova:name>tempest-device-tagging-server-9053064</nova:name>
Dec 06 07:02:38 user nova-compute[75021]:   <nova:creationTime>2023-12-06 07:02:38</nova:creationTime>
Dec 06 07:02:38 user nova-compute[75021]:   <nova:flavor name="m1.tiny">
Dec 06 07:02:38 user nova-compute[75021]:     <nova:memory>512</nova:memory>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:disk>1</nova:disk>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:swap>0</nova:swap>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:vcpus>1</nova:vcpus>
Dec 06 07:02:38 user nova-compute[75021]:   </nova:flavor>
Dec 06 07:02:38 user nova-compute[75021]:   <nova:owner>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:user uuid="f2de88a1aa57403e8c6614458998b059">tempest-TaggedAttachmentsTest-1423166060-project-member</nova:user>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:project uuid="eb6fd76416e04d298f16ae4dffbb2191">tempest-TaggedAttachmentsTest-1423166060</nova:project>
Dec 06 07:02:38 user nova-compute[75021]:   </nova:owner>
Dec 06 07:02:38 user nova-compute[75021]:   <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:02:38 user nova-compute[75021]:   <nova:ports>
Dec 06 07:02:38 user nova-compute[75021]:     <nova:port uuid="94173bea-6e40-4bcc-afe0-031fb7fde7fa">
Dec 06 07:02:38 user nova-compute[75021]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 07:02:38 user nova-compute[75021]:     </nova:port>
Dec 06 07:02:38 user nova-compute[75021]:   </nova:ports>
Dec 06 07:02:38 user nova-compute[75021]: </nova:instance>
Dec 06 07:02:38 user nova-compute[75021]:  {{(pid=75021) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:02:38 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG nova.compute.manager [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG nova.compute.manager [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG nova.network.neutron [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:02:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:02:39 user nova-compute[75021]: DEBUG nova.compute.manager [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG nova.policy [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b2add3b5bca409e89667f7508b8450f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e72540b430409b954290965f157c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquired lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG nova.network.neutron [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG nova.compute.manager [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:02:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Creating image(s)
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "/opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "/opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "/opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.229s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.205s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG nova.network.neutron [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Successfully created port: 6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk 1073741824" returned: 0 in 0.074s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received event network-vif-deleted-0e389dcb-c0a8-47b6-997f-8af8932019e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:40 user nova-compute[75021]: INFO nova.compute.manager [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Neutron deleted interface 0e389dcb-c0a8-47b6-997f-8af8932019e0; detaching it from the instance and deleting it from the info cache
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Updating instance_info_cache with network_info: [{"id": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "address": "fa:16:3e:91:f2:66", "network": {"id": "ad977a07-4f22-4e25-a953-2c36fdc6aafd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-324709235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94173bea-6e", "ovs_interfaceid": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.230s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.objects.instance [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] Lazy-loading 'system_metadata' on Instance uuid 91eeb5a9-b6de-40c0-bc37-49768cc15c9c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:02:40 user nova-compute[75021]: INFO nova.network.neutron [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Port 0e389dcb-c0a8-47b6-997f-8af8932019e0 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Updating instance_info_cache with network_info: [{"id": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "address": "fa:16:3e:91:f2:66", "network": {"id": "ad977a07-4f22-4e25-a953-2c36fdc6aafd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-324709235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94173bea-6e", "ovs_interfaceid": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Releasing lock "refresh_cache-91eeb5a9-b6de-40c0-bc37-49768cc15c9c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.objects.instance [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] Lazy-loading 'flavor' on Instance uuid 91eeb5a9-b6de-40c0-bc37-49768cc15c9c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-50c3b846-5032-438b-92e3-bf4bac7b10f2 tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "interface-91eeb5a9-b6de-40c0-bc37-49768cc15c9c-0e389dcb-c0a8-47b6-997f-8af8932019e0" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.091s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.objects.base [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] Object Instance<91eeb5a9-b6de-40c0-bc37-49768cc15c9c> lazy-loaded attributes: system_metadata,flavor {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T06:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9053064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9053064',id=8,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfxPXtIc47E18m6Z4qikWqTz2rTTY3bjnRhlRvdXGj9tpXYrXf76otmdZT3oE+W47oRVEPxUwhFLz0Caec3zbc1/KigN/WcfjgJ+3ELWkAH6KQ8DaAIyV9KAyPj8VZgwQ==',key_name='tempest-keypair-399869130',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb6fd76416e04d298f16ae4dffbb2191',ramdisk_id='',reservation_id='r-21w39m30',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1423166060',owner_user_name='tempest-TaggedAttachmentsTest-1423166060-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T06:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2de88a1aa57403e8c6614458998b059',uuid=91eeb5a9-b6de-40c0-bc37-49768cc15c9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "address": "fa:16:3e:6a:99:11", "network": {"id": "b25b1d3d-788d-4093-9933-d13031e93c63", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-721588809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e389dcb-c0", "ovs_interfaceid": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] Converting VIF {"id": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "address": "fa:16:3e:6a:99:11", "network": {"id": "b25b1d3d-788d-4093-9933-d13031e93c63", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-721588809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e389dcb-c0", "ovs_interfaceid": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:99:11,bridge_name='br-int',has_traffic_filtering=True,id=0e389dcb-c0a8-47b6-997f-8af8932019e0,network=Network(b25b1d3d-788d-4093-9933-d13031e93c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e389dcb-c0') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6a:99:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap0e389dcb-c0"/></interface> {{(pid=75021) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6a:99:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap0e389dcb-c0"/></interface>not found in domain: <domain type='kvm' id='9'>
Dec 06 07:02:40 user nova-compute[75021]:   <name>instance-00000008</name>
Dec 06 07:02:40 user nova-compute[75021]:   <uuid>91eeb5a9-b6de-40c0-bc37-49768cc15c9c</uuid>
Dec 06 07:02:40 user nova-compute[75021]:   <metadata>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:02:40 user nova-compute[75021]:   <nova:package version="0.0.0"/>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:name>tempest-device-tagging-server-9053064</nova:name>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:creationTime>2023-12-06 07:02:38</nova:creationTime>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:flavor name="m1.tiny">
Dec 06 07:02:40 user nova-compute[75021]:     <nova:memory>512</nova:memory>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:disk>1</nova:disk>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:swap>0</nova:swap>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:vcpus>1</nova:vcpus>
Dec 06 07:02:40 user nova-compute[75021]:   </nova:flavor>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:owner>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:user uuid="f2de88a1aa57403e8c6614458998b059">tempest-TaggedAttachmentsTest-1423166060-project-member</nova:user>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:project uuid="eb6fd76416e04d298f16ae4dffbb2191">tempest-TaggedAttachmentsTest-1423166060</nova:project>
Dec 06 07:02:40 user nova-compute[75021]:   </nova:owner>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:ports>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:port uuid="94173bea-6e40-4bcc-afe0-031fb7fde7fa">
Dec 06 07:02:40 user nova-compute[75021]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 07:02:40 user nova-compute[75021]:     </nova:port>
Dec 06 07:02:40 user nova-compute[75021]:   </nova:ports>
Dec 06 07:02:40 user nova-compute[75021]: </nova:instance>
Dec 06 07:02:40 user nova-compute[75021]:   </metadata>
Dec 06 07:02:40 user nova-compute[75021]:   <memory unit='KiB'>524288</memory>
Dec 06 07:02:40 user nova-compute[75021]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 06 07:02:40 user nova-compute[75021]:   <vcpu placement='static'>1</vcpu>
Dec 06 07:02:40 user nova-compute[75021]:   <resource>
Dec 06 07:02:40 user nova-compute[75021]:     <partition>/machine</partition>
Dec 06 07:02:40 user nova-compute[75021]:   </resource>
Dec 06 07:02:40 user nova-compute[75021]:   <sysinfo type='smbios'>
Dec 06 07:02:40 user nova-compute[75021]:     <system>
Dec 06 07:02:40 user nova-compute[75021]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 06 07:02:40 user nova-compute[75021]:       <entry name='product'>OpenStack Nova</entry>
Dec 06 07:02:40 user nova-compute[75021]:       <entry name='version'>0.0.0</entry>
Dec 06 07:02:40 user nova-compute[75021]:       <entry name='serial'>91eeb5a9-b6de-40c0-bc37-49768cc15c9c</entry>
Dec 06 07:02:40 user nova-compute[75021]:       <entry name='uuid'>91eeb5a9-b6de-40c0-bc37-49768cc15c9c</entry>
Dec 06 07:02:40 user nova-compute[75021]:       <entry name='family'>Virtual Machine</entry>
Dec 06 07:02:40 user nova-compute[75021]:     </system>
Dec 06 07:02:40 user nova-compute[75021]:   </sysinfo>
Dec 06 07:02:40 user nova-compute[75021]:   <os>
Dec 06 07:02:40 user nova-compute[75021]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 06 07:02:40 user nova-compute[75021]:     <boot dev='hd'/>
Dec 06 07:02:40 user nova-compute[75021]:     <smbios mode='sysinfo'/>
Dec 06 07:02:40 user nova-compute[75021]:   </os>
Dec 06 07:02:40 user nova-compute[75021]:   <features>
Dec 06 07:02:40 user nova-compute[75021]:     <acpi/>
Dec 06 07:02:40 user nova-compute[75021]:     <apic/>
Dec 06 07:02:40 user nova-compute[75021]:     <vmcoreinfo state='on'/>
Dec 06 07:02:40 user nova-compute[75021]:   </features>
Dec 06 07:02:40 user nova-compute[75021]:   <cpu mode='custom' match='exact' check='full'>
Dec 06 07:02:40 user nova-compute[75021]:     <model fallback='forbid'>Nehalem</model>
Dec 06 07:02:40 user nova-compute[75021]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 06 07:02:40 user nova-compute[75021]:     <feature policy='require' name='vme'/>
Dec 06 07:02:40 user nova-compute[75021]:     <feature policy='require' name='x2apic'/>
Dec 06 07:02:40 user nova-compute[75021]:     <feature policy='require' name='hypervisor'/>
Dec 06 07:02:40 user nova-compute[75021]:   </cpu>
Dec 06 07:02:40 user nova-compute[75021]:   <clock offset='utc'>
Dec 06 07:02:40 user nova-compute[75021]:     <timer name='pit' tickpolicy='delay'/>
Dec 06 07:02:40 user nova-compute[75021]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 06 07:02:40 user nova-compute[75021]:     <timer name='hpet' present='no'/>
Dec 06 07:02:40 user nova-compute[75021]:   </clock>
Dec 06 07:02:40 user nova-compute[75021]:   <on_poweroff>destroy</on_poweroff>
Dec 06 07:02:40 user nova-compute[75021]:   <on_reboot>restart</on_reboot>
Dec 06 07:02:40 user nova-compute[75021]:   <on_crash>destroy</on_crash>
Dec 06 07:02:40 user nova-compute[75021]:   <devices>
Dec 06 07:02:40 user nova-compute[75021]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 06 07:02:40 user nova-compute[75021]:     <disk type='file' device='disk'>
Dec 06 07:02:40 user nova-compute[75021]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 06 07:02:40 user nova-compute[75021]:       <source file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk' index='2'/>
Dec 06 07:02:40 user nova-compute[75021]:       <backingStore type='file' index='3'>
Dec 06 07:02:40 user nova-compute[75021]:         <format type='raw'/>
Dec 06 07:02:40 user nova-compute[75021]:         <source file='/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe'/>
Dec 06 07:02:40 user nova-compute[75021]:         <backingStore/>
Dec 06 07:02:40 user nova-compute[75021]:       </backingStore>
Dec 06 07:02:40 user nova-compute[75021]:       <target dev='vda' bus='virtio'/>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='virtio-disk0'/>
Dec 06 07:02:40 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </disk>
Dec 06 07:02:40 user nova-compute[75021]:     <disk type='file' device='cdrom'>
Dec 06 07:02:40 user nova-compute[75021]:       <driver name='qemu' type='raw' cache='none'/>
Dec 06 07:02:40 user nova-compute[75021]:       <source file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk.config' index='1'/>
Dec 06 07:02:40 user nova-compute[75021]:       <backingStore/>
Dec 06 07:02:40 user nova-compute[75021]:       <target dev='hda' bus='ide'/>
Dec 06 07:02:40 user nova-compute[75021]:       <readonly/>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='ide0-0-0'/>
Dec 06 07:02:40 user nova-compute[75021]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </disk>
Dec 06 07:02:40 user nova-compute[75021]:     <controller type='usb' index='0' model='none'>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='usb'/>
Dec 06 07:02:40 user nova-compute[75021]:     </controller>
Dec 06 07:02:40 user nova-compute[75021]:     <controller type='pci' index='0' model='pci-root'>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='pci.0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </controller>
Dec 06 07:02:40 user nova-compute[75021]:     <controller type='ide' index='0'>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='ide'/>
Dec 06 07:02:40 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 06 07:02:40 user nova-compute[75021]:     </controller>
Dec 06 07:02:40 user nova-compute[75021]:     <interface type='ethernet'>
Dec 06 07:02:40 user nova-compute[75021]:       <mac address='fa:16:3e:91:f2:66'/>
Dec 06 07:02:40 user nova-compute[75021]:       <target dev='tap94173bea-6e'/>
Dec 06 07:02:40 user nova-compute[75021]:       <model type='virtio'/>
Dec 06 07:02:40 user nova-compute[75021]:       <mtu size='1442'/>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='net0'/>
Dec 06 07:02:40 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </interface>
Dec 06 07:02:40 user nova-compute[75021]:     <serial type='pty'>
Dec 06 07:02:40 user nova-compute[75021]:       <source path='/dev/pts/8'/>
Dec 06 07:02:40 user nova-compute[75021]:       <log file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/console.log' append='off'/>
Dec 06 07:02:40 user nova-compute[75021]:       <target type='isa-serial' port='0'>
Dec 06 07:02:40 user nova-compute[75021]:         <model name='isa-serial'/>
Dec 06 07:02:40 user nova-compute[75021]:       </target>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='serial0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </serial>
Dec 06 07:02:40 user nova-compute[75021]:     <console type='pty' tty='/dev/pts/8'>
Dec 06 07:02:40 user nova-compute[75021]:       <source path='/dev/pts/8'/>
Dec 06 07:02:40 user nova-compute[75021]:       <log file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/console.log' append='off'/>
Dec 06 07:02:40 user nova-compute[75021]:       <target type='serial' port='0'/>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='serial0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </console>
Dec 06 07:02:40 user nova-compute[75021]:     <input type='mouse' bus='ps2'>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='input0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </input>
Dec 06 07:02:40 user nova-compute[75021]:     <input type='keyboard' bus='ps2'>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='input1'/>
Dec 06 07:02:40 user nova-compute[75021]:     </input>
Dec 06 07:02:40 user nova-compute[75021]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Dec 06 07:02:40 user nova-compute[75021]:       <listen type='address' address='0.0.0.0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </graphics>
Dec 06 07:02:40 user nova-compute[75021]:     <audio id='1' type='none'/>
Dec 06 07:02:40 user nova-compute[75021]:     <video>
Dec 06 07:02:40 user nova-compute[75021]:       <model type='virtio' heads='1' primary='yes'/>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='video0'/>
Dec 06 07:02:40 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </video>
Dec 06 07:02:40 user nova-compute[75021]:     <memballoon model='virtio'>
Dec 06 07:02:40 user nova-compute[75021]:       <stats period='10'/>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='balloon0'/>
Dec 06 07:02:40 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </memballoon>
Dec 06 07:02:40 user nova-compute[75021]:     <rng model='virtio'>
Dec 06 07:02:40 user nova-compute[75021]:       <backend model='random'>/dev/urandom</backend>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='rng0'/>
Dec 06 07:02:40 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </rng>
Dec 06 07:02:40 user nova-compute[75021]:   </devices>
Dec 06 07:02:40 user nova-compute[75021]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 06 07:02:40 user nova-compute[75021]:     <label>libvirt-91eeb5a9-b6de-40c0-bc37-49768cc15c9c</label>
Dec 06 07:02:40 user nova-compute[75021]:     <imagelabel>libvirt-91eeb5a9-b6de-40c0-bc37-49768cc15c9c</imagelabel>
Dec 06 07:02:40 user nova-compute[75021]:   </seclabel>
Dec 06 07:02:40 user nova-compute[75021]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 06 07:02:40 user nova-compute[75021]:     <label>+64055:+108</label>
Dec 06 07:02:40 user nova-compute[75021]:     <imagelabel>+64055:+108</imagelabel>
Dec 06 07:02:40 user nova-compute[75021]:   </seclabel>
Dec 06 07:02:40 user nova-compute[75021]: </domain>
Dec 06 07:02:40 user nova-compute[75021]:  {{(pid=75021) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6a:99:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap0e389dcb-c0"/></interface> {{(pid=75021) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Cannot resize image /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Ensure instance console log exists: /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6a:99:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap0e389dcb-c0"/></interface>not found in domain: <domain type='kvm' id='9'>
Dec 06 07:02:40 user nova-compute[75021]:   <name>instance-00000008</name>
Dec 06 07:02:40 user nova-compute[75021]:   <uuid>91eeb5a9-b6de-40c0-bc37-49768cc15c9c</uuid>
Dec 06 07:02:40 user nova-compute[75021]:   <metadata>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:02:40 user nova-compute[75021]:   <nova:package version="0.0.0"/>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:name>tempest-device-tagging-server-9053064</nova:name>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:creationTime>2023-12-06 07:02:38</nova:creationTime>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:flavor name="m1.tiny">
Dec 06 07:02:40 user nova-compute[75021]:     <nova:memory>512</nova:memory>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:disk>1</nova:disk>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:swap>0</nova:swap>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:vcpus>1</nova:vcpus>
Dec 06 07:02:40 user nova-compute[75021]:   </nova:flavor>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:owner>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:user uuid="f2de88a1aa57403e8c6614458998b059">tempest-TaggedAttachmentsTest-1423166060-project-member</nova:user>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:project uuid="eb6fd76416e04d298f16ae4dffbb2191">tempest-TaggedAttachmentsTest-1423166060</nova:project>
Dec 06 07:02:40 user nova-compute[75021]:   </nova:owner>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:ports>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:port uuid="94173bea-6e40-4bcc-afe0-031fb7fde7fa">
Dec 06 07:02:40 user nova-compute[75021]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 07:02:40 user nova-compute[75021]:     </nova:port>
Dec 06 07:02:40 user nova-compute[75021]:   </nova:ports>
Dec 06 07:02:40 user nova-compute[75021]: </nova:instance>
Dec 06 07:02:40 user nova-compute[75021]:   </metadata>
Dec 06 07:02:40 user nova-compute[75021]:   <memory unit='KiB'>524288</memory>
Dec 06 07:02:40 user nova-compute[75021]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 06 07:02:40 user nova-compute[75021]:   <vcpu placement='static'>1</vcpu>
Dec 06 07:02:40 user nova-compute[75021]:   <resource>
Dec 06 07:02:40 user nova-compute[75021]:     <partition>/machine</partition>
Dec 06 07:02:40 user nova-compute[75021]:   </resource>
Dec 06 07:02:40 user nova-compute[75021]:   <sysinfo type='smbios'>
Dec 06 07:02:40 user nova-compute[75021]:     <system>
Dec 06 07:02:40 user nova-compute[75021]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 06 07:02:40 user nova-compute[75021]:       <entry name='product'>OpenStack Nova</entry>
Dec 06 07:02:40 user nova-compute[75021]:       <entry name='version'>0.0.0</entry>
Dec 06 07:02:40 user nova-compute[75021]:       <entry name='serial'>91eeb5a9-b6de-40c0-bc37-49768cc15c9c</entry>
Dec 06 07:02:40 user nova-compute[75021]:       <entry name='uuid'>91eeb5a9-b6de-40c0-bc37-49768cc15c9c</entry>
Dec 06 07:02:40 user nova-compute[75021]:       <entry name='family'>Virtual Machine</entry>
Dec 06 07:02:40 user nova-compute[75021]:     </system>
Dec 06 07:02:40 user nova-compute[75021]:   </sysinfo>
Dec 06 07:02:40 user nova-compute[75021]:   <os>
Dec 06 07:02:40 user nova-compute[75021]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 06 07:02:40 user nova-compute[75021]:     <boot dev='hd'/>
Dec 06 07:02:40 user nova-compute[75021]:     <smbios mode='sysinfo'/>
Dec 06 07:02:40 user nova-compute[75021]:   </os>
Dec 06 07:02:40 user nova-compute[75021]:   <features>
Dec 06 07:02:40 user nova-compute[75021]:     <acpi/>
Dec 06 07:02:40 user nova-compute[75021]:     <apic/>
Dec 06 07:02:40 user nova-compute[75021]:     <vmcoreinfo state='on'/>
Dec 06 07:02:40 user nova-compute[75021]:   </features>
Dec 06 07:02:40 user nova-compute[75021]:   <cpu mode='custom' match='exact' check='full'>
Dec 06 07:02:40 user nova-compute[75021]:     <model fallback='forbid'>Nehalem</model>
Dec 06 07:02:40 user nova-compute[75021]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 06 07:02:40 user nova-compute[75021]:     <feature policy='require' name='vme'/>
Dec 06 07:02:40 user nova-compute[75021]:     <feature policy='require' name='x2apic'/>
Dec 06 07:02:40 user nova-compute[75021]:     <feature policy='require' name='hypervisor'/>
Dec 06 07:02:40 user nova-compute[75021]:   </cpu>
Dec 06 07:02:40 user nova-compute[75021]:   <clock offset='utc'>
Dec 06 07:02:40 user nova-compute[75021]:     <timer name='pit' tickpolicy='delay'/>
Dec 06 07:02:40 user nova-compute[75021]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 06 07:02:40 user nova-compute[75021]:     <timer name='hpet' present='no'/>
Dec 06 07:02:40 user nova-compute[75021]:   </clock>
Dec 06 07:02:40 user nova-compute[75021]:   <on_poweroff>destroy</on_poweroff>
Dec 06 07:02:40 user nova-compute[75021]:   <on_reboot>restart</on_reboot>
Dec 06 07:02:40 user nova-compute[75021]:   <on_crash>destroy</on_crash>
Dec 06 07:02:40 user nova-compute[75021]:   <devices>
Dec 06 07:02:40 user nova-compute[75021]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 06 07:02:40 user nova-compute[75021]:     <disk type='file' device='disk'>
Dec 06 07:02:40 user nova-compute[75021]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 06 07:02:40 user nova-compute[75021]:       <source file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk' index='2'/>
Dec 06 07:02:40 user nova-compute[75021]:       <backingStore type='file' index='3'>
Dec 06 07:02:40 user nova-compute[75021]:         <format type='raw'/>
Dec 06 07:02:40 user nova-compute[75021]:         <source file='/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe'/>
Dec 06 07:02:40 user nova-compute[75021]:         <backingStore/>
Dec 06 07:02:40 user nova-compute[75021]:       </backingStore>
Dec 06 07:02:40 user nova-compute[75021]:       <target dev='vda' bus='virtio'/>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='virtio-disk0'/>
Dec 06 07:02:40 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </disk>
Dec 06 07:02:40 user nova-compute[75021]:     <disk type='file' device='cdrom'>
Dec 06 07:02:40 user nova-compute[75021]:       <driver name='qemu' type='raw' cache='none'/>
Dec 06 07:02:40 user nova-compute[75021]:       <source file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk.config' index='1'/>
Dec 06 07:02:40 user nova-compute[75021]:       <backingStore/>
Dec 06 07:02:40 user nova-compute[75021]:       <target dev='hda' bus='ide'/>
Dec 06 07:02:40 user nova-compute[75021]:       <readonly/>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='ide0-0-0'/>
Dec 06 07:02:40 user nova-compute[75021]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </disk>
Dec 06 07:02:40 user nova-compute[75021]:     <controller type='usb' index='0' model='none'>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='usb'/>
Dec 06 07:02:40 user nova-compute[75021]:     </controller>
Dec 06 07:02:40 user nova-compute[75021]:     <controller type='pci' index='0' model='pci-root'>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='pci.0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </controller>
Dec 06 07:02:40 user nova-compute[75021]:     <controller type='ide' index='0'>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='ide'/>
Dec 06 07:02:40 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 06 07:02:40 user nova-compute[75021]:     </controller>
Dec 06 07:02:40 user nova-compute[75021]:     <interface type='ethernet'>
Dec 06 07:02:40 user nova-compute[75021]:       <mac address='fa:16:3e:91:f2:66'/>
Dec 06 07:02:40 user nova-compute[75021]:       <target dev='tap94173bea-6e'/>
Dec 06 07:02:40 user nova-compute[75021]:       <model type='virtio'/>
Dec 06 07:02:40 user nova-compute[75021]:       <mtu size='1442'/>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='net0'/>
Dec 06 07:02:40 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </interface>
Dec 06 07:02:40 user nova-compute[75021]:     <serial type='pty'>
Dec 06 07:02:40 user nova-compute[75021]:       <source path='/dev/pts/8'/>
Dec 06 07:02:40 user nova-compute[75021]:       <log file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/console.log' append='off'/>
Dec 06 07:02:40 user nova-compute[75021]:       <target type='isa-serial' port='0'>
Dec 06 07:02:40 user nova-compute[75021]:         <model name='isa-serial'/>
Dec 06 07:02:40 user nova-compute[75021]:       </target>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='serial0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </serial>
Dec 06 07:02:40 user nova-compute[75021]:     <console type='pty' tty='/dev/pts/8'>
Dec 06 07:02:40 user nova-compute[75021]:       <source path='/dev/pts/8'/>
Dec 06 07:02:40 user nova-compute[75021]:       <log file='/opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/console.log' append='off'/>
Dec 06 07:02:40 user nova-compute[75021]:       <target type='serial' port='0'/>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='serial0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </console>
Dec 06 07:02:40 user nova-compute[75021]:     <input type='mouse' bus='ps2'>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='input0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </input>
Dec 06 07:02:40 user nova-compute[75021]:     <input type='keyboard' bus='ps2'>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='input1'/>
Dec 06 07:02:40 user nova-compute[75021]:     </input>
Dec 06 07:02:40 user nova-compute[75021]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Dec 06 07:02:40 user nova-compute[75021]:       <listen type='address' address='0.0.0.0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </graphics>
Dec 06 07:02:40 user nova-compute[75021]:     <audio id='1' type='none'/>
Dec 06 07:02:40 user nova-compute[75021]:     <video>
Dec 06 07:02:40 user nova-compute[75021]:       <model type='virtio' heads='1' primary='yes'/>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='video0'/>
Dec 06 07:02:40 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </video>
Dec 06 07:02:40 user nova-compute[75021]:     <memballoon model='virtio'>
Dec 06 07:02:40 user nova-compute[75021]:       <stats period='10'/>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='balloon0'/>
Dec 06 07:02:40 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </memballoon>
Dec 06 07:02:40 user nova-compute[75021]:     <rng model='virtio'>
Dec 06 07:02:40 user nova-compute[75021]:       <backend model='random'>/dev/urandom</backend>
Dec 06 07:02:40 user nova-compute[75021]:       <alias name='rng0'/>
Dec 06 07:02:40 user nova-compute[75021]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 06 07:02:40 user nova-compute[75021]:     </rng>
Dec 06 07:02:40 user nova-compute[75021]:   </devices>
Dec 06 07:02:40 user nova-compute[75021]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 06 07:02:40 user nova-compute[75021]:     <label>libvirt-91eeb5a9-b6de-40c0-bc37-49768cc15c9c</label>
Dec 06 07:02:40 user nova-compute[75021]:     <imagelabel>libvirt-91eeb5a9-b6de-40c0-bc37-49768cc15c9c</imagelabel>
Dec 06 07:02:40 user nova-compute[75021]:   </seclabel>
Dec 06 07:02:40 user nova-compute[75021]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 06 07:02:40 user nova-compute[75021]:     <label>+64055:+108</label>
Dec 06 07:02:40 user nova-compute[75021]:     <imagelabel>+64055:+108</imagelabel>
Dec 06 07:02:40 user nova-compute[75021]:   </seclabel>
Dec 06 07:02:40 user nova-compute[75021]: </domain>
Dec 06 07:02:40 user nova-compute[75021]:  {{(pid=75021) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 06 07:02:40 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Detaching interface fa:16:3e:6a:99:11 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap0e389dcb-c0' not found.
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T06:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9053064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9053064',id=8,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfxPXtIc47E18m6Z4qikWqTz2rTTY3bjnRhlRvdXGj9tpXYrXf76otmdZT3oE+W47oRVEPxUwhFLz0Caec3zbc1/KigN/WcfjgJ+3ELWkAH6KQ8DaAIyV9KAyPj8VZgwQ==',key_name='tempest-keypair-399869130',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb6fd76416e04d298f16ae4dffbb2191',ramdisk_id='',reservation_id='r-21w39m30',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1423166060',owner_user_name='tempest-TaggedAttachmentsTest-1423166060-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T06:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2de88a1aa57403e8c6614458998b059',uuid=91eeb5a9-b6de-40c0-bc37-49768cc15c9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "address": "fa:16:3e:6a:99:11", "network": {"id": "b25b1d3d-788d-4093-9933-d13031e93c63", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-721588809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e389dcb-c0", "ovs_interfaceid": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] Converting VIF {"id": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "address": "fa:16:3e:6a:99:11", "network": {"id": "b25b1d3d-788d-4093-9933-d13031e93c63", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-721588809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e389dcb-c0", "ovs_interfaceid": "0e389dcb-c0a8-47b6-997f-8af8932019e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:99:11,bridge_name='br-int',has_traffic_filtering=True,id=0e389dcb-c0a8-47b6-997f-8af8932019e0,network=Network(b25b1d3d-788d-4093-9933-d13031e93c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e389dcb-c0') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG os_vif [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:99:11,bridge_name='br-int',has_traffic_filtering=True,id=0e389dcb-c0a8-47b6-997f-8af8932019e0,network=Network(b25b1d3d-788d-4093-9933-d13031e93c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e389dcb-c0') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e389dcb-c0, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:02:40 user nova-compute[75021]: INFO os_vif [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:99:11,bridge_name='br-int',has_traffic_filtering=True,id=0e389dcb-c0a8-47b6-997f-8af8932019e0,network=Network(b25b1d3d-788d-4093-9933-d13031e93c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e389dcb-c0')
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [req-40d800a6-1b95-4be7-b701-01fa84e5e594 req-00067c5e-585c-4bf0-af35-1d44d0953e26 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:02:40 user nova-compute[75021]:   <nova:package version="0.0.0"/>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:name>tempest-device-tagging-server-9053064</nova:name>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:creationTime>2023-12-06 07:02:40</nova:creationTime>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:flavor name="m1.tiny">
Dec 06 07:02:40 user nova-compute[75021]:     <nova:memory>512</nova:memory>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:disk>1</nova:disk>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:swap>0</nova:swap>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:vcpus>1</nova:vcpus>
Dec 06 07:02:40 user nova-compute[75021]:   </nova:flavor>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:owner>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:user uuid="f2de88a1aa57403e8c6614458998b059">tempest-TaggedAttachmentsTest-1423166060-project-member</nova:user>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:project uuid="eb6fd76416e04d298f16ae4dffbb2191">tempest-TaggedAttachmentsTest-1423166060</nova:project>
Dec 06 07:02:40 user nova-compute[75021]:   </nova:owner>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:02:40 user nova-compute[75021]:   <nova:ports>
Dec 06 07:02:40 user nova-compute[75021]:     <nova:port uuid="94173bea-6e40-4bcc-afe0-031fb7fde7fa">
Dec 06 07:02:40 user nova-compute[75021]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 07:02:40 user nova-compute[75021]:     </nova:port>
Dec 06 07:02:40 user nova-compute[75021]:   </nova:ports>
Dec 06 07:02:40 user nova-compute[75021]: </nova:instance>
Dec 06 07:02:40 user nova-compute[75021]:  {{(pid=75021) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Successfully updated port: 6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "refresh_cache-7184c6b7-d34c-425a-ba1d-ddad75231f7e" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquired lock "refresh_cache-7184c6b7-d34c-425a-ba1d-ddad75231f7e" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-cabe9abb-05c4-4db1-b535-45becb2726c2 req-d7528342-923e-4c63-9343-164af71e4b7c service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Received event network-changed-6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-cabe9abb-05c4-4db1-b535-45becb2726c2 req-d7528342-923e-4c63-9343-164af71e4b7c service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Refreshing instance network info cache due to event network-changed-6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cabe9abb-05c4-4db1-b535-45becb2726c2 req-d7528342-923e-4c63-9343-164af71e4b7c service nova] Acquiring lock "refresh_cache-7184c6b7-d34c-425a-ba1d-ddad75231f7e" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Updating instance_info_cache with network_info: [{"id": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "address": "fa:16:3e:d3:01:14", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4bf2b6-a5", "ovs_interfaceid": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Releasing lock "refresh_cache-7184c6b7-d34c-425a-ba1d-ddad75231f7e" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Instance network_info: |[{"id": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "address": "fa:16:3e:d3:01:14", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4bf2b6-a5", "ovs_interfaceid": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cabe9abb-05c4-4db1-b535-45becb2726c2 req-d7528342-923e-4c63-9343-164af71e4b7c service nova] Acquired lock "refresh_cache-7184c6b7-d34c-425a-ba1d-ddad75231f7e" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-cabe9abb-05c4-4db1-b535-45becb2726c2 req-d7528342-923e-4c63-9343-164af71e4b7c service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Refreshing network info cache for port 6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:02:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Start _get_guest_xml network_info=[{"id": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "address": "fa:16:3e:d3:01:14", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4bf2b6-a5", "ovs_interfaceid": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:02:41 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:02:41 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-606964116',display_name='tempest-VolumesAdminNegativeTest-server-606964116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-606964116',id=14,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79e72540b430409b954290965f157c43',ramdisk_id='',reservation_id='r-dyfhrz4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1751614012',owner_user_name='tempest-VolumesAdminNegativeTest-1751614012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:02:39Z,user_data=None,user_id='6b2add3b5bca409e89667f7508b8450f',uuid=7184c6b7-d34c-425a-ba1d-ddad75231f7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "address": "fa:16:3e:d3:01:14", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4bf2b6-a5", "ovs_interfaceid": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Converting VIF {"id": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "address": "fa:16:3e:d3:01:14", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4bf2b6-a5", "ovs_interfaceid": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:01:14,bridge_name='br-int',has_traffic_filtering=True,id=6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4,network=Network(1bf2263d-db40-4f7c-bf4f-9839edad2d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4bf2b6-a5') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.objects.instance [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lazy-loading 'pci_devices' on Instance uuid 7184c6b7-d34c-425a-ba1d-ddad75231f7e {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:02:41 user nova-compute[75021]:   <uuid>7184c6b7-d34c-425a-ba1d-ddad75231f7e</uuid>
Dec 06 07:02:41 user nova-compute[75021]:   <name>instance-0000000e</name>
Dec 06 07:02:41 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:02:41 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:02:41 user nova-compute[75021]:   <metadata>
Dec 06 07:02:41 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:02:41 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:02:41 user nova-compute[75021]:       <nova:name>tempest-VolumesAdminNegativeTest-server-606964116</nova:name>
Dec 06 07:02:41 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:02:41</nova:creationTime>
Dec 06 07:02:41 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:02:41 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:02:41 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:02:41 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:02:41 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:02:41 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:02:41 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:02:41 user nova-compute[75021]:       <nova:owner>
Dec 06 07:02:41 user nova-compute[75021]:         <nova:user uuid="6b2add3b5bca409e89667f7508b8450f">tempest-VolumesAdminNegativeTest-1751614012-project-member</nova:user>
Dec 06 07:02:41 user nova-compute[75021]:         <nova:project uuid="79e72540b430409b954290965f157c43">tempest-VolumesAdminNegativeTest-1751614012</nova:project>
Dec 06 07:02:41 user nova-compute[75021]:       </nova:owner>
Dec 06 07:02:41 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:02:41 user nova-compute[75021]:       <nova:ports>
Dec 06 07:02:41 user nova-compute[75021]:         <nova:port uuid="6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4">
Dec 06 07:02:41 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 06 07:02:41 user nova-compute[75021]:         </nova:port>
Dec 06 07:02:41 user nova-compute[75021]:       </nova:ports>
Dec 06 07:02:41 user nova-compute[75021]:     </nova:instance>
Dec 06 07:02:41 user nova-compute[75021]:   </metadata>
Dec 06 07:02:41 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:02:41 user nova-compute[75021]:     <system>
Dec 06 07:02:41 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:02:41 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:02:41 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:02:41 user nova-compute[75021]:       <entry name="serial">7184c6b7-d34c-425a-ba1d-ddad75231f7e</entry>
Dec 06 07:02:41 user nova-compute[75021]:       <entry name="uuid">7184c6b7-d34c-425a-ba1d-ddad75231f7e</entry>
Dec 06 07:02:41 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:02:41 user nova-compute[75021]:     </system>
Dec 06 07:02:41 user nova-compute[75021]:   </sysinfo>
Dec 06 07:02:41 user nova-compute[75021]:   <os>
Dec 06 07:02:41 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:02:41 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:02:41 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:02:41 user nova-compute[75021]:   </os>
Dec 06 07:02:41 user nova-compute[75021]:   <features>
Dec 06 07:02:41 user nova-compute[75021]:     <acpi/>
Dec 06 07:02:41 user nova-compute[75021]:     <apic/>
Dec 06 07:02:41 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:02:41 user nova-compute[75021]:   </features>
Dec 06 07:02:41 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:02:41 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:02:41 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:02:41 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:02:41 user nova-compute[75021]:   </clock>
Dec 06 07:02:41 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:02:41 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:02:41 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:02:41 user nova-compute[75021]:   </cpu>
Dec 06 07:02:41 user nova-compute[75021]:   <devices>
Dec 06 07:02:41 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:02:41 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:02:41 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk"/>
Dec 06 07:02:41 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:02:41 user nova-compute[75021]:     </disk>
Dec 06 07:02:41 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:02:41 user nova-compute[75021]:       <mac address="fa:16:3e:d3:01:14"/>
Dec 06 07:02:41 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:02:41 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:02:41 user nova-compute[75021]:       <target dev="tap6a4bf2b6-a5"/>
Dec 06 07:02:41 user nova-compute[75021]:     </interface>
Dec 06 07:02:41 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:02:41 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/console.log" append="off"/>
Dec 06 07:02:41 user nova-compute[75021]:     </serial>
Dec 06 07:02:41 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:02:41 user nova-compute[75021]:     <video>
Dec 06 07:02:41 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:02:41 user nova-compute[75021]:     </video>
Dec 06 07:02:41 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:02:41 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:02:41 user nova-compute[75021]:     </rng>
Dec 06 07:02:41 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:02:41 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:02:41 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:02:41 user nova-compute[75021]:     </memballoon>
Dec 06 07:02:41 user nova-compute[75021]:   </devices>
Dec 06 07:02:41 user nova-compute[75021]: </domain>
Dec 06 07:02:41 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-606964116',display_name='tempest-VolumesAdminNegativeTest-server-606964116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-606964116',id=14,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79e72540b430409b954290965f157c43',ramdisk_id='',reservation_id='r-dyfhrz4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1751614012',owner_user_name='tempest-VolumesAdminNegativeTest-1751614012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:02:39Z,user_data=None,user_id='6b2add3b5bca409e89667f7508b8450f',uuid=7184c6b7-d34c-425a-ba1d-ddad75231f7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "address": "fa:16:3e:d3:01:14", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4bf2b6-a5", "ovs_interfaceid": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Converting VIF {"id": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "address": "fa:16:3e:d3:01:14", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4bf2b6-a5", "ovs_interfaceid": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:01:14,bridge_name='br-int',has_traffic_filtering=True,id=6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4,network=Network(1bf2263d-db40-4f7c-bf4f-9839edad2d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4bf2b6-a5') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG os_vif [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:01:14,bridge_name='br-int',has_traffic_filtering=True,id=6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4,network=Network(1bf2263d-db40-4f7c-bf4f-9839edad2d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4bf2b6-a5') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65d08f2d-f666-58d2-969d-8b30a0c790a5', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a4bf2b6-a5, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a4bf2b6-a5, col_values=(('qos', UUID('3be4541d-a4d2-469b-89f3-848ce24ebbcd')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a4bf2b6-a5, col_values=(('external_ids', {'iface-id': '6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:01:14', 'vm-uuid': '7184c6b7-d34c-425a-ba1d-ddad75231f7e'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:41 user nova-compute[75021]: INFO os_vif [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:01:14,bridge_name='br-int',has_traffic_filtering=True,id=6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4,network=Network(1bf2263d-db40-4f7c-bf4f-9839edad2d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4bf2b6-a5')
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] No VIF found with MAC fa:16:3e:d3:01:14, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.network.neutron [req-cabe9abb-05c4-4db1-b535-45becb2726c2 req-d7528342-923e-4c63-9343-164af71e4b7c service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Updated VIF entry in instance network info cache for port 6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG nova.network.neutron [req-cabe9abb-05c4-4db1-b535-45becb2726c2 req-d7528342-923e-4c63-9343-164af71e4b7c service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Updating instance_info_cache with network_info: [{"id": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "address": "fa:16:3e:d3:01:14", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4bf2b6-a5", "ovs_interfaceid": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:02:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cabe9abb-05c4-4db1-b535-45becb2726c2 req-d7528342-923e-4c63-9343-164af71e4b7c service nova] Releasing lock "refresh_cache-7184c6b7-d34c-425a-ba1d-ddad75231f7e" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:02:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:42 user nova-compute[75021]: DEBUG nova.compute.manager [req-7e2bc753-29a4-4649-9711-641c1c771192 req-c536a6ed-ff74-4edd-aadb-4ad8f725e7d6 service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Received event network-vif-plugged-6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7e2bc753-29a4-4649-9711-641c1c771192 req-c536a6ed-ff74-4edd-aadb-4ad8f725e7d6 service nova] Acquiring lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7e2bc753-29a4-4649-9711-641c1c771192 req-c536a6ed-ff74-4edd-aadb-4ad8f725e7d6 service nova] Lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7e2bc753-29a4-4649-9711-641c1c771192 req-c536a6ed-ff74-4edd-aadb-4ad8f725e7d6 service nova] Lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:42 user nova-compute[75021]: DEBUG nova.compute.manager [req-7e2bc753-29a4-4649-9711-641c1c771192 req-c536a6ed-ff74-4edd-aadb-4ad8f725e7d6 service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] No waiting events found dispatching network-vif-plugged-6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:02:42 user nova-compute[75021]: WARNING nova.compute.manager [req-7e2bc753-29a4-4649-9711-641c1c771192 req-c536a6ed-ff74-4edd-aadb-4ad8f725e7d6 service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Received unexpected event network-vif-plugged-6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 for instance with vm_state building and task_state spawning.
Dec 06 07:02:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Acquiring lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Acquiring lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:44 user nova-compute[75021]: INFO nova.compute.manager [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Terminating instance
Dec 06 07:02:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:02:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-50c017ad-e410-4b34-95d4-f767a9f91ff1 req-809d99c2-a7b5-4a45-b151-c8ee0512208e service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Received event network-vif-plugged-6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-50c017ad-e410-4b34-95d4-f767a9f91ff1 req-809d99c2-a7b5-4a45-b151-c8ee0512208e service nova] Acquiring lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-50c017ad-e410-4b34-95d4-f767a9f91ff1 req-809d99c2-a7b5-4a45-b151-c8ee0512208e service nova] Lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-50c017ad-e410-4b34-95d4-f767a9f91ff1 req-809d99c2-a7b5-4a45-b151-c8ee0512208e service nova] Lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-50c017ad-e410-4b34-95d4-f767a9f91ff1 req-809d99c2-a7b5-4a45-b151-c8ee0512208e service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] No waiting events found dispatching network-vif-plugged-6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:02:45 user nova-compute[75021]: WARNING nova.compute.manager [req-50c017ad-e410-4b34-95d4-f767a9f91ff1 req-809d99c2-a7b5-4a45-b151-c8ee0512208e service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Received unexpected event network-vif-plugged-6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 for instance with vm_state building and task_state spawning.
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:02:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Instance spawned successfully.
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:02:45 user nova-compute[75021]: INFO nova.compute.manager [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Took 5.85 seconds to spawn the instance on the hypervisor.
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-3663cf67-53ff-4400-95a5-f75ea23efc5c req-585ea57a-7bdb-45a3-8db2-ff06b51d04a6 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Received event network-vif-unplugged-a4942c0a-b7fd-467f-80e0-fc4f66261e12 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3663cf67-53ff-4400-95a5-f75ea23efc5c req-585ea57a-7bdb-45a3-8db2-ff06b51d04a6 service nova] Acquiring lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3663cf67-53ff-4400-95a5-f75ea23efc5c req-585ea57a-7bdb-45a3-8db2-ff06b51d04a6 service nova] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3663cf67-53ff-4400-95a5-f75ea23efc5c req-585ea57a-7bdb-45a3-8db2-ff06b51d04a6 service nova] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-3663cf67-53ff-4400-95a5-f75ea23efc5c req-585ea57a-7bdb-45a3-8db2-ff06b51d04a6 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] No waiting events found dispatching network-vif-unplugged-a4942c0a-b7fd-467f-80e0-fc4f66261e12 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-3663cf67-53ff-4400-95a5-f75ea23efc5c req-585ea57a-7bdb-45a3-8db2-ff06b51d04a6 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Received event network-vif-unplugged-a4942c0a-b7fd-467f-80e0-fc4f66261e12 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:02:45 user nova-compute[75021]: INFO nova.compute.manager [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Took 6.88 seconds to build instance.
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-004e65a0-7d92-4869-85eb-fb0a84e4b447 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.983s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:45 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c is timed out.
Dec 06 07:02:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Successfully detached device vdb from instance b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c from the live domain config.
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlsJUqSA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:02:45 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f146d8ed-0605-4727-9302-182cd4e28eda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:02:45 user nova-compute[75021]: No targets found.
Dec 06 07:02:45 user nova-compute[75021]: iSNS:
Dec 06 07:02:45 user nova-compute[75021]: No targets found.
Dec 06 07:02:45 user nova-compute[75021]: STATIC:
Dec 06 07:02:45 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5
Dec 06 07:02:45 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:45 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:45 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3
Dec 06 07:02:45 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:45 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:45 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d
Dec 06 07:02:45 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:45 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:45 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd
Dec 06 07:02:45 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:45 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:45 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794
Dec 06 07:02:45 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:02:45 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:02:45 user nova-compute[75021]: FIRMWARE:
Dec 06 07:02:45 user nova-compute[75021]: No targets found.
Dec 06 07:02:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:02:45 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:02:45 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Instance destroyed successfully.
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.objects.instance [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lazy-loading 'resources' on Instance uuid 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f939b0ca-b57e-45bb-83e1-ed187474153a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1185390691',display_name='tempest-VolumesAssistedSnapshotsTest-server-1185390691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1185390691',id=9,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3Tdw8ld6HVt5lN5liZ5oZHohcW+g1AQHl5ZRg8GsUk1QLz6Vhk7QGdQ7dtThHbS/FGZpb2tddpYPVJD4IJ1xPn9HzxDGGjVnbJbEq7d9dHCJK0vglMa2bubjiCJTNwhA==',key_name='tempest-keypair-249771813',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de6a7955718c44d79b908d650ea3bbe5',ramdisk_id='',reservation_id='r-8vg1ona4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-678336041',owner_user_name='tempest-VolumesAssistedSnapshotsTest-678336041-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T06:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5c2decab47e4837a24ac498b9b065cb',uuid=9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "address": "fa:16:3e:eb:6e:d5", "network": {"id": "fe4e2805-4027-4464-b44a-98d002a04c2f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-103297198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6a7955718c44d79b908d650ea3bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4942c0a-b7", "ovs_interfaceid": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Converting VIF {"id": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "address": "fa:16:3e:eb:6e:d5", "network": {"id": "fe4e2805-4027-4464-b44a-98d002a04c2f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-103297198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de6a7955718c44d79b908d650ea3bbe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4942c0a-b7", "ovs_interfaceid": "a4942c0a-b7fd-467f-80e0-fc4f66261e12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:6e:d5,bridge_name='br-int',has_traffic_filtering=True,id=a4942c0a-b7fd-467f-80e0-fc4f66261e12,network=Network(fe4e2805-4027-4464-b44a-98d002a04c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4942c0a-b7') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_vif [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:6e:d5,bridge_name='br-int',has_traffic_filtering=True,id=a4942c0a-b7fd-467f-80e0-fc4f66261e12,network=Network(fe4e2805-4027-4464-b44a-98d002a04c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4942c0a-b7') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4942c0a-b7, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=394155cb-acf0-4b95-9cce-4fdaced39bb8) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce6b5e2-7f69-4dd4-82c6-ac576057ceb6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd (non-flash)
Dec 06 07:02:45 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:02:45 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:45 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:45 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd (non-flash)
Dec 06 07:02:45 user nova-compute[75021]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:02:45 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:02:45 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:02:45 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:02:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b47ce200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:45 user nova-compute[75021]: INFO os_vif [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:6e:d5,bridge_name='br-int',has_traffic_filtering=True,id=a4942c0a-b7fd-467f-80e0-fc4f66261e12,network=Network(fe4e2805-4027-4464-b44a-98d002a04c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4942c0a-b7')
Dec 06 07:02:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Deleting instance files /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0_del
Dec 06 07:02:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Deletion of /opt/stack/data/nova/instances/9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0_del complete
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ebdd4d-273f-43f6-aa9e-b12d8319a154]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7be6c30-dfc2-434e-b7b8-e962c03e664d]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f761547-937b-45f5-a0d5-6acc95f5ee4d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:45 user nova-compute[75021]: INFO nova.compute.manager [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Took 1.16 seconds to destroy the instance on the hypervisor.
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0582cfc-f059-4dd2-aab7-3094b20ec3d7]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c596ab1-72eb-43c7-9256-5f8543e8838f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --logout" returned: 0 in 0.150s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c0f3d7-d1ae-4ecb-adc2-3e81fab6e01c]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd, portal: 172.16.0.220,3260]
Dec 06 07:02:46 user nova-compute[75021]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd, portal: 172.16.0.220,3260] successful.
Dec 06 07:02:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9335bda-2f4e-4758-b9d3-d9784eacafdd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3343b4fa-ac2f-4aa7-923b-ef158d26d2ee]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:02:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:02:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.465s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:02:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] <== disconnect_volume: return (468ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:02:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:02:46 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:02:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-de4b5062-16ce-4ca3-808a-d77949951cf8 req-b4c779fd-7837-4703-b19a-7adc6c449eb0 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Received event network-vif-deleted-a4942c0a-b7fd-467f-80e0-fc4f66261e12 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:46 user nova-compute[75021]: INFO nova.compute.manager [req-de4b5062-16ce-4ca3-808a-d77949951cf8 req-b4c779fd-7837-4703-b19a-7adc6c449eb0 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Neutron deleted interface a4942c0a-b7fd-467f-80e0-fc4f66261e12; detaching it from the instance and deleting it from the info cache
Dec 06 07:02:46 user nova-compute[75021]: DEBUG nova.network.neutron [req-de4b5062-16ce-4ca3-808a-d77949951cf8 req-b4c779fd-7837-4703-b19a-7adc6c449eb0 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:02:46 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Took 1.00 seconds to deallocate network for instance.
Dec 06 07:02:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-de4b5062-16ce-4ca3-808a-d77949951cf8 req-b4c779fd-7837-4703-b19a-7adc6c449eb0 service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Detach interface failed, port_id=a4942c0a-b7fd-467f-80e0-fc4f66261e12, reason: Instance 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0 could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 07:02:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:47 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lazy-loading 'flavor' on Instance uuid b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:02:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9b21c376-8ac7-4ac0-a40d-92bfd5bba5ce tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.073s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-e0ca1e6f-0bd8-4c39-9d02-eb8c9c0964d0 req-04293b1f-6875-43c2-9e63-ca85a7b120ad service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Received event network-vif-plugged-a4942c0a-b7fd-467f-80e0-fc4f66261e12 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:02:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e0ca1e6f-0bd8-4c39-9d02-eb8c9c0964d0 req-04293b1f-6875-43c2-9e63-ca85a7b120ad service nova] Acquiring lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e0ca1e6f-0bd8-4c39-9d02-eb8c9c0964d0 req-04293b1f-6875-43c2-9e63-ca85a7b120ad service nova] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e0ca1e6f-0bd8-4c39-9d02-eb8c9c0964d0 req-04293b1f-6875-43c2-9e63-ca85a7b120ad service nova] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-e0ca1e6f-0bd8-4c39-9d02-eb8c9c0964d0 req-04293b1f-6875-43c2-9e63-ca85a7b120ad service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] No waiting events found dispatching network-vif-plugged-a4942c0a-b7fd-467f-80e0-fc4f66261e12 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:02:47 user nova-compute[75021]: WARNING nova.compute.manager [req-e0ca1e6f-0bd8-4c39-9d02-eb8c9c0964d0 req-04293b1f-6875-43c2-9e63-ca85a7b120ad service nova] [instance: 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0] Received unexpected event network-vif-plugged-a4942c0a-b7fd-467f-80e0-fc4f66261e12 for instance with vm_state deleted and task_state None.
Dec 06 07:02:47 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:02:47 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:02:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:47 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Deleted allocations for instance 9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0
Dec 06 07:02:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-477927a6-9036-4d5f-94cf-7f52240426cd tempest-VolumesAssistedSnapshotsTest-678336041 tempest-VolumesAssistedSnapshotsTest-678336041-project-member] Lock "9934f4e8-bab5-4e08-b5a4-9162bb5d9ae0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.940s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:56 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:02:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:02:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:02:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:02:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:02:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:02:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:02:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:02:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:02:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:02:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:02:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:02:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:02:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lazy-loading 'flavor' on Instance uuid 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.142s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:00 user nova-compute[75021]: INFO nova.compute.manager [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Attaching volume 7ccdd51d-7737-4a34-b5ab-e986a8a87635 to /dev/vdb
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG os_brick.utils [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf98a6c-8b3b-4852-b8d2-580246bfe889]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ee0601-0ae7-48d4-8321-5a38b50ef2e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[486a7e14-1623-4735-b031-dd347039bf79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a1de91-665b-4106-83be-8785696dc755]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:03:01 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:03:01 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[333cf46d-7cd7-4af0-ab22-0dc3a1fe4dee]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG os_brick.utils [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updating existing volume attachment record: b359f12b-7bab-4bb2-97aa-d747a9b6844a {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-f060db4a-6b3f-44b8-8535-9ad52dfa29a3 req-e6e09738-2669-4815-a7ad-c37a555afb1f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-changed-69fc2f53-a06e-4792-9f4d-5044050ed607 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-f060db4a-6b3f-44b8-8535-9ad52dfa29a3 req-e6e09738-2669-4815-a7ad-c37a555afb1f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing instance network info cache due to event network-changed-69fc2f53-a06e-4792-9f4d-5044050ed607. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f060db4a-6b3f-44b8-8535-9ad52dfa29a3 req-e6e09738-2669-4815-a7ad-c37a555afb1f service nova] Acquiring lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f060db4a-6b3f-44b8-8535-9ad52dfa29a3 req-e6e09738-2669-4815-a7ad-c37a555afb1f service nova] Acquired lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.network.neutron [req-f060db4a-6b3f-44b8-8535-9ad52dfa29a3 req-e6e09738-2669-4815-a7ad-c37a555afb1f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Refreshing network info cache for port 69fc2f53-a06e-4792-9f4d-5044050ed607 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:03:01 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:03:01 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7367MB free_disk=25.609390258789062GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance d5cd8c5d-acc4-44b8-b240-58f8fea899ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance ab907f07-df7b-4d56-baef-f2502b88b622 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 7184c6b7-d34c-425a-ba1d-ddad75231f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:03:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:03:02 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:03:02 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:03:02 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:03:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:02 user nova-compute[75021]: DEBUG nova.network.neutron [req-f060db4a-6b3f-44b8-8535-9ad52dfa29a3 req-e6e09738-2669-4815-a7ad-c37a555afb1f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updated VIF entry in instance network info cache for port 69fc2f53-a06e-4792-9f4d-5044050ed607. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:03:02 user nova-compute[75021]: DEBUG nova.network.neutron [req-f060db4a-6b3f-44b8-8535-9ad52dfa29a3 req-e6e09738-2669-4815-a7ad-c37a555afb1f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating instance_info_cache with network_info: [{"id": "69fc2f53-a06e-4792-9f4d-5044050ed607", "address": "fa:16:3e:ce:59:97", "network": {"id": "68f06c4c-2346-43fc-b05a-a1316f086ac9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-574220473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fc2f53-a0", "ovs_interfaceid": "69fc2f53-a06e-4792-9f4d-5044050ed607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "address": "fa:16:3e:98:90:3a", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape296dd9b-d7", "ovs_interfaceid": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "address": "fa:16:3e:b8:dc:57", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f5b4cc-ae", "ovs_interfaceid": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "address": "fa:16:3e:0c:80:0f", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ea8b6-97", "ovs_interfaceid": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "address": "fa:16:3e:05:d0:4b", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaeaf2a-91", "ovs_interfaceid": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "address": "fa:16:3e:c6:50:8e", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87be3bc7-32", "ovs_interfaceid": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "address": "fa:16:3e:1d:25:78", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90de25ad-46", "ovs_interfaceid": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f060db4a-6b3f-44b8-8535-9ad52dfa29a3 req-e6e09738-2669-4815-a7ad-c37a555afb1f service nova] Releasing lock "refresh_cache-ab907f07-df7b-4d56-baef-f2502b88b622" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Updating instance_info_cache with network_info: [{"id": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "address": "fa:16:3e:5f:22:74", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c57d6ef-14", "ovs_interfaceid": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:03:03 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "ab907f07-df7b-4d56-baef-f2502b88b622" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:04 user nova-compute[75021]: INFO nova.compute.manager [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Terminating instance
Dec 06 07:03:04 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-95641c50-c32e-421f-a4cb-7e9b378599f5 req-af147ddf-8c11-4d02-9ad2-8556f017fe88 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-unplugged-69fc2f53-a06e-4792-9f4d-5044050ed607 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-95641c50-c32e-421f-a4cb-7e9b378599f5 req-af147ddf-8c11-4d02-9ad2-8556f017fe88 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-95641c50-c32e-421f-a4cb-7e9b378599f5 req-af147ddf-8c11-4d02-9ad2-8556f017fe88 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-95641c50-c32e-421f-a4cb-7e9b378599f5 req-af147ddf-8c11-4d02-9ad2-8556f017fe88 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-95641c50-c32e-421f-a4cb-7e9b378599f5 req-af147ddf-8c11-4d02-9ad2-8556f017fe88 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-unplugged-69fc2f53-a06e-4792-9f4d-5044050ed607 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-95641c50-c32e-421f-a4cb-7e9b378599f5 req-af147ddf-8c11-4d02-9ad2-8556f017fe88 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-unplugged-69fc2f53-a06e-4792-9f4d-5044050ed607 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-9a22f082-70c3-4ebf-924a-f8b1a1124827 req-ba3383cf-3482-4f67-ad45-660f1f16717d service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-unplugged-16f5b4cc-aef4-43c4-a87f-81993a0cdee9 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9a22f082-70c3-4ebf-924a-f8b1a1124827 req-ba3383cf-3482-4f67-ad45-660f1f16717d service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9a22f082-70c3-4ebf-924a-f8b1a1124827 req-ba3383cf-3482-4f67-ad45-660f1f16717d service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9a22f082-70c3-4ebf-924a-f8b1a1124827 req-ba3383cf-3482-4f67-ad45-660f1f16717d service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-9a22f082-70c3-4ebf-924a-f8b1a1124827 req-ba3383cf-3482-4f67-ad45-660f1f16717d service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-unplugged-16f5b4cc-aef4-43c4-a87f-81993a0cdee9 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-9a22f082-70c3-4ebf-924a-f8b1a1124827 req-ba3383cf-3482-4f67-ad45-660f1f16717d service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-unplugged-16f5b4cc-aef4-43c4-a87f-81993a0cdee9 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:03:06 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Instance destroyed successfully.
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.objects.instance [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lazy-loading 'resources' on Instance uuid ab907f07-df7b-4d56-baef-f2502b88b622 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:01:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69fc2f53-a06e-4792-9f4d-5044050ed607", "address": "fa:16:3e:ce:59:97", "network": {"id": "68f06c4c-2346-43fc-b05a-a1316f086ac9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-574220473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fc2f53-a0", "ovs_interfaceid": "69fc2f53-a06e-4792-9f4d-5044050ed607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "69fc2f53-a06e-4792-9f4d-5044050ed607", "address": "fa:16:3e:ce:59:97", "network": {"id": "68f06c4c-2346-43fc-b05a-a1316f086ac9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-574220473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fc2f53-a0", "ovs_interfaceid": "69fc2f53-a06e-4792-9f4d-5044050ed607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:59:97,bridge_name='br-int',has_traffic_filtering=True,id=69fc2f53-a06e-4792-9f4d-5044050ed607,network=Network(68f06c4c-2346-43fc-b05a-a1316f086ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69fc2f53-a0') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:59:97,bridge_name='br-int',has_traffic_filtering=True,id=69fc2f53-a06e-4792-9f4d-5044050ed607,network=Network(68f06c4c-2346-43fc-b05a-a1316f086ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69fc2f53-a0') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69fc2f53-a0, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87ae653b-6632-4c79-9ea7-04ebc1b60278) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: INFO os_vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:59:97,bridge_name='br-int',has_traffic_filtering=True,id=69fc2f53-a06e-4792-9f4d-5044050ed607,network=Network(68f06c4c-2346-43fc-b05a-a1316f086ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69fc2f53-a0')
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:01:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "address": "fa:16:3e:98:90:3a", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape296dd9b-d7", "ovs_interfaceid": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "address": "fa:16:3e:98:90:3a", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape296dd9b-d7", "ovs_interfaceid": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:90:3a,bridge_name='br-int',has_traffic_filtering=True,id=e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape296dd9b-d7') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:90:3a,bridge_name='br-int',has_traffic_filtering=True,id=e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape296dd9b-d7') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape296dd9b-d7, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2931bd06-8247-47b9-b44d-c5ea5431a512) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-69fc2f53-a06e-4792-9f4d-5044050ed607 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-69fc2f53-a06e-4792-9f4d-5044050ed607 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:06 user nova-compute[75021]: WARNING nova.compute.manager [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-69fc2f53-a06e-4792-9f4d-5044050ed607 for instance with vm_state active and task_state deleting.
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-unplugged-8b7ea8b6-978c-4760-b4eb-81ca2fe10caa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-unplugged-8b7ea8b6-978c-4760-b4eb-81ca2fe10caa {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-unplugged-8b7ea8b6-978c-4760-b4eb-81ca2fe10caa for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-8b7ea8b6-978c-4760-b4eb-81ca2fe10caa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-8b7ea8b6-978c-4760-b4eb-81ca2fe10caa {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:06 user nova-compute[75021]: WARNING nova.compute.manager [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-8b7ea8b6-978c-4760-b4eb-81ca2fe10caa for instance with vm_state active and task_state deleting.
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-unplugged-cfaeaf2a-91aa-405d-ab13-b3827d9165e3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-unplugged-cfaeaf2a-91aa-405d-ab13-b3827d9165e3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-unplugged-cfaeaf2a-91aa-405d-ab13-b3827d9165e3 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-cfaeaf2a-91aa-405d-ab13-b3827d9165e3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-cfaeaf2a-91aa-405d-ab13-b3827d9165e3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:06 user nova-compute[75021]: WARNING nova.compute.manager [req-d5121ba0-1483-43d9-b582-61a9c3e30c80 req-3226f6a1-9f71-4b2d-92c0-b7255ccfc07e service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-cfaeaf2a-91aa-405d-ab13-b3827d9165e3 for instance with vm_state active and task_state deleting.
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: INFO os_vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:90:3a,bridge_name='br-int',has_traffic_filtering=True,id=e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape296dd9b-d7')
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:01:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "address": "fa:16:3e:b8:dc:57", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f5b4cc-ae", "ovs_interfaceid": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "address": "fa:16:3e:b8:dc:57", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f5b4cc-ae", "ovs_interfaceid": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:dc:57,bridge_name='br-int',has_traffic_filtering=True,id=16f5b4cc-aef4-43c4-a87f-81993a0cdee9,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16f5b4cc-ae') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:dc:57,bridge_name='br-int',has_traffic_filtering=True,id=16f5b4cc-aef4-43c4-a87f-81993a0cdee9,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16f5b4cc-ae') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16f5b4cc-ae, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f926a2ac-b55c-4afd-ba74-19e9a3797fdd) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: INFO os_vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:dc:57,bridge_name='br-int',has_traffic_filtering=True,id=16f5b4cc-aef4-43c4-a87f-81993a0cdee9,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap16f5b4cc-ae')
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:01:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "address": "fa:16:3e:0c:80:0f", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ea8b6-97", "ovs_interfaceid": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "address": "fa:16:3e:0c:80:0f", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ea8b6-97", "ovs_interfaceid": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:80:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b7ea8b6-978c-4760-b4eb-81ca2fe10caa,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7ea8b6-97') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:80:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b7ea8b6-978c-4760-b4eb-81ca2fe10caa,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7ea8b6-97') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b7ea8b6-97, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9eed5c6-4d95-41c6-a1e9-a01b24cf7f0d) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-9a325328-e706-480a-8559-917d9f65cda2 req-f67f8da5-d0c0-4120-8319-b4113439b1df service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-unplugged-e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9a325328-e706-480a-8559-917d9f65cda2 req-f67f8da5-d0c0-4120-8319-b4113439b1df service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9a325328-e706-480a-8559-917d9f65cda2 req-f67f8da5-d0c0-4120-8319-b4113439b1df service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9a325328-e706-480a-8559-917d9f65cda2 req-f67f8da5-d0c0-4120-8319-b4113439b1df service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-9a325328-e706-480a-8559-917d9f65cda2 req-f67f8da5-d0c0-4120-8319-b4113439b1df service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-unplugged-e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-9a325328-e706-480a-8559-917d9f65cda2 req-f67f8da5-d0c0-4120-8319-b4113439b1df service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-unplugged-e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: INFO os_vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:80:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b7ea8b6-978c-4760-b4eb-81ca2fe10caa,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b7ea8b6-97')
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:01:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "address": "fa:16:3e:05:d0:4b", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaeaf2a-91", "ovs_interfaceid": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "address": "fa:16:3e:05:d0:4b", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfaeaf2a-91", "ovs_interfaceid": "cfaeaf2a-91aa-405d-ab13-b3827d9165e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:d0:4b,bridge_name='br-int',has_traffic_filtering=True,id=cfaeaf2a-91aa-405d-ab13-b3827d9165e3,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfaeaf2a-91') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:d0:4b,bridge_name='br-int',has_traffic_filtering=True,id=cfaeaf2a-91aa-405d-ab13-b3827d9165e3,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfaeaf2a-91') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfaeaf2a-91, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a932fbcc-e7c0-439c-8040-69c75ba914c3) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: INFO os_vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:d0:4b,bridge_name='br-int',has_traffic_filtering=True,id=cfaeaf2a-91aa-405d-ab13-b3827d9165e3,network=Network(85745779-46c5-44b2-9211-cddb150f558b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfaeaf2a-91')
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:01:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "address": "fa:16:3e:c6:50:8e", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87be3bc7-32", "ovs_interfaceid": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "address": "fa:16:3e:c6:50:8e", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87be3bc7-32", "ovs_interfaceid": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:50:8e,bridge_name='br-int',has_traffic_filtering=True,id=87be3bc7-3281-4732-8ba2-8a1d89d724fe,network=Network(c9839188-595f-4aa5-a6e7-c05d3aed9f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87be3bc7-32') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:50:8e,bridge_name='br-int',has_traffic_filtering=True,id=87be3bc7-3281-4732-8ba2-8a1d89d724fe,network=Network(c9839188-595f-4aa5-a6e7-c05d3aed9f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87be3bc7-32') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87be3bc7-32, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7432894-83c3-462b-8207-6b1b14273d70) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: INFO os_vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:50:8e,bridge_name='br-int',has_traffic_filtering=True,id=87be3bc7-3281-4732-8ba2-8a1d89d724fe,network=Network(c9839188-595f-4aa5-a6e7-c05d3aed9f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87be3bc7-32')
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469752436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469752436',id=12,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtD+Tc/Qxi8jCk0tY+T6+a8eNgsPCJQIFW/mn43GL9/+tou4EBxK3lEvapma1vtNiV/zSTwYYRr5UPPvwDONUWms2rx2tx0Jip7cQzuOdKRPLyVg9QnX6blm/aqEE47g==',key_name='tempest-keypair-234643422',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb0be691fa62401a967b32a716490165',ramdisk_id='',reservation_id='r-sve1c2l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-556945540',owner_user_name='tempest-TaggedBootDevicesTest-556945540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:01:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='038526fdbc594c88ba8ed742fa8dc471',uuid=ab907f07-df7b-4d56-baef-f2502b88b622,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "address": "fa:16:3e:1d:25:78", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90de25ad-46", "ovs_interfaceid": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converting VIF {"id": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "address": "fa:16:3e:1d:25:78", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90de25ad-46", "ovs_interfaceid": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:25:78,bridge_name='br-int',has_traffic_filtering=True,id=90de25ad-46b1-410a-bfc6-81ad5873c4f0,network=Network(c9839188-595f-4aa5-a6e7-c05d3aed9f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90de25ad-46') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:25:78,bridge_name='br-int',has_traffic_filtering=True,id=90de25ad-46b1-410a-bfc6-81ad5873c4f0,network=Network(c9839188-595f-4aa5-a6e7-c05d3aed9f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90de25ad-46') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90de25ad-46, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ef3b5b5-d2fc-4749-826e-b7cd3fe316eb) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:06 user nova-compute[75021]: INFO os_vif [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:25:78,bridge_name='br-int',has_traffic_filtering=True,id=90de25ad-46b1-410a-bfc6-81ad5873c4f0,network=Network(c9839188-595f-4aa5-a6e7-c05d3aed9f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90de25ad-46')
Dec 06 07:03:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ibAxPcmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:03:06 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4705a5c3-29d2-46a7-8f96-2f29156416d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:03:06 user nova-compute[75021]: No targets found.
Dec 06 07:03:06 user nova-compute[75021]: iSNS:
Dec 06 07:03:06 user nova-compute[75021]: No targets found.
Dec 06 07:03:06 user nova-compute[75021]: STATIC:
Dec 06 07:03:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5
Dec 06 07:03:06 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:03:06 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:03:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3
Dec 06 07:03:06 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:03:06 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:03:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d
Dec 06 07:03:06 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:03:06 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:03:06 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794
Dec 06 07:03:06 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:03:06 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:03:06 user nova-compute[75021]: FIRMWARE:
Dec 06 07:03:06 user nova-compute[75021]: No targets found.
Dec 06 07:03:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:03:06 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:03:06 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf1cfcb-3c4a-4c60-8c35-cb116ac25c25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4981308a-3201-4f5e-918a-e6fd0741950f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:06 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:03:06 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:03:06 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:03:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:06 user nova-compute[75021]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 (non-flash)
Dec 06 07:03:06 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:03:06 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:03:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b47f1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3'): ({'sdc'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Removing single pathed devices sdc {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:03:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26d0651-248b-48f4-a491-e5c6293343e7]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[03567491-0105-4e1d-832f-2ce10fc19b24]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Flushing IO for device /dev/sdc {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a649f2-f93f-463d-8f18-4c587805f9b2]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.070s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a926532-2660-4a2a-8cdc-20f54dc321e4]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5306e29-5089-4973-b2ea-2c088f54e607]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba91ccc9-734a-4850-803d-747af19707bc]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3, portal: 172.16.0.220,3260]
Dec 06 07:03:07 user nova-compute[75021]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3, portal: 172.16.0.220,3260] successful.
Dec 06 07:03:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e5496c-0ebb-419a-9cb5-779af8247ec3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7704b6d2-884d-4b7b-a122-de87232a712e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] <== disconnect_volume: return (441ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjbFHtoY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:03:07 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0b66ee-5d7d-4037-a674-037d03dd5373]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:03:07 user nova-compute[75021]: No targets found.
Dec 06 07:03:07 user nova-compute[75021]: iSNS:
Dec 06 07:03:07 user nova-compute[75021]: No targets found.
Dec 06 07:03:07 user nova-compute[75021]: STATIC:
Dec 06 07:03:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5
Dec 06 07:03:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:03:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:03:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d
Dec 06 07:03:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:03:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:03:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794
Dec 06 07:03:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:03:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:03:07 user nova-compute[75021]: FIRMWARE:
Dec 06 07:03:07 user nova-compute[75021]: No targets found.
Dec 06 07:03:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:03:07 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:03:07 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[392d0b0a-80ef-4af9-9a9d-237494ac7809]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48de59e-3229-48c3-904d-815d878c974e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:07 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:03:07 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:03:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:07 user nova-compute[75021]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 (non-flash)
Dec 06 07:03:07 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:03:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b47f1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794'): ({'sde'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Removing single pathed devices sde {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[913fbcda-384d-4903-9373-af0d055c9c46]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa24eb0d-46b6-4375-91f9-96f9f9ab9028]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Flushing IO for device /dev/sde {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9affb6db-72ac-4755-b55b-76115a053b43]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.070s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6ed496-afbc-4220-b2ff-1066c87ea873]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d007ec5-f7b0-4ea9-8836-834dcde87e0b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeb3825-0f78-4589-86bc-14afaa674d89]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794, portal: 172.16.0.220,3260]
Dec 06 07:03:07 user nova-compute[75021]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794, portal: 172.16.0.220,3260] successful.
Dec 06 07:03:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c92406e3-bbbe-45a5-8099-4798ac4ba794 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e342ba3f-63a1-465e-83de-d8e42fcb3746]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] <== disconnect_volume: return (389ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSEGodcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:03:07 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc13347a-b35e-4a16-b083-23611a601edf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:03:07 user nova-compute[75021]: No targets found.
Dec 06 07:03:07 user nova-compute[75021]: iSNS:
Dec 06 07:03:07 user nova-compute[75021]: No targets found.
Dec 06 07:03:07 user nova-compute[75021]: STATIC:
Dec 06 07:03:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5
Dec 06 07:03:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:03:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:03:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d
Dec 06 07:03:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:03:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:03:07 user nova-compute[75021]: FIRMWARE:
Dec 06 07:03:07 user nova-compute[75021]: No targets found.
Dec 06 07:03:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:03:07 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:03:07 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae30c97b-563d-4e11-8128-7b5af4954d35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96abca1-58f2-4259-95d7-9118e8c9c952]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:07 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:03:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:07 user nova-compute[75021]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 (non-flash)
Dec 06 07:03:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b47f1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5'): ({'sdf'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Removing single pathed devices sdf {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.045s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2d44c2-98fa-4d59-96e2-52c4061270f0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-16f5b4cc-aef4-43c4-a87f-81993a0cdee9 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-16f5b4cc-aef4-43c4-a87f-81993a0cdee9 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:07 user nova-compute[75021]: WARNING nova.compute.manager [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-16f5b4cc-aef4-43c4-a87f-81993a0cdee9 for instance with vm_state active and task_state deleting.
Dec 06 07:03:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-unplugged-87be3bc7-3281-4732-8ba2-8a1d89d724fe {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-unplugged-87be3bc7-3281-4732-8ba2-8a1d89d724fe {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-unplugged-87be3bc7-3281-4732-8ba2-8a1d89d724fe for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-87be3bc7-3281-4732-8ba2-8a1d89d724fe {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-87be3bc7-3281-4732-8ba2-8a1d89d724fe {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:07 user nova-compute[75021]: WARNING nova.compute.manager [req-9e6fa97b-2ddb-4049-8a38-981d6216c5c0 req-58e4aca6-5b0a-4cfd-9414-4a61d1b4cf1f service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-87be3bc7-3281-4732-8ba2-8a1d89d724fe for instance with vm_state active and task_state deleting.
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.031s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[23acaf62-4a72-43e9-a40b-ad6899324ad5]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Flushing IO for device /dev/sdf {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd0b692-e1e9-4cd4-ad73-24f7dbbcf19a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:03:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[666d334e-15af-4192-8058-393fcd001b44]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ad26a1-7772-4207-a3a3-fc71a60fa55e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[33000e45-7107-4c1b-8a12-36cbc1ba04f2]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5, portal: 172.16.0.220,3260]
Dec 06 07:03:08 user nova-compute[75021]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5, portal: 172.16.0.220,3260] successful.
Dec 06 07:03:08 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2452ccce-7f6e-4168-b492-cc4cfa3519e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[417ceb37-3681-4a87-a8c0-f9325056b45a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] <== disconnect_volume: return (415ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:03:08 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Deleting instance files /opt/stack/data/nova/instances/ab907f07-df7b-4d56-baef-f2502b88b622_del
Dec 06 07:03:08 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Deletion of /opt/stack/data/nova/instances/ab907f07-df7b-4d56-baef-f2502b88b622_del complete
Dec 06 07:03:08 user nova-compute[75021]: INFO nova.compute.manager [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Took 4.21 seconds to destroy the instance on the hypervisor.
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:08 user nova-compute[75021]: WARNING nova.compute.manager [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e for instance with vm_state active and task_state deleting.
Dec 06 07:03:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-unplugged-90de25ad-46b1-410a-bfc6-81ad5873c4f0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-unplugged-90de25ad-46b1-410a-bfc6-81ad5873c4f0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-unplugged-90de25ad-46b1-410a-bfc6-81ad5873c4f0 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-plugged-90de25ad-46b1-410a-bfc6-81ad5873c4f0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] Acquiring lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] Lock "ab907f07-df7b-4d56-baef-f2502b88b622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] No waiting events found dispatching network-vif-plugged-90de25ad-46b1-410a-bfc6-81ad5873c4f0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:08 user nova-compute[75021]: WARNING nova.compute.manager [req-b1485683-e86c-4544-9506-7fe1495a80bd req-03e0dce7-66e3-4c10-ab0c-758da4392582 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received unexpected event network-vif-plugged-90de25ad-46b1-410a-bfc6-81ad5873c4f0 for instance with vm_state active and task_state deleting.
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:09 user nova-compute[75021]: INFO nova.compute.manager [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Unshelving
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:09 user nova-compute[75021]: INFO nova.compute.manager [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Terminating instance
Dec 06 07:03:09 user nova-compute[75021]: DEBUG nova.compute.manager [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:03:09 user nova-compute[75021]: INFO nova.virt.block_device [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Booting with volume 239e00ec-bb8c-4be2-9e22-1cb61ee8b21c at /dev/vdc
Dec 06 07:03:09 user nova-compute[75021]: DEBUG os_brick.utils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecff55e1-6b1c-4478-8683-96439350d980]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bde0d85-0877-4feb-a1e1-4b43fa358793]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed52be7e-0bab-4bd7-b5f2-3e9086fbdf4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6b21c7-65cb-48f7-af88-b2ee22349350]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:03:09 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:03:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d89e5f-99ed-463b-8d30-9874efbbd11d]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG os_brick.utils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:03:09 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Updating existing volume attachment record: 1e4506a5-4d98-4a0d-8572-286d880845aa {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:03:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Instance destroyed successfully.
Dec 06 07:03:10 user nova-compute[75021]: DEBUG nova.objects.instance [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lazy-loading 'resources' on Instance uuid 91eeb5a9-b6de-40c0-bc37-49768cc15c9c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T06:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-9053064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-9053064',id=8,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfxPXtIc47E18m6Z4qikWqTz2rTTY3bjnRhlRvdXGj9tpXYrXf76otmdZT3oE+W47oRVEPxUwhFLz0Caec3zbc1/KigN/WcfjgJ+3ELWkAH6KQ8DaAIyV9KAyPj8VZgwQ==',key_name='tempest-keypair-399869130',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb6fd76416e04d298f16ae4dffbb2191',ramdisk_id='',reservation_id='r-21w39m30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1423166060',owner_user_name='tempest-TaggedAttachmentsTest-1423166060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T06:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2de88a1aa57403e8c6614458998b059',uuid=91eeb5a9-b6de-40c0-bc37-49768cc15c9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "address": "fa:16:3e:91:f2:66", "network": {"id": "ad977a07-4f22-4e25-a953-2c36fdc6aafd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-324709235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94173bea-6e", "ovs_interfaceid": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Converting VIF {"id": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "address": "fa:16:3e:91:f2:66", "network": {"id": "ad977a07-4f22-4e25-a953-2c36fdc6aafd", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-324709235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb6fd76416e04d298f16ae4dffbb2191", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94173bea-6e", "ovs_interfaceid": "94173bea-6e40-4bcc-afe0-031fb7fde7fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=94173bea-6e40-4bcc-afe0-031fb7fde7fa,network=Network(ad977a07-4f22-4e25-a953-2c36fdc6aafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94173bea-6e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG os_vif [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=94173bea-6e40-4bcc-afe0-031fb7fde7fa,network=Network(ad977a07-4f22-4e25-a953-2c36fdc6aafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94173bea-6e') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94173bea-6e, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61c0b37a-4024-4eb3-8cf6-88fd10445d00) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:10 user nova-compute[75021]: INFO os_vif [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=94173bea-6e40-4bcc-afe0-031fb7fde7fa,network=Network(ad977a07-4f22-4e25-a953-2c36fdc6aafd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94173bea-6e')
Dec 06 07:03:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Deleting instance files /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c_del
Dec 06 07:03:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Deletion of /opt/stack/data/nova/instances/91eeb5a9-b6de-40c0-bc37-49768cc15c9c_del complete
Dec 06 07:03:10 user nova-compute[75021]: INFO nova.compute.manager [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Took 0.96 seconds to destroy the instance on the hypervisor.
Dec 06 07:03:10 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-a2328583-02fb-424b-bae5-803c85f0e8f4 req-34ffbac1-dbdd-4649-ab6f-36711a385ecf service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-deleted-cfaeaf2a-91aa-405d-ab13-b3827d9165e3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:10 user nova-compute[75021]: INFO nova.compute.manager [req-a2328583-02fb-424b-bae5-803c85f0e8f4 req-34ffbac1-dbdd-4649-ab6f-36711a385ecf service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Neutron deleted interface cfaeaf2a-91aa-405d-ab13-b3827d9165e3; detaching it from the instance and deleting it from the info cache
Dec 06 07:03:10 user nova-compute[75021]: DEBUG nova.network.neutron [req-a2328583-02fb-424b-bae5-803c85f0e8f4 req-34ffbac1-dbdd-4649-ab6f-36711a385ecf service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating instance_info_cache with network_info: [{"id": "69fc2f53-a06e-4792-9f4d-5044050ed607", "address": "fa:16:3e:ce:59:97", "network": {"id": "68f06c4c-2346-43fc-b05a-a1316f086ac9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-574220473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69fc2f53-a0", "ovs_interfaceid": "69fc2f53-a06e-4792-9f4d-5044050ed607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "address": "fa:16:3e:98:90:3a", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape296dd9b-d7", "ovs_interfaceid": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "address": "fa:16:3e:b8:dc:57", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f5b4cc-ae", "ovs_interfaceid": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "address": "fa:16:3e:0c:80:0f", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ea8b6-97", "ovs_interfaceid": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "address": "fa:16:3e:c6:50:8e", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87be3bc7-32", "ovs_interfaceid": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "address": "fa:16:3e:1d:25:78", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90de25ad-46", "ovs_interfaceid": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-a2328583-02fb-424b-bae5-803c85f0e8f4 req-34ffbac1-dbdd-4649-ab6f-36711a385ecf service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Detach interface failed, port_id=cfaeaf2a-91aa-405d-ab13-b3827d9165e3, reason: Instance ab907f07-df7b-4d56-baef-f2502b88b622 could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 07:03:11 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:11 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Took 1.24 seconds to deallocate network for instance.
Dec 06 07:03:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-ec3f1cc2-27ed-4449-80a9-0210550184aa req-4568c3f9-1041-4375-b1ba-ef1b7e118dac service nova] [instance: 91eeb5a9-b6de-40c0-bc37-49768cc15c9c] Received event network-vif-deleted-94173bea-6e40-4bcc-afe0-031fb7fde7fa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:12 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Deleted allocations for instance 91eeb5a9-b6de-40c0-bc37-49768cc15c9c
Dec 06 07:03:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82e666e5-392e-4ccb-9cfb-d28fb9e8ccbe tempest-TaggedAttachmentsTest-1423166060 tempest-TaggedAttachmentsTest-1423166060-project-member] Lock "91eeb5a9-b6de-40c0-bc37-49768cc15c9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.922s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-100d4b63-143c-4126-bdfd-1c3afac74cab req-9d2b2b11-4b2d-42c9-b601-1c663c6e22f2 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-deleted-69fc2f53-a06e-4792-9f4d-5044050ed607 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:12 user nova-compute[75021]: INFO nova.compute.manager [req-100d4b63-143c-4126-bdfd-1c3afac74cab req-9d2b2b11-4b2d-42c9-b601-1c663c6e22f2 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Neutron deleted interface 69fc2f53-a06e-4792-9f4d-5044050ed607; detaching it from the instance and deleting it from the info cache
Dec 06 07:03:12 user nova-compute[75021]: DEBUG nova.network.neutron [req-100d4b63-143c-4126-bdfd-1c3afac74cab req-9d2b2b11-4b2d-42c9-b601-1c663c6e22f2 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating instance_info_cache with network_info: [{"id": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "address": "fa:16:3e:98:90:3a", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape296dd9b-d7", "ovs_interfaceid": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "address": "fa:16:3e:b8:dc:57", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f5b4cc-ae", "ovs_interfaceid": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "address": "fa:16:3e:0c:80:0f", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ea8b6-97", "ovs_interfaceid": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "address": "fa:16:3e:c6:50:8e", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87be3bc7-32", "ovs_interfaceid": "87be3bc7-3281-4732-8ba2-8a1d89d724fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "address": "fa:16:3e:1d:25:78", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90de25ad-46", "ovs_interfaceid": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-100d4b63-143c-4126-bdfd-1c3afac74cab req-9d2b2b11-4b2d-42c9-b601-1c663c6e22f2 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Detach interface failed, port_id=69fc2f53-a06e-4792-9f4d-5044050ed607, reason: Instance ab907f07-df7b-4d56-baef-f2502b88b622 could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-100d4b63-143c-4126-bdfd-1c3afac74cab req-9d2b2b11-4b2d-42c9-b601-1c663c6e22f2 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-deleted-87be3bc7-3281-4732-8ba2-8a1d89d724fe {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:12 user nova-compute[75021]: INFO nova.compute.manager [req-100d4b63-143c-4126-bdfd-1c3afac74cab req-9d2b2b11-4b2d-42c9-b601-1c663c6e22f2 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Neutron deleted interface 87be3bc7-3281-4732-8ba2-8a1d89d724fe; detaching it from the instance and deleting it from the info cache
Dec 06 07:03:12 user nova-compute[75021]: DEBUG nova.network.neutron [req-100d4b63-143c-4126-bdfd-1c3afac74cab req-9d2b2b11-4b2d-42c9-b601-1c663c6e22f2 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating instance_info_cache with network_info: [{"id": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "address": "fa:16:3e:98:90:3a", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape296dd9b-d7", "ovs_interfaceid": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "address": "fa:16:3e:b8:dc:57", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f5b4cc-ae", "ovs_interfaceid": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "address": "fa:16:3e:0c:80:0f", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ea8b6-97", "ovs_interfaceid": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "address": "fa:16:3e:1d:25:78", "network": {"id": "c9839188-595f-4aa5-a6e7-c05d3aed9f5d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1803528730", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90de25ad-46", "ovs_interfaceid": "90de25ad-46b1-410a-bfc6-81ad5873c4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-100d4b63-143c-4126-bdfd-1c3afac74cab req-9d2b2b11-4b2d-42c9-b601-1c663c6e22f2 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Detach interface failed, port_id=87be3bc7-3281-4732-8ba2-8a1d89d724fe, reason: Instance ab907f07-df7b-4d56-baef-f2502b88b622 could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-100d4b63-143c-4126-bdfd-1c3afac74cab req-9d2b2b11-4b2d-42c9-b601-1c663c6e22f2 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-deleted-90de25ad-46b1-410a-bfc6-81ad5873c4f0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:12 user nova-compute[75021]: INFO nova.compute.manager [req-100d4b63-143c-4126-bdfd-1c3afac74cab req-9d2b2b11-4b2d-42c9-b601-1c663c6e22f2 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Neutron deleted interface 90de25ad-46b1-410a-bfc6-81ad5873c4f0; detaching it from the instance and deleting it from the info cache
Dec 06 07:03:12 user nova-compute[75021]: DEBUG nova.network.neutron [req-100d4b63-143c-4126-bdfd-1c3afac74cab req-9d2b2b11-4b2d-42c9-b601-1c663c6e22f2 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating instance_info_cache with network_info: [{"id": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "address": "fa:16:3e:98:90:3a", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape296dd9b-d7", "ovs_interfaceid": "e296dd9b-d7a0-48d3-b8e3-4e9e48595e9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "address": "fa:16:3e:b8:dc:57", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f5b4cc-ae", "ovs_interfaceid": "16f5b4cc-aef4-43c4-a87f-81993a0cdee9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "address": "fa:16:3e:0c:80:0f", "network": {"id": "85745779-46c5-44b2-9211-cddb150f558b", "bridge": "br-int", "label": "tempest-device-tagging-net1-89820422", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bb0be691fa62401a967b32a716490165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b7ea8b6-97", "ovs_interfaceid": "8b7ea8b6-978c-4760-b4eb-81ca2fe10caa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:12 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Took 4.35 seconds to deallocate network for instance.
Dec 06 07:03:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-100d4b63-143c-4126-bdfd-1c3afac74cab req-9d2b2b11-4b2d-42c9-b601-1c663c6e22f2 service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Detach interface failed, port_id=90de25ad-46b1-410a-bfc6-81ad5873c4f0, reason: Instance ab907f07-df7b-4d56-baef-f2502b88b622 could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvehRiEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:03:12 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:03:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:03:12 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:03:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:03:12 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:03:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda971ba-3d4c-4123-9511-a947322ed785]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:03:12 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[01617dff-ac27-47d9-a103-4635e7e27de4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635] added
Dec 06 07:03:12 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd6852c-4032-48d1-90df-5d283e9444c5]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e38d1d-c0ce-4635-bfda-dbc67a1d2dea]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvehRiEa {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvehRiEa" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e2fba8-8a90-466f-8f2e-7b1c08e029f0]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvehRiEa'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d01038-033e-4119-9e59-ce7f95bc0b10]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[427b18d6-8e6b-4c1f-b3bb-d523953a248c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:13 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:13 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a16e3c1-fc01-4e23-922a-b72eb6301e77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260]
Dec 06 07:03:13 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260] successful.
Dec 06 07:03:13 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6725bba-21aa-4b5f-abfe-8638b5b30253]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[412c5188-770d-4d51-8987-4f8198b9fb57]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:13 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:03:13 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:13 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:03:13 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05aed32-42c8-438b-a62f-767885596ea9]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:03:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvehRiEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:03:14 user nova-compute[75021]: INFO nova.compute.claims [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Claim successful on node user
Dec 06 07:03:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23233613435323961', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233613435323961', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lazy-loading 'flavor' on Instance uuid 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:03:14 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:03:14 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:03:14 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:03:14 user nova-compute[75021]:   <serial>7ccdd51d-7737-4a34-b5ab-e986a8a87635</serial>
Dec 06 07:03:14 user nova-compute[75021]: </disk>
Dec 06 07:03:14 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-1a68215f-2c10-4669-99d0-6273f72d46c7 req-0d553b34-4a2a-4db8-bf91-d5c8d51428ad service nova] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Received event network-vif-deleted-8b7ea8b6-978c-4760-b4eb-81ca2fe10caa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] No VIF found with MAC fa:16:3e:43:60:12, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:03:14 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:03:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:03:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b8bb2b84-d057-4ae5-9147-c90a48382725 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.048s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG nova.policy [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54cf3afd4b904266877afc19aca2d223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08ce66a727943c7a4e1cf96225c9ff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:03:15 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Creating image(s)
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "/opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "/opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.107s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.216s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:15 user nova-compute[75021]: INFO nova.compute.manager [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] [instance: ab907f07-df7b-4d56-baef-f2502b88b622] Took 2.84 seconds to detach 3 volumes for instance.
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.215s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk 1073741824" returned: 0 in 0.056s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:15 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Successfully created port: 7e699ac5-b079-428e-9728-ce1b30ed4feb {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Cannot resize image /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Ensure instance console log exists: /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.630s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:16 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Deleted allocations for instance ab907f07-df7b-4d56-baef-f2502b88b622
Dec 06 07:03:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c20cb974-745e-4afc-8a44-915b00cd99e0 tempest-TaggedBootDevicesTest-556945540 tempest-TaggedBootDevicesTest-556945540-project-member] Lock "ab907f07-df7b-4d56-baef-f2502b88b622" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.301s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Successfully updated port: 7e699ac5-b079-428e-9728-ce1b30ed4feb {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "refresh_cache-5c50a6a8-2500-4408-a932-48f0116713b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquired lock "refresh_cache-5c50a6a8-2500-4408-a932-48f0116713b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-8fed93c3-88bc-45c7-a5a8-83fb85b74f66 req-01fb3327-3ac3-4190-adcd-a8925dba9736 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Received event network-changed-7e699ac5-b079-428e-9728-ce1b30ed4feb {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-8fed93c3-88bc-45c7-a5a8-83fb85b74f66 req-01fb3327-3ac3-4190-adcd-a8925dba9736 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Refreshing instance network info cache due to event network-changed-7e699ac5-b079-428e-9728-ce1b30ed4feb. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8fed93c3-88bc-45c7-a5a8-83fb85b74f66 req-01fb3327-3ac3-4190-adcd-a8925dba9736 service nova] Acquiring lock "refresh_cache-5c50a6a8-2500-4408-a932-48f0116713b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Updating instance_info_cache with network_info: [{"id": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "address": "fa:16:3e:f3:41:7d", "network": {"id": "6838b696-43bf-4794-ae4c-82828037f5cf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1983647302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ce66a727943c7a4e1cf96225c9ff1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e699ac5-b0", "ovs_interfaceid": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Releasing lock "refresh_cache-5c50a6a8-2500-4408-a932-48f0116713b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Instance network_info: |[{"id": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "address": "fa:16:3e:f3:41:7d", "network": {"id": "6838b696-43bf-4794-ae4c-82828037f5cf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1983647302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ce66a727943c7a4e1cf96225c9ff1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e699ac5-b0", "ovs_interfaceid": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8fed93c3-88bc-45c7-a5a8-83fb85b74f66 req-01fb3327-3ac3-4190-adcd-a8925dba9736 service nova] Acquired lock "refresh_cache-5c50a6a8-2500-4408-a932-48f0116713b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG nova.network.neutron [req-8fed93c3-88bc-45c7-a5a8-83fb85b74f66 req-01fb3327-3ac3-4190-adcd-a8925dba9736 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Refreshing network info cache for port 7e699ac5-b079-428e-9728-ce1b30ed4feb {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:03:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Start _get_guest_xml network_info=[{"id": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "address": "fa:16:3e:f3:41:7d", "network": {"id": "6838b696-43bf-4794-ae4c-82828037f5cf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1983647302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ce66a727943c7a4e1cf96225c9ff1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e699ac5-b0", "ovs_interfaceid": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:03:17 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:03:17 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-425835316',display_name='tempest-SnapshotDataIntegrityTests-server-425835316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-425835316',id=15,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfii4FMkd/GlcN10MafXmbTff/4PzXa0nSqVQgaOB0SNTuzZUoJxz61fBVxzkybhlW83jCdOx1Ku64rZ2KdUbn2Pns4BMIGh5pYj+ntXHi5axVPiX+PR8h0EM5rwyOGFQ==',key_name='tempest-keypair-1607569311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c08ce66a727943c7a4e1cf96225c9ff1',ramdisk_id='',reservation_id='r-69fzhje0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-750605823',owner_user_name='tempest-SnapshotDataIntegrityTests-750605823-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54cf3afd4b904266877afc19aca2d223',uuid=5c50a6a8-2500-4408-a932-48f0116713b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "address": "fa:16:3e:f3:41:7d", "network": {"id": "6838b696-43bf-4794-ae4c-82828037f5cf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1983647302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ce66a727943c7a4e1cf96225c9ff1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e699ac5-b0", "ovs_interfaceid": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Converting VIF {"id": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "address": "fa:16:3e:f3:41:7d", "network": {"id": "6838b696-43bf-4794-ae4c-82828037f5cf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1983647302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ce66a727943c7a4e1cf96225c9ff1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e699ac5-b0", "ovs_interfaceid": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:41:7d,bridge_name='br-int',has_traffic_filtering=True,id=7e699ac5-b079-428e-9728-ce1b30ed4feb,network=Network(6838b696-43bf-4794-ae4c-82828037f5cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e699ac5-b0') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.objects.instance [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:03:17 user nova-compute[75021]:   <uuid>5c50a6a8-2500-4408-a932-48f0116713b8</uuid>
Dec 06 07:03:17 user nova-compute[75021]:   <name>instance-0000000f</name>
Dec 06 07:03:17 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:03:17 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:03:17 user nova-compute[75021]:   <metadata>
Dec 06 07:03:17 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:03:17 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:03:17 user nova-compute[75021]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-425835316</nova:name>
Dec 06 07:03:17 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:03:17</nova:creationTime>
Dec 06 07:03:17 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:03:17 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:03:17 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:03:17 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:03:17 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:03:17 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:03:17 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:03:17 user nova-compute[75021]:       <nova:owner>
Dec 06 07:03:17 user nova-compute[75021]:         <nova:user uuid="54cf3afd4b904266877afc19aca2d223">tempest-SnapshotDataIntegrityTests-750605823-project-member</nova:user>
Dec 06 07:03:17 user nova-compute[75021]:         <nova:project uuid="c08ce66a727943c7a4e1cf96225c9ff1">tempest-SnapshotDataIntegrityTests-750605823</nova:project>
Dec 06 07:03:17 user nova-compute[75021]:       </nova:owner>
Dec 06 07:03:17 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:03:17 user nova-compute[75021]:       <nova:ports>
Dec 06 07:03:17 user nova-compute[75021]:         <nova:port uuid="7e699ac5-b079-428e-9728-ce1b30ed4feb">
Dec 06 07:03:17 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 07:03:17 user nova-compute[75021]:         </nova:port>
Dec 06 07:03:17 user nova-compute[75021]:       </nova:ports>
Dec 06 07:03:17 user nova-compute[75021]:     </nova:instance>
Dec 06 07:03:17 user nova-compute[75021]:   </metadata>
Dec 06 07:03:17 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:03:17 user nova-compute[75021]:     <system>
Dec 06 07:03:17 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:03:17 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:03:17 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:03:17 user nova-compute[75021]:       <entry name="serial">5c50a6a8-2500-4408-a932-48f0116713b8</entry>
Dec 06 07:03:17 user nova-compute[75021]:       <entry name="uuid">5c50a6a8-2500-4408-a932-48f0116713b8</entry>
Dec 06 07:03:17 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:03:17 user nova-compute[75021]:     </system>
Dec 06 07:03:17 user nova-compute[75021]:   </sysinfo>
Dec 06 07:03:17 user nova-compute[75021]:   <os>
Dec 06 07:03:17 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:03:17 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:03:17 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:03:17 user nova-compute[75021]:   </os>
Dec 06 07:03:17 user nova-compute[75021]:   <features>
Dec 06 07:03:17 user nova-compute[75021]:     <acpi/>
Dec 06 07:03:17 user nova-compute[75021]:     <apic/>
Dec 06 07:03:17 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:03:17 user nova-compute[75021]:   </features>
Dec 06 07:03:17 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:03:17 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:03:17 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:03:17 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:03:17 user nova-compute[75021]:   </clock>
Dec 06 07:03:17 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:03:17 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:03:17 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:03:17 user nova-compute[75021]:   </cpu>
Dec 06 07:03:17 user nova-compute[75021]:   <devices>
Dec 06 07:03:17 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:03:17 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:03:17 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk"/>
Dec 06 07:03:17 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:03:17 user nova-compute[75021]:     </disk>
Dec 06 07:03:17 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:03:17 user nova-compute[75021]:       <mac address="fa:16:3e:f3:41:7d"/>
Dec 06 07:03:17 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:03:17 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:03:17 user nova-compute[75021]:       <target dev="tap7e699ac5-b0"/>
Dec 06 07:03:17 user nova-compute[75021]:     </interface>
Dec 06 07:03:17 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:03:17 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/console.log" append="off"/>
Dec 06 07:03:17 user nova-compute[75021]:     </serial>
Dec 06 07:03:17 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:03:17 user nova-compute[75021]:     <video>
Dec 06 07:03:17 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:03:17 user nova-compute[75021]:     </video>
Dec 06 07:03:17 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:03:17 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:03:17 user nova-compute[75021]:     </rng>
Dec 06 07:03:17 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:03:17 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:03:17 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:03:17 user nova-compute[75021]:     </memballoon>
Dec 06 07:03:17 user nova-compute[75021]:   </devices>
Dec 06 07:03:17 user nova-compute[75021]: </domain>
Dec 06 07:03:17 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-425835316',display_name='tempest-SnapshotDataIntegrityTests-server-425835316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-425835316',id=15,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfii4FMkd/GlcN10MafXmbTff/4PzXa0nSqVQgaOB0SNTuzZUoJxz61fBVxzkybhlW83jCdOx1Ku64rZ2KdUbn2Pns4BMIGh5pYj+ntXHi5axVPiX+PR8h0EM5rwyOGFQ==',key_name='tempest-keypair-1607569311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c08ce66a727943c7a4e1cf96225c9ff1',ramdisk_id='',reservation_id='r-69fzhje0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-750605823',owner_user_name='tempest-SnapshotDataIntegrityTests-750605823-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54cf3afd4b904266877afc19aca2d223',uuid=5c50a6a8-2500-4408-a932-48f0116713b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "address": "fa:16:3e:f3:41:7d", "network": {"id": "6838b696-43bf-4794-ae4c-82828037f5cf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1983647302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ce66a727943c7a4e1cf96225c9ff1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e699ac5-b0", "ovs_interfaceid": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Converting VIF {"id": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "address": "fa:16:3e:f3:41:7d", "network": {"id": "6838b696-43bf-4794-ae4c-82828037f5cf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1983647302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ce66a727943c7a4e1cf96225c9ff1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e699ac5-b0", "ovs_interfaceid": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:41:7d,bridge_name='br-int',has_traffic_filtering=True,id=7e699ac5-b079-428e-9728-ce1b30ed4feb,network=Network(6838b696-43bf-4794-ae4c-82828037f5cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e699ac5-b0') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG os_vif [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:41:7d,bridge_name='br-int',has_traffic_filtering=True,id=7e699ac5-b079-428e-9728-ce1b30ed4feb,network=Network(6838b696-43bf-4794-ae4c-82828037f5cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e699ac5-b0') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e3848eb-3ea5-529b-86b5-6f7e9b3c80de', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e699ac5-b0, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e699ac5-b0, col_values=(('qos', UUID('088e6912-55c2-4db0-911d-b17b8f26401e')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e699ac5-b0, col_values=(('external_ids', {'iface-id': '7e699ac5-b079-428e-9728-ce1b30ed4feb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:41:7d', 'vm-uuid': '5c50a6a8-2500-4408-a932-48f0116713b8'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:17 user nova-compute[75021]: INFO os_vif [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:41:7d,bridge_name='br-int',has_traffic_filtering=True,id=7e699ac5-b079-428e-9728-ce1b30ed4feb,network=Network(6838b696-43bf-4794-ae4c-82828037f5cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e699ac5-b0')
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] No VIF found with MAC fa:16:3e:f3:41:7d, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Stashing vm_state: active {{(pid=75021) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:03:17 user nova-compute[75021]: INFO nova.compute.claims [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Claim successful on node user
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.network.neutron [req-8fed93c3-88bc-45c7-a5a8-83fb85b74f66 req-01fb3327-3ac3-4190-adcd-a8925dba9736 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Updated VIF entry in instance network info cache for port 7e699ac5-b079-428e-9728-ce1b30ed4feb. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.network.neutron [req-8fed93c3-88bc-45c7-a5a8-83fb85b74f66 req-01fb3327-3ac3-4190-adcd-a8925dba9736 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Updating instance_info_cache with network_info: [{"id": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "address": "fa:16:3e:f3:41:7d", "network": {"id": "6838b696-43bf-4794-ae4c-82828037f5cf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1983647302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ce66a727943c7a4e1cf96225c9ff1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e699ac5-b0", "ovs_interfaceid": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8fed93c3-88bc-45c7-a5a8-83fb85b74f66 req-01fb3327-3ac3-4190-adcd-a8925dba9736 service nova] Releasing lock "refresh_cache-5c50a6a8-2500-4408-a932-48f0116713b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:03:17 user nova-compute[75021]: INFO nova.compute.resource_tracker [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updating resource usage from migration 99ebc416-4861-41d1-a463-6c587341ecbd
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.510s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:17 user nova-compute[75021]: INFO nova.compute.manager [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Migrating
Dec 06 07:03:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:03:17 user nova-compute[75021]: INFO nova.compute.rpcapi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Dec 06 07:03:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquired lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:03:17 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:03:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updating instance_info_cache with network_info: [{"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Releasing lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:03:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Starting migrate_disk_and_power_off {{(pid=75021) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11490}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG nova.compute.manager [req-1b923573-428d-4a88-8e0c-b1bb621b6d67 req-b0d5b208-636e-4151-8d13-b7a9d422d0f0 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Received event network-vif-plugged-7e699ac5-b079-428e-9728-ce1b30ed4feb {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1b923573-428d-4a88-8e0c-b1bb621b6d67 req-b0d5b208-636e-4151-8d13-b7a9d422d0f0 service nova] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1b923573-428d-4a88-8e0c-b1bb621b6d67 req-b0d5b208-636e-4151-8d13-b7a9d422d0f0 service nova] Lock "5c50a6a8-2500-4408-a932-48f0116713b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1b923573-428d-4a88-8e0c-b1bb621b6d67 req-b0d5b208-636e-4151-8d13-b7a9d422d0f0 service nova] Lock "5c50a6a8-2500-4408-a932-48f0116713b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG nova.compute.manager [req-1b923573-428d-4a88-8e0c-b1bb621b6d67 req-b0d5b208-636e-4151-8d13-b7a9d422d0f0 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] No waiting events found dispatching network-vif-plugged-7e699ac5-b079-428e-9728-ce1b30ed4feb {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:19 user nova-compute[75021]: WARNING nova.compute.manager [req-1b923573-428d-4a88-8e0c-b1bb621b6d67 req-b0d5b208-636e-4151-8d13-b7a9d422d0f0 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Received unexpected event network-vif-plugged-7e699ac5-b079-428e-9728-ce1b30ed4feb for instance with vm_state building and task_state spawning.
Dec 06 07:03:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:19 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Instance destroyed successfully.
Dec 06 07:03:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-272299805',display_name='tempest-ServerActionsTestOtherB-server-272299805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-272299805',id=4,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDr10Uf7mSfaKxaWiZMlOkgp+3gz+zk9cuGM2WOwPxRQl0KGDW8m0MH0trEdCAhYZHvExMqqK1A+1XoEwjfDbN1X4V66K4XOiRtH4zqe8KgY/USo0EOIRMWD8nLuB034BA==',key_name='tempest-keypair-2107162455',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d0482e21a6db45199f3c82f7f5913ec1',ramdisk_id='',reservation_id='r-lhdcj864',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1150715110',owner_user_name='tempest-ServerActionsTestOtherB-1150715110-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9273703a77bf425685228a99248f6d4e',uuid=2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1644315764-network", "vif_mac": "fa:16:3e:43:60:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converting VIF {"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1644315764-network", "vif_mac": "fa:16:3e:43:60:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG os_vif [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf48c57d0-30, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46610192-1c5c-4d73-aec6-5eaf3dc81883) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:19 user nova-compute[75021]: INFO os_vif [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30')
Dec 06 07:03:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvehRiEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:03:19 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:03:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ceb612-65c5-44e1-af5b-35140b42475e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:03:19 user nova-compute[75021]: No targets found.
Dec 06 07:03:19 user nova-compute[75021]: iSNS:
Dec 06 07:03:19 user nova-compute[75021]: No targets found.
Dec 06 07:03:19 user nova-compute[75021]: STATIC:
Dec 06 07:03:19 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635
Dec 06 07:03:19 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:03:19 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:03:19 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d
Dec 06 07:03:19 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:03:19 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:03:19 user nova-compute[75021]: FIRMWARE:
Dec 06 07:03:19 user nova-compute[75021]: No targets found.
Dec 06 07:03:19 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:03:19 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:03:19 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc95d2d-8b55-497c-92ab-1043a4cc9327]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2be37a-839b-43cb-b2c1-b38f9434e58e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:19 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:03:19 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:19 user nova-compute[75021]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:03:19 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d870b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74f4583-9b0d-4017-bd39-68fd787784dc]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ca39e6-07a3-447c-9fe5-6b66c92e55e9]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b94af0e-74d1-4af1-8bee-c90cff261c5d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:03:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cae5e7-3734-4fb5-9c39-6a8e38fce209]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70fdefa-c2cc-42b5-bc25-6f39d1ca0ea4]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb490ab1-86ab-4d0a-91a8-4e593ba933ba]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260]
Dec 06 07:03:20 user nova-compute[75021]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260] successful.
Dec 06 07:03:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[57803877-3017-421f-8b54-4d1148fea432]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] <== disconnect_volume: return (336ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf_resize/disk /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG nova.objects.instance [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'pci_requests' on Instance uuid f9275ae0-ccb1-4c73-b639-9cd243c6ff60 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG nova.objects.instance [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'numa_topology' on Instance uuid f9275ae0-ccb1-4c73-b639-9cd243c6ff60 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:03:20 user nova-compute[75021]: INFO nova.compute.claims [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Claim successful on node user
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:03:21 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Instance spawned successfully.
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquiring lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquiring lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:03:21 user nova-compute[75021]: INFO nova.compute.manager [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Terminating instance
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CMD "cp -r /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf_resize/disk /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk" returned: 0 in 0.623s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf_resize/disk.info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk.info {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CMD "cp -r /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf_resize/disk.info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk.info" returned: 0 in 0.060s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:21 user nova-compute[75021]: INFO nova.compute.manager [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Took 6.20 seconds to spawn the instance on the hypervisor.
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Received event network-vif-plugged-7e699ac5-b079-428e-9728-ce1b30ed4feb {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] Lock "5c50a6a8-2500-4408-a932-48f0116713b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] Lock "5c50a6a8-2500-4408-a932-48f0116713b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] No waiting events found dispatching network-vif-plugged-7e699ac5-b079-428e-9728-ce1b30ed4feb {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:21 user nova-compute[75021]: WARNING nova.compute.manager [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Received unexpected event network-vif-plugged-7e699ac5-b079-428e-9728-ce1b30ed4feb for instance with vm_state building and task_state spawning.
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-vif-unplugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] No waiting events found dispatching network-vif-unplugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:21 user nova-compute[75021]: WARNING nova.compute.manager [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received unexpected event network-vif-unplugged-f48c57d0-3024-4f70-8989-454717799fe3 for instance with vm_state active and task_state resize_migrating.
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] No waiting events found dispatching network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:21 user nova-compute[75021]: WARNING nova.compute.manager [req-8dc367f1-479d-4dcb-88da-3784262d0a30 req-dcb948c5-5f1b-49ee-8ad2-ef624b1522f5 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received unexpected event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 for instance with vm_state active and task_state resize_migrating.
Dec 06 07:03:21 user nova-compute[75021]: INFO nova.compute.manager [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Took 7.22 seconds to build instance.
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a0189075-6f9c-4230-98b7-f34517514a1e tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.360s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-513825fa-0722-4aca-9d2f-4dd186376ef0 req-65ab5f7a-e2fb-4ecd-ba67-94ccce4daef9 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Received event network-vif-unplugged-b3867e25-16d1-476e-8ebc-4f8bc95f785d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-513825fa-0722-4aca-9d2f-4dd186376ef0 req-65ab5f7a-e2fb-4ecd-ba67-94ccce4daef9 service nova] Acquiring lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-513825fa-0722-4aca-9d2f-4dd186376ef0 req-65ab5f7a-e2fb-4ecd-ba67-94ccce4daef9 service nova] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-513825fa-0722-4aca-9d2f-4dd186376ef0 req-65ab5f7a-e2fb-4ecd-ba67-94ccce4daef9 service nova] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-513825fa-0722-4aca-9d2f-4dd186376ef0 req-65ab5f7a-e2fb-4ecd-ba67-94ccce4daef9 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] No waiting events found dispatching network-vif-unplugged-b3867e25-16d1-476e-8ebc-4f8bc95f785d {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-513825fa-0722-4aca-9d2f-4dd186376ef0 req-65ab5f7a-e2fb-4ecd-ba67-94ccce4daef9 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Received event network-vif-unplugged-b3867e25-16d1-476e-8ebc-4f8bc95f785d for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.069s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:21 user nova-compute[75021]: INFO nova.network.neutron [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Updating port c605d9e6-fce9-495d-b4f3-e2f1e4952633 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 06 07:03:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:21 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Instance destroyed successfully.
Dec 06 07:03:21 user nova-compute[75021]: DEBUG nova.objects.instance [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lazy-loading 'resources' on Instance uuid b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2037420528',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2037420528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2037420',id=11,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCM3IMBgbPuHaw83Bd63sFw79Pok5rPcqpuEw7+B9qAyWOxNCPlhG93TV8Y2bkEU89XvSZ8arfA0Y+czfzT9nURsbZljePZpA01aIZjDjsy+UIMiWt+L0WQmus9A0juCrQ==',key_name='tempest-keypair-1635405384',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:00:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b82fc63d07764525aac64fb2c9377429',ramdisk_id='',reservation_id='r-zz09hyr2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-9680726',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:00:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80684806237b41848b68d9b5cbad474f',uuid=b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "address": "fa:16:3e:4f:b1:0c", "network": {"id": "8fae4511-0ed6-4cef-af43-c90ede6da761", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2095445360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82fc63d07764525aac64fb2c9377429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3867e25-16", "ovs_interfaceid": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Converting VIF {"id": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "address": "fa:16:3e:4f:b1:0c", "network": {"id": "8fae4511-0ed6-4cef-af43-c90ede6da761", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2095445360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b82fc63d07764525aac64fb2c9377429", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3867e25-16", "ovs_interfaceid": "b3867e25-16d1-476e-8ebc-4f8bc95f785d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:b1:0c,bridge_name='br-int',has_traffic_filtering=True,id=b3867e25-16d1-476e-8ebc-4f8bc95f785d,network=Network(8fae4511-0ed6-4cef-af43-c90ede6da761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3867e25-16') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG os_vif [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:b1:0c,bridge_name='br-int',has_traffic_filtering=True,id=b3867e25-16d1-476e-8ebc-4f8bc95f785d,network=Network(8fae4511-0ed6-4cef-af43-c90ede6da761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3867e25-16') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3867e25-16, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7284e6f-2116-4785-bac3-93d28ae671c9) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:22 user nova-compute[75021]: INFO os_vif [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:b1:0c,bridge_name='br-int',has_traffic_filtering=True,id=b3867e25-16d1-476e-8ebc-4f8bc95f785d,network=Network(8fae4511-0ed6-4cef-af43-c90ede6da761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3867e25-16')
Dec 06 07:03:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Deleting instance files /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c_del
Dec 06 07:03:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Deletion of /opt/stack/data/nova/instances/b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c_del complete
Dec 06 07:03:22 user nova-compute[75021]: INFO nova.compute.manager [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Took 1.04 seconds to destroy the instance on the hypervisor.
Dec 06 07:03:22 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquired lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG nova.network.neutron [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Port f48c57d0-3024-4f70-8989-454717799fe3 binding to destination host user is already ACTIVE {{(pid=75021) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG nova.network.neutron [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Updating instance_info_cache with network_info: [{"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Releasing lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:03:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Creating image(s)
Dec 06 07:03:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "/opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "/opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:22 user nova-compute[75021]: DEBUG nova.objects.instance [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'trusted_certs' on Instance uuid f9275ae0-ccb1-4c73-b639-9cd243c6ff60 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:23 user nova-compute[75021]: DEBUG nova.objects.base [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Object Instance<f9275ae0-ccb1-4c73-b639-9cd243c6ff60> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:03:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "2f28ebb93a3f275980cd87fc21b98eef76d84162" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "2f28ebb93a3f275980cd87fc21b98eef76d84162" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162.part --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquired lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-34b55674-9168-4fbf-8ddb-b356f6e5a1e3 req-a2165e1e-0d5d-44f3-827a-cf968e040110 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Received event network-vif-deleted-b3867e25-16d1-476e-8ebc-4f8bc95f785d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:24 user nova-compute[75021]: INFO nova.compute.manager [req-34b55674-9168-4fbf-8ddb-b356f6e5a1e3 req-a2165e1e-0d5d-44f3-827a-cf968e040110 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Neutron deleted interface b3867e25-16d1-476e-8ebc-4f8bc95f785d; detaching it from the instance and deleting it from the info cache
Dec 06 07:03:24 user nova-compute[75021]: DEBUG nova.network.neutron [req-34b55674-9168-4fbf-8ddb-b356f6e5a1e3 req-a2165e1e-0d5d-44f3-827a-cf968e040110 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-11cfb5fd-4827-4e85-adb4-dd1a129fd976 req-eaaa31a5-6296-4fc8-8706-9e9cddb5feed service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Received event network-vif-plugged-b3867e25-16d1-476e-8ebc-4f8bc95f785d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-11cfb5fd-4827-4e85-adb4-dd1a129fd976 req-eaaa31a5-6296-4fc8-8706-9e9cddb5feed service nova] Acquiring lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-11cfb5fd-4827-4e85-adb4-dd1a129fd976 req-eaaa31a5-6296-4fc8-8706-9e9cddb5feed service nova] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-11cfb5fd-4827-4e85-adb4-dd1a129fd976 req-eaaa31a5-6296-4fc8-8706-9e9cddb5feed service nova] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-11cfb5fd-4827-4e85-adb4-dd1a129fd976 req-eaaa31a5-6296-4fc8-8706-9e9cddb5feed service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] No waiting events found dispatching network-vif-plugged-b3867e25-16d1-476e-8ebc-4f8bc95f785d {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:24 user nova-compute[75021]: WARNING nova.compute.manager [req-11cfb5fd-4827-4e85-adb4-dd1a129fd976 req-eaaa31a5-6296-4fc8-8706-9e9cddb5feed service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Received unexpected event network-vif-plugged-b3867e25-16d1-476e-8ebc-4f8bc95f785d for instance with vm_state active and task_state deleting.
Dec 06 07:03:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-11cfb5fd-4827-4e85-adb4-dd1a129fd976 req-eaaa31a5-6296-4fc8-8706-9e9cddb5feed service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received event network-changed-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-11cfb5fd-4827-4e85-adb4-dd1a129fd976 req-eaaa31a5-6296-4fc8-8706-9e9cddb5feed service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Refreshing instance network info cache due to event network-changed-c605d9e6-fce9-495d-b4f3-e2f1e4952633. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-11cfb5fd-4827-4e85-adb4-dd1a129fd976 req-eaaa31a5-6296-4fc8-8706-9e9cddb5feed service nova] Acquiring lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-11cfb5fd-4827-4e85-adb4-dd1a129fd976 req-eaaa31a5-6296-4fc8-8706-9e9cddb5feed service nova] Acquired lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG nova.network.neutron [req-11cfb5fd-4827-4e85-adb4-dd1a129fd976 req-eaaa31a5-6296-4fc8-8706-9e9cddb5feed service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Refreshing network info cache for port c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:24 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Took 2.24 seconds to deallocate network for instance.
Dec 06 07:03:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-34b55674-9168-4fbf-8ddb-b356f6e5a1e3 req-a2165e1e-0d5d-44f3-827a-cf968e040110 service nova] [instance: b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c] Detach interface failed, port_id=b3867e25-16d1-476e-8ebc-4f8bc95f785d, reason: Instance b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG nova.virt.images [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] c08f3275-f5dd-4456-977a-4de852703db0 was qcow2, converting to raw {{(pid=75021) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162.part /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162.converted {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updating instance_info_cache with network_info: [{"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Releasing lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162.part /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162.converted" returned: 0 in 0.488s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162.converted --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG os_brick.utils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c5770c-3549-49bf-98d0-25c7d84008fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d93f6bd-ca6a-47d6-99e7-f204a29988f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG nova.network.neutron [req-11cfb5fd-4827-4e85-adb4-dd1a129fd976 req-eaaa31a5-6296-4fc8-8706-9e9cddb5feed service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Updated VIF entry in instance network info cache for port c605d9e6-fce9-495d-b4f3-e2f1e4952633. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG nova.network.neutron [req-11cfb5fd-4827-4e85-adb4-dd1a129fd976 req-eaaa31a5-6296-4fc8-8706-9e9cddb5feed service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Updating instance_info_cache with network_info: [{"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3601f717-fa03-4d86-aea0-a88de8863380]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[17eaa293-caf9-4beb-9797-b65bac55dc65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-11cfb5fd-4827-4e85-adb4-dd1a129fd976 req-eaaa31a5-6296-4fc8-8706-9e9cddb5feed service nova] Releasing lock "refresh_cache-f9275ae0-ccb1-4c73-b639-9cd243c6ff60" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:03:25 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0a86b3-7a34-4589-9792-a368cc90ece2]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG os_brick.utils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "2f28ebb93a3f275980cd87fc21b98eef76d84162" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.205s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162 --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.734s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:25 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Deleted allocations for instance b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aba891d9-0c04-43ae-9339-2b77a11732a4 tempest-TestServerVolumeAttachScenarioOldVersion-9680726 tempest-TestServerVolumeAttachScenarioOldVersion-9680726-project-member] Lock "b36bb2c3-faf7-4e6a-bd38-753b52e2ca7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.333s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162 --force-share --output=json" returned: 0 in 0.218s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "2f28ebb93a3f275980cd87fc21b98eef76d84162" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "2f28ebb93a3f275980cd87fc21b98eef76d84162" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162 --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162 --force-share --output=json" returned: 0 in 0.187s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162,backing_fmt=raw /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162,backing_fmt=raw /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk 1073741824" returned: 0 in 0.046s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "2f28ebb93a3f275980cd87fc21b98eef76d84162" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162 --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162 --force-share --output=json" returned: 0 in 0.176s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG nova.objects.instance [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'migration_context' on Instance uuid f9275ae0-ccb1-4c73-b639-9cd243c6ff60 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:25 user nova-compute[75021]: DEBUG nova.objects.base [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Object Instance<f9275ae0-ccb1-4c73-b639-9cd243c6ff60> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:03:25 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Rebasing disk image.
Dec 06 07:03:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.190s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe -F raw /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe -F raw /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk" returned: 0 in 2.937s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Ensure instance console log exists: /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Start _get_guest_xml network_info=[{"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='3b1058d52c2c65842e551d839d0eacb0',container_format='bare',created_at=2023-12-06T07:01:16Z,direct_url=<?>,disk_format='qcow2',id=c08f3275-f5dd-4456-977a-4de852703db0,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2135327261-shelved',owner='d75ae216dcb345c79a5c2a4d38e51b38',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-06T07:01:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1e4506a5-4d98-4a0d-8572-286d880845aa', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztumyJnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'f9275ae0-ccb1-4c73-b639-9cd243c6ff60', 'attached_at': '', 'detached_at': '', 'volume_id': '239e00ec-bb8c-4be2-9e22-1cb61ee8b21c', 'serial': '239e00ec-bb8c-4be2-9e22-1cb61ee8b21c'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:03:29 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:03:29 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3b1058d52c2c65842e551d839d0eacb0',container_format='bare',created_at=2023-12-06T07:01:16Z,direct_url=<?>,disk_format='qcow2',id=c08f3275-f5dd-4456-977a-4de852703db0,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2135327261-shelved',owner='d75ae216dcb345c79a5c2a4d38e51b38',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-06T07:01:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.objects.instance [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'vcpu_model' on Instance uuid f9275ae0-ccb1-4c73-b639-9cd243c6ff60 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.objects.base [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Object Instance<f9275ae0-ccb1-4c73-b639-9cd243c6ff60> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztumyJnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:03:29 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:03:29 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:03:29 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260" returned: 21 in 0.076s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5ee330-426c-414e-a242-8695beddb0a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:03:29 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9433c511-735e-4bea-928e-a49a200a7767]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c] added
Dec 06 07:03:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e594d07-07b4-4df6-a3a5-04aecb7d7fb3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8de2bf-e68c-4541-b444-8ac27a5060a4]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztumyJnC {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztumyJnC" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a2c88f-6b4a-40c2-bafc-b25ba5574933]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ztumyJnC'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc4d589-2d89-4079-a736-e4c619267d12]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe6650a-ae2a-4c3b-815b-d03a0423b31b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ffed32-24b8-4c3c-b530-5fd2513600e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c, portal: 172.16.0.220,3260]
Dec 06 07:03:29 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c, portal: 172.16.0.220,3260] successful.
Dec 06 07:03:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed1dbfc-a0c5-4bc5-9ec5-13b2c221b9a5]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad74407c-05d7-4aa3-b888-b047ca549564]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:29 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)
Dec 06 07:03:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:29 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)
Dec 06 07:03:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[31554e2c-5fba-4cf7-8240-03cf71a5c387]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztumyJnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:03:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23065623664623537', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065623664623537', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T06:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2135327261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2135327261',id=5,image_ref='c08f3275-f5dd-4456-977a-4de852703db0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-400149348',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d75ae216dcb345c79a5c2a4d38e51b38',ramdisk_id='',reservation_id='r-mbynyqjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1923852465',owner_user_name='tempest-AttachVolumeShelveTestJSON-1923852465-project-member',shelved_at='2023-12-06T07:01:21.094812',shelved_host='user',shelved_image_id='c08f3275-f5dd-4456-977a-4de852703db0'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4daf20c071c4b5cb826452811323abd',uuid=f9275ae0-ccb1-4c73-b639-9cd243c6ff60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converting VIF {"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=c605d9e6-fce9-495d-b4f3-e2f1e4952633,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605d9e6-fc') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG nova.objects.instance [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'pci_devices' on Instance uuid f9275ae0-ccb1-4c73-b639-9cd243c6ff60 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG nova.objects.base [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Object Instance<f9275ae0-ccb1-4c73-b639-9cd243c6ff60> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:03:30 user nova-compute[75021]:   <uuid>f9275ae0-ccb1-4c73-b639-9cd243c6ff60</uuid>
Dec 06 07:03:30 user nova-compute[75021]:   <name>instance-00000005</name>
Dec 06 07:03:30 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:03:30 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:03:30 user nova-compute[75021]:   <metadata>
Dec 06 07:03:30 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:03:30 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:03:30 user nova-compute[75021]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2135327261</nova:name>
Dec 06 07:03:30 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:03:29</nova:creationTime>
Dec 06 07:03:30 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:03:30 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:03:30 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:03:30 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:03:30 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:03:30 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:03:30 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:03:30 user nova-compute[75021]:       <nova:owner>
Dec 06 07:03:30 user nova-compute[75021]:         <nova:user uuid="b4daf20c071c4b5cb826452811323abd">tempest-AttachVolumeShelveTestJSON-1923852465-project-member</nova:user>
Dec 06 07:03:30 user nova-compute[75021]:         <nova:project uuid="d75ae216dcb345c79a5c2a4d38e51b38">tempest-AttachVolumeShelveTestJSON-1923852465</nova:project>
Dec 06 07:03:30 user nova-compute[75021]:       </nova:owner>
Dec 06 07:03:30 user nova-compute[75021]:       <nova:root type="image" uuid="c08f3275-f5dd-4456-977a-4de852703db0"/>
Dec 06 07:03:30 user nova-compute[75021]:       <nova:ports>
Dec 06 07:03:30 user nova-compute[75021]:         <nova:port uuid="c605d9e6-fce9-495d-b4f3-e2f1e4952633">
Dec 06 07:03:30 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 07:03:30 user nova-compute[75021]:         </nova:port>
Dec 06 07:03:30 user nova-compute[75021]:       </nova:ports>
Dec 06 07:03:30 user nova-compute[75021]:     </nova:instance>
Dec 06 07:03:30 user nova-compute[75021]:   </metadata>
Dec 06 07:03:30 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:03:30 user nova-compute[75021]:     <system>
Dec 06 07:03:30 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:03:30 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:03:30 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:03:30 user nova-compute[75021]:       <entry name="serial">f9275ae0-ccb1-4c73-b639-9cd243c6ff60</entry>
Dec 06 07:03:30 user nova-compute[75021]:       <entry name="uuid">f9275ae0-ccb1-4c73-b639-9cd243c6ff60</entry>
Dec 06 07:03:30 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:03:30 user nova-compute[75021]:     </system>
Dec 06 07:03:30 user nova-compute[75021]:   </sysinfo>
Dec 06 07:03:30 user nova-compute[75021]:   <os>
Dec 06 07:03:30 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:03:30 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:03:30 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:03:30 user nova-compute[75021]:   </os>
Dec 06 07:03:30 user nova-compute[75021]:   <features>
Dec 06 07:03:30 user nova-compute[75021]:     <acpi/>
Dec 06 07:03:30 user nova-compute[75021]:     <apic/>
Dec 06 07:03:30 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:03:30 user nova-compute[75021]:   </features>
Dec 06 07:03:30 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:03:30 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:03:30 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:03:30 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:03:30 user nova-compute[75021]:   </clock>
Dec 06 07:03:30 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:03:30 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:03:30 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:03:30 user nova-compute[75021]:   </cpu>
Dec 06 07:03:30 user nova-compute[75021]:   <devices>
Dec 06 07:03:30 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:03:30 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:03:30 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk"/>
Dec 06 07:03:30 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:03:30 user nova-compute[75021]:     </disk>
Dec 06 07:03:30 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:03:30 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:03:30 user nova-compute[75021]:       <source dev="/dev/sdb"/>
Dec 06 07:03:30 user nova-compute[75021]:       <target dev="vdc" bus="virtio"/>
Dec 06 07:03:30 user nova-compute[75021]:       <serial>239e00ec-bb8c-4be2-9e22-1cb61ee8b21c</serial>
Dec 06 07:03:30 user nova-compute[75021]:     </disk>
Dec 06 07:03:30 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:03:30 user nova-compute[75021]:       <mac address="fa:16:3e:a3:19:e2"/>
Dec 06 07:03:30 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:03:30 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:03:30 user nova-compute[75021]:       <target dev="tapc605d9e6-fc"/>
Dec 06 07:03:30 user nova-compute[75021]:     </interface>
Dec 06 07:03:30 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:03:30 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/console.log" append="off"/>
Dec 06 07:03:30 user nova-compute[75021]:     </serial>
Dec 06 07:03:30 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:03:30 user nova-compute[75021]:     <video>
Dec 06 07:03:30 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:03:30 user nova-compute[75021]:     </video>
Dec 06 07:03:30 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:03:30 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:03:30 user nova-compute[75021]:     </rng>
Dec 06 07:03:30 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:03:30 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:03:30 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:03:30 user nova-compute[75021]:     </memballoon>
Dec 06 07:03:30 user nova-compute[75021]:   </devices>
Dec 06 07:03:30 user nova-compute[75021]: </domain>
Dec 06 07:03:30 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T06:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2135327261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2135327261',id=5,image_ref='c08f3275-f5dd-4456-977a-4de852703db0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-400149348',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d75ae216dcb345c79a5c2a4d38e51b38',ramdisk_id='',reservation_id='r-mbynyqjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1923852465',owner_user_name='tempest-AttachVolumeShelveTestJSON-1923852465-project-member',shelved_at='2023-12-06T07:01:21.094812',shelved_host='user',shelved_image_id='c08f3275-f5dd-4456-977a-4de852703db0'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4daf20c071c4b5cb826452811323abd',uuid=f9275ae0-ccb1-4c73-b639-9cd243c6ff60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converting VIF {"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=c605d9e6-fce9-495d-b4f3-e2f1e4952633,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605d9e6-fc') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG os_vif [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=c605d9e6-fce9-495d-b4f3-e2f1e4952633,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605d9e6-fc') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '560b7370-d01b-5582-9328-7762e883301b', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc605d9e6-fc, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc605d9e6-fc, col_values=(('qos', UUID('eb53938e-fffe-4230-a037-d2a8fdf8de97')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc605d9e6-fc, col_values=(('external_ids', {'iface-id': 'c605d9e6-fce9-495d-b4f3-e2f1e4952633', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:19:e2', 'vm-uuid': 'f9275ae0-ccb1-4c73-b639-9cd243c6ff60'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:30 user nova-compute[75021]: INFO os_vif [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=c605d9e6-fce9-495d-b4f3-e2f1e4952633,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605d9e6-fc')
Dec 06 07:03:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:03:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] No VIF found with MAC fa:16:3e:a3:19:e2, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:03:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "cd198206-4476-4b87-8399-dd5cb38fd3b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:03:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:32 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:03:32 user nova-compute[75021]: INFO nova.compute.claims [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Claim successful on node user
Dec 06 07:03:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:03:33 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:03:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG nova.policy [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3369c937ad24537a114a71eb4674750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f011c1a70ac1465d8eb31e20850fdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:03:33 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Creating image(s)
Dec 06 07:03:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "/opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "/opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.221s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.185s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk 1073741824" returned: 0 in 0.049s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG nova.network.neutron [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Successfully created port: 1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.172s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:03:34 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Instance spawned successfully.
Dec 06 07:03:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Cannot resize image /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Ensure instance console log exists: /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.network.neutron [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Successfully updated port: 1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b62fe27-435d-4848-9481-8b29e15aaa22 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.897s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquired lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.network.neutron [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-5eaace81-61f3-4a3c-904b-7028fb574530 req-ee43db6d-bb05-4882-b415-b379dbb01b24 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Received event network-changed-1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-5eaace81-61f3-4a3c-904b-7028fb574530 req-ee43db6d-bb05-4882-b415-b379dbb01b24 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Refreshing instance network info cache due to event network-changed-1f43de0b-bfae-4359-9a48-56a43f5dbdbf. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5eaace81-61f3-4a3c-904b-7028fb574530 req-ee43db6d-bb05-4882-b415-b379dbb01b24 service nova] Acquiring lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.network.neutron [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.network.neutron [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Updating instance_info_cache with network_info: [{"id": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "address": "fa:16:3e:b7:f2:e4", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f43de0b-bf", "ovs_interfaceid": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Releasing lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.compute.manager [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Instance network_info: |[{"id": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "address": "fa:16:3e:b7:f2:e4", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f43de0b-bf", "ovs_interfaceid": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5eaace81-61f3-4a3c-904b-7028fb574530 req-ee43db6d-bb05-4882-b415-b379dbb01b24 service nova] Acquired lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.network.neutron [req-5eaace81-61f3-4a3c-904b-7028fb574530 req-ee43db6d-bb05-4882-b415-b379dbb01b24 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Refreshing network info cache for port 1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Start _get_guest_xml network_info=[{"id": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "address": "fa:16:3e:b7:f2:e4", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f43de0b-bf", "ovs_interfaceid": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:03:35 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:03:35 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:03:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-713644889',display_name='tempest-ServerActionsTestOtherA-server-713644889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-713644889',id=16,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbe4qUdep78TgBLG29O7GMFI0uEKESU+Xx64Y2G0xkh2EtccpxwWlafCMPJHygmaEQbyUAtZjD22PTzS9xqolPPxgkkpdNuHJ15mMhGsezfXPp1cLkefmXHoF6E+QYoeA==',key_name='tempest-keypair-34997867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f011c1a70ac1465d8eb31e20850fdbad',ramdisk_id='',reservation_id='r-dagydyip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1761792884',owner_user_name='tempest-ServerActionsTestOtherA-1761792884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:03:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3369c937ad24537a114a71eb4674750',uuid=cd198206-4476-4b87-8399-dd5cb38fd3b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "address": "fa:16:3e:b7:f2:e4", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f43de0b-bf", "ovs_interfaceid": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converting VIF {"id": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "address": "fa:16:3e:b7:f2:e4", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f43de0b-bf", "ovs_interfaceid": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f2:e4,bridge_name='br-int',has_traffic_filtering=True,id=1f43de0b-bfae-4359-9a48-56a43f5dbdbf,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f43de0b-bf') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.objects.instance [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lazy-loading 'pci_devices' on Instance uuid cd198206-4476-4b87-8399-dd5cb38fd3b1 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:03:35 user nova-compute[75021]:   <uuid>cd198206-4476-4b87-8399-dd5cb38fd3b1</uuid>
Dec 06 07:03:35 user nova-compute[75021]:   <name>instance-00000010</name>
Dec 06 07:03:35 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:03:35 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:03:35 user nova-compute[75021]:   <metadata>
Dec 06 07:03:35 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:03:35 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:03:35 user nova-compute[75021]:       <nova:name>tempest-ServerActionsTestOtherA-server-713644889</nova:name>
Dec 06 07:03:35 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:03:35</nova:creationTime>
Dec 06 07:03:35 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:03:35 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:03:35 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:03:35 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:03:35 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:03:35 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:03:35 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:03:35 user nova-compute[75021]:       <nova:owner>
Dec 06 07:03:35 user nova-compute[75021]:         <nova:user uuid="e3369c937ad24537a114a71eb4674750">tempest-ServerActionsTestOtherA-1761792884-project-member</nova:user>
Dec 06 07:03:35 user nova-compute[75021]:         <nova:project uuid="f011c1a70ac1465d8eb31e20850fdbad">tempest-ServerActionsTestOtherA-1761792884</nova:project>
Dec 06 07:03:35 user nova-compute[75021]:       </nova:owner>
Dec 06 07:03:35 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:03:35 user nova-compute[75021]:       <nova:ports>
Dec 06 07:03:35 user nova-compute[75021]:         <nova:port uuid="1f43de0b-bfae-4359-9a48-56a43f5dbdbf">
Dec 06 07:03:35 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 06 07:03:35 user nova-compute[75021]:         </nova:port>
Dec 06 07:03:35 user nova-compute[75021]:       </nova:ports>
Dec 06 07:03:35 user nova-compute[75021]:     </nova:instance>
Dec 06 07:03:35 user nova-compute[75021]:   </metadata>
Dec 06 07:03:35 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:03:35 user nova-compute[75021]:     <system>
Dec 06 07:03:35 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:03:35 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:03:35 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:03:35 user nova-compute[75021]:       <entry name="serial">cd198206-4476-4b87-8399-dd5cb38fd3b1</entry>
Dec 06 07:03:35 user nova-compute[75021]:       <entry name="uuid">cd198206-4476-4b87-8399-dd5cb38fd3b1</entry>
Dec 06 07:03:35 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:03:35 user nova-compute[75021]:     </system>
Dec 06 07:03:35 user nova-compute[75021]:   </sysinfo>
Dec 06 07:03:35 user nova-compute[75021]:   <os>
Dec 06 07:03:35 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:03:35 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:03:35 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:03:35 user nova-compute[75021]:   </os>
Dec 06 07:03:35 user nova-compute[75021]:   <features>
Dec 06 07:03:35 user nova-compute[75021]:     <acpi/>
Dec 06 07:03:35 user nova-compute[75021]:     <apic/>
Dec 06 07:03:35 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:03:35 user nova-compute[75021]:   </features>
Dec 06 07:03:35 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:03:35 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:03:35 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:03:35 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:03:35 user nova-compute[75021]:   </clock>
Dec 06 07:03:35 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:03:35 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:03:35 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:03:35 user nova-compute[75021]:   </cpu>
Dec 06 07:03:35 user nova-compute[75021]:   <devices>
Dec 06 07:03:35 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:03:35 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:03:35 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk"/>
Dec 06 07:03:35 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:03:35 user nova-compute[75021]:     </disk>
Dec 06 07:03:35 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:03:35 user nova-compute[75021]:       <mac address="fa:16:3e:b7:f2:e4"/>
Dec 06 07:03:35 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:03:35 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:03:35 user nova-compute[75021]:       <target dev="tap1f43de0b-bf"/>
Dec 06 07:03:35 user nova-compute[75021]:     </interface>
Dec 06 07:03:35 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:03:35 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/console.log" append="off"/>
Dec 06 07:03:35 user nova-compute[75021]:     </serial>
Dec 06 07:03:35 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:03:35 user nova-compute[75021]:     <video>
Dec 06 07:03:35 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:03:35 user nova-compute[75021]:     </video>
Dec 06 07:03:35 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:03:35 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:03:35 user nova-compute[75021]:     </rng>
Dec 06 07:03:35 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:03:35 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:03:35 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:03:35 user nova-compute[75021]:     </memballoon>
Dec 06 07:03:35 user nova-compute[75021]:   </devices>
Dec 06 07:03:35 user nova-compute[75021]: </domain>
Dec 06 07:03:35 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:03:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-713644889',display_name='tempest-ServerActionsTestOtherA-server-713644889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-713644889',id=16,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbe4qUdep78TgBLG29O7GMFI0uEKESU+Xx64Y2G0xkh2EtccpxwWlafCMPJHygmaEQbyUAtZjD22PTzS9xqolPPxgkkpdNuHJ15mMhGsezfXPp1cLkefmXHoF6E+QYoeA==',key_name='tempest-keypair-34997867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f011c1a70ac1465d8eb31e20850fdbad',ramdisk_id='',reservation_id='r-dagydyip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1761792884',owner_user_name='tempest-ServerActionsTestOtherA-1761792884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:03:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3369c937ad24537a114a71eb4674750',uuid=cd198206-4476-4b87-8399-dd5cb38fd3b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "address": "fa:16:3e:b7:f2:e4", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f43de0b-bf", "ovs_interfaceid": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converting VIF {"id": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "address": "fa:16:3e:b7:f2:e4", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f43de0b-bf", "ovs_interfaceid": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f2:e4,bridge_name='br-int',has_traffic_filtering=True,id=1f43de0b-bfae-4359-9a48-56a43f5dbdbf,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f43de0b-bf') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG os_vif [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f2:e4,bridge_name='br-int',has_traffic_filtering=True,id=1f43de0b-bfae-4359-9a48-56a43f5dbdbf,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f43de0b-bf') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b21b8ba8-0ac1-557f-bd55-62c5ee71ca5e', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f43de0b-bf, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f43de0b-bf, col_values=(('qos', UUID('dd7bba59-cb85-481a-9ad4-3dd516a324b5')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f43de0b-bf, col_values=(('external_ids', {'iface-id': '1f43de0b-bfae-4359-9a48-56a43f5dbdbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:f2:e4', 'vm-uuid': 'cd198206-4476-4b87-8399-dd5cb38fd3b1'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:35 user nova-compute[75021]: INFO os_vif [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f2:e4,bridge_name='br-int',has_traffic_filtering=True,id=1f43de0b-bfae-4359-9a48-56a43f5dbdbf,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f43de0b-bf')
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-be935e34-b619-4e4b-a92b-d61bccf892b9 req-6807cfe9-9747-434f-bbab-32d56f96c5b7 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received event network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-be935e34-b619-4e4b-a92b-d61bccf892b9 req-6807cfe9-9747-434f-bbab-32d56f96c5b7 service nova] Acquiring lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-be935e34-b619-4e4b-a92b-d61bccf892b9 req-6807cfe9-9747-434f-bbab-32d56f96c5b7 service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-be935e34-b619-4e4b-a92b-d61bccf892b9 req-6807cfe9-9747-434f-bbab-32d56f96c5b7 service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-be935e34-b619-4e4b-a92b-d61bccf892b9 req-6807cfe9-9747-434f-bbab-32d56f96c5b7 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] No waiting events found dispatching network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:35 user nova-compute[75021]: WARNING nova.compute.manager [req-be935e34-b619-4e4b-a92b-d61bccf892b9 req-6807cfe9-9747-434f-bbab-32d56f96c5b7 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received unexpected event network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 for instance with vm_state active and task_state None.
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] No VIF found with MAC fa:16:3e:b7:f2:e4, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Starting finish_migration {{(pid=75021) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11677}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Instance directory exists: not creating {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 07:03:35 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Creating image(s)
Dec 06 07:03:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.207s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk. size=21474836480 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:03:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.network.neutron [req-5eaace81-61f3-4a3c-904b-7028fb574530 req-ee43db6d-bb05-4882-b415-b379dbb01b24 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Updated VIF entry in instance network info cache for port 1f43de0b-bfae-4359-9a48-56a43f5dbdbf. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.network.neutron [req-5eaace81-61f3-4a3c-904b-7028fb574530 req-ee43db6d-bb05-4882-b415-b379dbb01b24 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Updating instance_info_cache with network_info: [{"id": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "address": "fa:16:3e:b7:f2:e4", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f43de0b-bf", "ovs_interfaceid": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5eaace81-61f3-4a3c-904b-7028fb574530 req-ee43db6d-bb05-4882-b415-b379dbb01b24 service nova] Releasing lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk 21474836480 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk 21474836480" returned: 0 in 0.054s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Ensure instance console log exists: /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Start _get_guest_xml network_info=[{"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1644315764-network", "vif_mac": "fa:16:3e:43:60:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '602b1db8-93df-42ee-8543-d2fd7d69fa91', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvehRiEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf', 'attached_at': '2023-12-06T07:03:35.000000', 'detached_at': '', 'volume_id': '7ccdd51d-7737-4a34-b5ab-e986a8a87635', 'serial': '7ccdd51d-7737-4a34-b5ab-e986a8a87635'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:03:36 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:03:36 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvehRiEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:03:36 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:03:36 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:03:36 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1284d84f-88a4-4961-b80b-b7db46369812]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:03:36 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.042s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fada37d5-68fc-4b58-9ac4-32204dffc164]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635] added
Dec 06 07:03:36 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf58dd55-d9ee-419d-b5ef-e95339822bcd]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[060f8b1b-a120-45ae-9cff-99b01b78f4c0]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvehRiEa {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvehRiEa" returned: 0 in 0.045s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f937dd18-4857-452e-a909-4562e0b81191]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvehRiEa'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[65882c5d-118f-44d0-b6fd-d2a04872d37c]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e9254f-ba1e-455a-9399-86f1e230cd41]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:36 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)
Dec 06 07:03:36 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:36 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)
Dec 06 07:03:36 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2d778f-c4da-4125-ae05-e1f0dd60944a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260]
Dec 06 07:03:36 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260] successful.
Dec 06 07:03:36 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[361e7dcc-bd0f-4c8e-82a7-06fc9a7f996e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f53351-4291-4a60-a080-ef9ecc7638a9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:36 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)
Dec 06 07:03:36 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:03:36 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:36 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)
Dec 06 07:03:36 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:03:36 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0546a16-f11b-498e-b535-2c4d8daba221]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:36 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-a8b8476e-e060-4b97-9c37-9ca731879356 req-0065c3c6-7b67-420e-9542-c9b865be0a5b service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Received event network-vif-plugged-1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a8b8476e-e060-4b97-9c37-9ca731879356 req-0065c3c6-7b67-420e-9542-c9b865be0a5b service nova] Acquiring lock "cd198206-4476-4b87-8399-dd5cb38fd3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a8b8476e-e060-4b97-9c37-9ca731879356 req-0065c3c6-7b67-420e-9542-c9b865be0a5b service nova] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a8b8476e-e060-4b97-9c37-9ca731879356 req-0065c3c6-7b67-420e-9542-c9b865be0a5b service nova] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-a8b8476e-e060-4b97-9c37-9ca731879356 req-0065c3c6-7b67-420e-9542-c9b865be0a5b service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] No waiting events found dispatching network-vif-plugged-1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:37 user nova-compute[75021]: WARNING nova.compute.manager [req-a8b8476e-e060-4b97-9c37-9ca731879356 req-0065c3c6-7b67-420e-9542-c9b865be0a5b service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Received unexpected event network-vif-plugged-1f43de0b-bfae-4359-9a48-56a43f5dbdbf for instance with vm_state building and task_state spawning.
Dec 06 07:03:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-e1485f86-f8d6-4eb8-8557-e8085f901556 req-34207ca5-16c6-44ed-b329-acce5b0d8b2c service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received event network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e1485f86-f8d6-4eb8-8557-e8085f901556 req-34207ca5-16c6-44ed-b329-acce5b0d8b2c service nova] Acquiring lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e1485f86-f8d6-4eb8-8557-e8085f901556 req-34207ca5-16c6-44ed-b329-acce5b0d8b2c service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e1485f86-f8d6-4eb8-8557-e8085f901556 req-34207ca5-16c6-44ed-b329-acce5b0d8b2c service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-e1485f86-f8d6-4eb8-8557-e8085f901556 req-34207ca5-16c6-44ed-b329-acce5b0d8b2c service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] No waiting events found dispatching network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:37 user nova-compute[75021]: WARNING nova.compute.manager [req-e1485f86-f8d6-4eb8-8557-e8085f901556 req-34207ca5-16c6-44ed-b329-acce5b0d8b2c service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received unexpected event network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 for instance with vm_state active and task_state None.
Dec 06 07:03:37 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvehRiEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23233613435323961', 'path': '/dev/sdc'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233613435323961', 'path': '/dev/sdc'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-272299805',display_name='tempest-ServerActionsTestOtherB-server-272299805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-272299805',id=4,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDr10Uf7mSfaKxaWiZMlOkgp+3gz+zk9cuGM2WOwPxRQl0KGDW8m0MH0trEdCAhYZHvExMqqK1A+1XoEwjfDbN1X4V66K4XOiRtH4zqe8KgY/USo0EOIRMWD8nLuB034BA==',key_name='tempest-keypair-2107162455',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d0482e21a6db45199f3c82f7f5913ec1',ramdisk_id='',reservation_id='r-lhdcj864',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1150715110',owner_user_name='tempest-ServerActionsTestOtherB-1150715110-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:03:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9273703a77bf425685228a99248f6d4e',uuid=2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1644315764-network", "vif_mac": "fa:16:3e:43:60:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converting VIF {"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1644315764-network", "vif_mac": "fa:16:3e:43:60:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:03:37 user nova-compute[75021]:   <uuid>2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf</uuid>
Dec 06 07:03:37 user nova-compute[75021]:   <name>instance-00000004</name>
Dec 06 07:03:37 user nova-compute[75021]:   <memory>2097152</memory>
Dec 06 07:03:37 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:03:37 user nova-compute[75021]:   <metadata>
Dec 06 07:03:37 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:03:37 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:03:37 user nova-compute[75021]:       <nova:name>tempest-ServerActionsTestOtherB-server-272299805</nova:name>
Dec 06 07:03:37 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:03:36</nova:creationTime>
Dec 06 07:03:37 user nova-compute[75021]:       <nova:flavor name="m1.small">
Dec 06 07:03:37 user nova-compute[75021]:         <nova:memory>2048</nova:memory>
Dec 06 07:03:37 user nova-compute[75021]:         <nova:disk>20</nova:disk>
Dec 06 07:03:37 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:03:37 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:03:37 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:03:37 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:03:37 user nova-compute[75021]:       <nova:owner>
Dec 06 07:03:37 user nova-compute[75021]:         <nova:user uuid="9273703a77bf425685228a99248f6d4e">tempest-ServerActionsTestOtherB-1150715110-project-member</nova:user>
Dec 06 07:03:37 user nova-compute[75021]:         <nova:project uuid="d0482e21a6db45199f3c82f7f5913ec1">tempest-ServerActionsTestOtherB-1150715110</nova:project>
Dec 06 07:03:37 user nova-compute[75021]:       </nova:owner>
Dec 06 07:03:37 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:03:37 user nova-compute[75021]:       <nova:ports>
Dec 06 07:03:37 user nova-compute[75021]:         <nova:port uuid="f48c57d0-3024-4f70-8989-454717799fe3">
Dec 06 07:03:37 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 07:03:37 user nova-compute[75021]:         </nova:port>
Dec 06 07:03:37 user nova-compute[75021]:       </nova:ports>
Dec 06 07:03:37 user nova-compute[75021]:     </nova:instance>
Dec 06 07:03:37 user nova-compute[75021]:   </metadata>
Dec 06 07:03:37 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:03:37 user nova-compute[75021]:     <system>
Dec 06 07:03:37 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:03:37 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:03:37 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:03:37 user nova-compute[75021]:       <entry name="serial">2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf</entry>
Dec 06 07:03:37 user nova-compute[75021]:       <entry name="uuid">2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf</entry>
Dec 06 07:03:37 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:03:37 user nova-compute[75021]:     </system>
Dec 06 07:03:37 user nova-compute[75021]:   </sysinfo>
Dec 06 07:03:37 user nova-compute[75021]:   <os>
Dec 06 07:03:37 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:03:37 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:03:37 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:03:37 user nova-compute[75021]:   </os>
Dec 06 07:03:37 user nova-compute[75021]:   <features>
Dec 06 07:03:37 user nova-compute[75021]:     <acpi/>
Dec 06 07:03:37 user nova-compute[75021]:     <apic/>
Dec 06 07:03:37 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:03:37 user nova-compute[75021]:   </features>
Dec 06 07:03:37 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:03:37 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:03:37 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:03:37 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:03:37 user nova-compute[75021]:   </clock>
Dec 06 07:03:37 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:03:37 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:03:37 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:03:37 user nova-compute[75021]:   </cpu>
Dec 06 07:03:37 user nova-compute[75021]:   <devices>
Dec 06 07:03:37 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:03:37 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:03:37 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk"/>
Dec 06 07:03:37 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:03:37 user nova-compute[75021]:     </disk>
Dec 06 07:03:37 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:03:37 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:03:37 user nova-compute[75021]:       <source dev="/dev/sdc"/>
Dec 06 07:03:37 user nova-compute[75021]:       <target dev="vdb" bus="virtio"/>
Dec 06 07:03:37 user nova-compute[75021]:       <serial>7ccdd51d-7737-4a34-b5ab-e986a8a87635</serial>
Dec 06 07:03:37 user nova-compute[75021]:     </disk>
Dec 06 07:03:37 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:03:37 user nova-compute[75021]:       <mac address="fa:16:3e:43:60:12"/>
Dec 06 07:03:37 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:03:37 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:03:37 user nova-compute[75021]:       <target dev="tapf48c57d0-30"/>
Dec 06 07:03:37 user nova-compute[75021]:     </interface>
Dec 06 07:03:37 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:03:37 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/console.log" append="off"/>
Dec 06 07:03:37 user nova-compute[75021]:     </serial>
Dec 06 07:03:37 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:03:37 user nova-compute[75021]:     <video>
Dec 06 07:03:37 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:03:37 user nova-compute[75021]:     </video>
Dec 06 07:03:37 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:03:37 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:03:37 user nova-compute[75021]:     </rng>
Dec 06 07:03:37 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:03:37 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:03:37 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:03:37 user nova-compute[75021]:     </memballoon>
Dec 06 07:03:37 user nova-compute[75021]:   </devices>
Dec 06 07:03:37 user nova-compute[75021]: </domain>
Dec 06 07:03:37 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-272299805',display_name='tempest-ServerActionsTestOtherB-server-272299805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-272299805',id=4,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDr10Uf7mSfaKxaWiZMlOkgp+3gz+zk9cuGM2WOwPxRQl0KGDW8m0MH0trEdCAhYZHvExMqqK1A+1XoEwjfDbN1X4V66K4XOiRtH4zqe8KgY/USo0EOIRMWD8nLuB034BA==',key_name='tempest-keypair-2107162455',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d0482e21a6db45199f3c82f7f5913ec1',ramdisk_id='',reservation_id='r-lhdcj864',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1150715110',owner_user_name='tempest-ServerActionsTestOtherB-1150715110-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:03:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9273703a77bf425685228a99248f6d4e',uuid=2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1644315764-network", "vif_mac": "fa:16:3e:43:60:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converting VIF {"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1644315764-network", "vif_mac": "fa:16:3e:43:60:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG os_vif [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f24ba05-19aa-57a1-8786-2367e3ba21a0', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf48c57d0-30, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf48c57d0-30, col_values=(('qos', UUID('e46f799c-2908-4b87-90d0-1c74e85f6c9a')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf48c57d0-30, col_values=(('external_ids', {'iface-id': 'f48c57d0-3024-4f70-8989-454717799fe3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:60:12', 'vm-uuid': '2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:37 user nova-compute[75021]: INFO os_vif [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30')
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] No VIF found with MAC fa:16:3e:43:60:12, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG nova.compute.manager [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:03:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Instance spawned successfully.
Dec 06 07:03:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-a1f0a144-4dfc-44cb-bb78-ccc720a0866b req-a8becaed-3846-4272-900d-258447d34669 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Received event network-vif-plugged-1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a1f0a144-4dfc-44cb-bb78-ccc720a0866b req-a8becaed-3846-4272-900d-258447d34669 service nova] Acquiring lock "cd198206-4476-4b87-8399-dd5cb38fd3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a1f0a144-4dfc-44cb-bb78-ccc720a0866b req-a8becaed-3846-4272-900d-258447d34669 service nova] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a1f0a144-4dfc-44cb-bb78-ccc720a0866b req-a8becaed-3846-4272-900d-258447d34669 service nova] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-a1f0a144-4dfc-44cb-bb78-ccc720a0866b req-a8becaed-3846-4272-900d-258447d34669 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] No waiting events found dispatching network-vif-plugged-1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:39 user nova-compute[75021]: WARNING nova.compute.manager [req-a1f0a144-4dfc-44cb-bb78-ccc720a0866b req-a8becaed-3846-4272-900d-258447d34669 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Received unexpected event network-vif-plugged-1f43de0b-bfae-4359-9a48-56a43f5dbdbf for instance with vm_state building and task_state spawning.
Dec 06 07:03:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-3851c33d-011c-4ace-b227-16bb76aad56b req-6e77fc1a-0a06-4ca9-b740-9f1724bc8b03 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3851c33d-011c-4ace-b227-16bb76aad56b req-6e77fc1a-0a06-4ca9-b740-9f1724bc8b03 service nova] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3851c33d-011c-4ace-b227-16bb76aad56b req-6e77fc1a-0a06-4ca9-b740-9f1724bc8b03 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3851c33d-011c-4ace-b227-16bb76aad56b req-6e77fc1a-0a06-4ca9-b740-9f1724bc8b03 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-3851c33d-011c-4ace-b227-16bb76aad56b req-6e77fc1a-0a06-4ca9-b740-9f1724bc8b03 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] No waiting events found dispatching network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:39 user nova-compute[75021]: WARNING nova.compute.manager [req-3851c33d-011c-4ace-b227-16bb76aad56b req-6e77fc1a-0a06-4ca9-b740-9f1724bc8b03 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received unexpected event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 for instance with vm_state active and task_state resize_finish.
Dec 06 07:03:39 user nova-compute[75021]: INFO nova.compute.manager [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Took 6.08 seconds to spawn the instance on the hypervisor.
Dec 06 07:03:39 user nova-compute[75021]: DEBUG nova.compute.manager [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:03:39 user nova-compute[75021]: INFO nova.compute.manager [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Took 7.08 seconds to build instance.
Dec 06 07:03:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-75103dea-4eec-45fd-8fb6-58782d817add tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.259s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:41 user nova-compute[75021]: DEBUG nova.compute.manager [req-b9d3490d-32a5-425d-933b-f20b385f0986 req-cda332b2-22a6-429d-be13-76ab0a26a920 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b9d3490d-32a5-425d-933b-f20b385f0986 req-cda332b2-22a6-429d-be13-76ab0a26a920 service nova] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b9d3490d-32a5-425d-933b-f20b385f0986 req-cda332b2-22a6-429d-be13-76ab0a26a920 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b9d3490d-32a5-425d-933b-f20b385f0986 req-cda332b2-22a6-429d-be13-76ab0a26a920 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:41 user nova-compute[75021]: DEBUG nova.compute.manager [req-b9d3490d-32a5-425d-933b-f20b385f0986 req-cda332b2-22a6-429d-be13-76ab0a26a920 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] No waiting events found dispatching network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:41 user nova-compute[75021]: WARNING nova.compute.manager [req-b9d3490d-32a5-425d-933b-f20b385f0986 req-cda332b2-22a6-429d-be13-76ab0a26a920 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received unexpected event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 for instance with vm_state active and task_state resize_finish.
Dec 06 07:03:41 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:03:41 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Instance running successfully.
Dec 06 07:03:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Failed to set time: agent not configured {{(pid=75021) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 06 07:03:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0536091d-351f-4c7d-af15-25225f016716 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] finish_migration finished successfully. {{(pid=75021) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11772}}
Dec 06 07:03:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:43 user nova-compute[75021]: INFO nova.compute.manager [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Terminating instance
Dec 06 07:03:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-a343b135-767b-423c-8b15-59bbf41bbd17 req-a2d79e9c-8381-44b5-b450-c0f466e04f53 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received event network-vif-unplugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a343b135-767b-423c-8b15-59bbf41bbd17 req-a2d79e9c-8381-44b5-b450-c0f466e04f53 service nova] Acquiring lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a343b135-767b-423c-8b15-59bbf41bbd17 req-a2d79e9c-8381-44b5-b450-c0f466e04f53 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a343b135-767b-423c-8b15-59bbf41bbd17 req-a2d79e9c-8381-44b5-b450-c0f466e04f53 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-a343b135-767b-423c-8b15-59bbf41bbd17 req-a2d79e9c-8381-44b5-b450-c0f466e04f53 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] No waiting events found dispatching network-vif-unplugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-a343b135-767b-423c-8b15-59bbf41bbd17 req-a2d79e9c-8381-44b5-b450-c0f466e04f53 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received event network-vif-unplugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:03:44 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Instance destroyed successfully.
Dec 06 07:03:44 user nova-compute[75021]: DEBUG nova.objects.instance [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lazy-loading 'resources' on Instance uuid d5cd8c5d-acc4-44b8-b240-58f8fea899ec {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T06:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1888906845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1814435056',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiXiD74QqzfgkFXGjJOZvAqeUVo+mq15hHQ8QIS/Wj/WBUADk0S9ETtuL5LG29w5xqYMy6zRLAJsgjvd9bu5CBLpGA3OWWGNin8u/kh+TSTPSCT1+3h0wrNEHGduvVlPw==',key_name='tempest-keypair-139423592',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:02:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71465ef2851b453393044740cb4703a8',ramdisk_id='',reservation_id='r-d3iwgob5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-888472527',owner_user_name='tempest-ServerActionsV293TestJSON-888472527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:02:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c13c9f93326641e09f763a42c76449f9',uuid=d5cd8c5d-acc4-44b8-b240-58f8fea899ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Converting VIF {"id": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "address": "fa:16:3e:2a:4e:65", "network": {"id": "48eb6005-fd57-4d35-a701-ac7bed58807d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-93807863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71465ef2851b453393044740cb4703a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d5a156-55", "ovs_interfaceid": "15d5a156-55aa-4946-9ca4-7bb6cc1a07a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4e:65,bridge_name='br-int',has_traffic_filtering=True,id=15d5a156-55aa-4946-9ca4-7bb6cc1a07a0,network=Network(48eb6005-fd57-4d35-a701-ac7bed58807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d5a156-55') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_vif [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4e:65,bridge_name='br-int',has_traffic_filtering=True,id=15d5a156-55aa-4946-9ca4-7bb6cc1a07a0,network=Network(48eb6005-fd57-4d35-a701-ac7bed58807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d5a156-55') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15d5a156-55, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55302a14-84f2-423a-a834-5ef7e2592d08) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:03:44 user nova-compute[75021]: INFO os_vif [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4e:65,bridge_name='br-int',has_traffic_filtering=True,id=15d5a156-55aa-4946-9ca4-7bb6cc1a07a0,network=Network(48eb6005-fd57-4d35-a701-ac7bed58807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d5a156-55')
Dec 06 07:03:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKNuoOHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:03:44 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00c9303-3846-40f6-bdab-87155e3037b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:03:44 user nova-compute[75021]: No targets found.
Dec 06 07:03:44 user nova-compute[75021]: iSNS:
Dec 06 07:03:44 user nova-compute[75021]: No targets found.
Dec 06 07:03:44 user nova-compute[75021]: STATIC:
Dec 06 07:03:44 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635
Dec 06 07:03:44 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:03:44 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:03:44 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d
Dec 06 07:03:44 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:03:44 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:03:44 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c
Dec 06 07:03:44 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:03:44 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:03:44 user nova-compute[75021]: FIRMWARE:
Dec 06 07:03:44 user nova-compute[75021]: No targets found.
Dec 06 07:03:44 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:03:44 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:03:44 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[20df9684-29b6-47af-ad82-4d68827063d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df0e7d5-d669-479a-9dd5-3376db610ad8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:44 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)
Dec 06 07:03:44 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:03:44 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d (non-flash)
Dec 06 07:03:44 user nova-compute[75021]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)
Dec 06 07:03:44 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:03:44 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b4629090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d'): ({'sdd'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Removing single pathed devices sdd {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb1f82d-c2c1-4e53-97ba-8ea7cd41238a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bcbcc1-273c-495f-bc95-bd2c313d6eb4]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Flushing IO for device /dev/sdd {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7720a8-a571-408b-a1c0-6e18546ee9d0]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.223s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2e4a61-a49f-4dda-a3b0-2b18112f149d]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9a853dd8-03d759de40a35fa9', '/dev/disk/by-id/scsi-23033643735396465', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9a853dd8') {{(pid=86148) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 07:03:44 user nova-compute[75021]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO9a853dd8-03d759de40a35fa9
Dec 06 07:03:44 user nova-compute[75021]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23033643735396465
Dec 06 07:03:44 user nova-compute[75021]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_9a853dd8
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[616e9860-6f39-4c56-a21f-b032f5f9518f]: (4, None) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e0a4c3-ce74-4bb3-a68f-398de86744ff]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6673952d-ac63-47a6-96b9-f90047c9e3fd]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260]
Dec 06 07:03:44 user nova-compute[75021]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d, portal: 172.16.0.220,3260] successful.
Dec 06 07:03:44 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc022fa0-75a9-49f7-9908-571e56a19d9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[721a0e60-9f4b-430d-a843-b915604dc211]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.560s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] <== disconnect_volume: return (561ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:03:44 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Deleting instance files /opt/stack/data/nova/instances/d5cd8c5d-acc4-44b8-b240-58f8fea899ec_del
Dec 06 07:03:44 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Deletion of /opt/stack/data/nova/instances/d5cd8c5d-acc4-44b8-b240-58f8fea899ec_del complete
Dec 06 07:03:44 user nova-compute[75021]: INFO nova.compute.manager [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Took 1.48 seconds to destroy the instance on the hypervisor.
Dec 06 07:03:44 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:03:44 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:03:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-1f0651e6-f916-417f-b7d4-a00903b7e683 req-abb8b444-c9bc-4b0d-aba5-eb7d045a2e68 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received event network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1f0651e6-f916-417f-b7d4-a00903b7e683 req-abb8b444-c9bc-4b0d-aba5-eb7d045a2e68 service nova] Acquiring lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1f0651e6-f916-417f-b7d4-a00903b7e683 req-abb8b444-c9bc-4b0d-aba5-eb7d045a2e68 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1f0651e6-f916-417f-b7d4-a00903b7e683 req-abb8b444-c9bc-4b0d-aba5-eb7d045a2e68 service nova] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-1f0651e6-f916-417f-b7d4-a00903b7e683 req-abb8b444-c9bc-4b0d-aba5-eb7d045a2e68 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] No waiting events found dispatching network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:46 user nova-compute[75021]: WARNING nova.compute.manager [req-1f0651e6-f916-417f-b7d4-a00903b7e683 req-abb8b444-c9bc-4b0d-aba5-eb7d045a2e68 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received unexpected event network-vif-plugged-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 for instance with vm_state active and task_state deleting.
Dec 06 07:03:46 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:46 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Took 1.42 seconds to deallocate network for instance.
Dec 06 07:03:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:47 user nova-compute[75021]: INFO nova.compute.manager [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Took 1.14 seconds to detach 1 volumes for instance.
Dec 06 07:03:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Deleting volume: cc022fa0-75a9-49f7-9908-571e56a19d9d {{(pid=75021) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 07:03:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:48 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:03:48 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:03:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.602s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-4acdea62-f374-4751-b572-2e24b738ac1f req-6e8b4d8a-d57a-46de-9f9e-74a4bdd0f241 service nova] [instance: d5cd8c5d-acc4-44b8-b240-58f8fea899ec] Received event network-vif-deleted-15d5a156-55aa-4946-9ca4-7bb6cc1a07a0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:48 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Deleted allocations for instance d5cd8c5d-acc4-44b8-b240-58f8fea899ec
Dec 06 07:03:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f7476e42-a06f-499c-ba13-3dcbca1cb581 tempest-ServerActionsV293TestJSON-888472527 tempest-ServerActionsV293TestJSON-888472527-project-member] Lock "d5cd8c5d-acc4-44b8-b240-58f8fea899ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.070s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:56 user nova-compute[75021]: INFO nova.compute.manager [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Rescuing
Dec 06 07:03:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:03:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquired lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:03:56 user nova-compute[75021]: DEBUG nova.network.neutron [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:03:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:03:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:03:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:57 user nova-compute[75021]: DEBUG nova.network.neutron [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Updating instance_info_cache with network_info: [{"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:03:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Releasing lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:03:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-580612c1-9bbf-4069-abe4-a661b000263d req-acc9dd78-a7a4-4790-be8b-f8e16df9b421 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received event network-vif-unplugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-580612c1-9bbf-4069-abe4-a661b000263d req-acc9dd78-a7a4-4790-be8b-f8e16df9b421 service nova] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-580612c1-9bbf-4069-abe4-a661b000263d req-acc9dd78-a7a4-4790-be8b-f8e16df9b421 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-580612c1-9bbf-4069-abe4-a661b000263d req-acc9dd78-a7a4-4790-be8b-f8e16df9b421 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-580612c1-9bbf-4069-abe4-a661b000263d req-acc9dd78-a7a4-4790-be8b-f8e16df9b421 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] No waiting events found dispatching network-vif-unplugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:03:58 user nova-compute[75021]: WARNING nova.compute.manager [req-580612c1-9bbf-4069-abe4-a661b000263d req-acc9dd78-a7a4-4790-be8b-f8e16df9b421 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received unexpected event network-vif-unplugged-0b799ddb-c34b-457f-9412-d09c3ab04806 for instance with vm_state active and task_state rescuing.
Dec 06 07:03:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:58 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Instance destroyed successfully.
Dec 06 07:03:58 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Attempting rescue
Dec 06 07:03:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75021) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Instance directory exists: not creating {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 07:03:58 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Creating image(s)
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "/opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "/opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG nova.objects.instance [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4ffc6429-3f3c-4a7e-98e5-0db984266eae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.246s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk.rescue {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk.rescue" returned: 0 in 0.059s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.objects.instance [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'migration_context' on Instance uuid 4ffc6429-3f3c-4a7e-98e5-0db984266eae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.objects.base [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Object Instance<4ffc6429-3f3c-4a7e-98e5-0db984266eae> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Start _get_guest_xml network_info=[{"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "vif_mac": "fa:16:3e:7a:2d:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.objects.instance [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'resources' on Instance uuid 4ffc6429-3f3c-4a7e-98e5-0db984266eae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.objects.base [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Object Instance<4ffc6429-3f3c-4a7e-98e5-0db984266eae> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.objects.instance [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'numa_topology' on Instance uuid 4ffc6429-3f3c-4a7e-98e5-0db984266eae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.objects.base [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Object Instance<4ffc6429-3f3c-4a7e-98e5-0db984266eae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:03:59 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:03:59 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:03:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.objects.instance [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4ffc6429-3f3c-4a7e-98e5-0db984266eae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.objects.base [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Object Instance<4ffc6429-3f3c-4a7e-98e5-0db984266eae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1331447466',display_name='tempest-ServerRescueNegativeTestJSON-server-1331447466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1331447466',id=1,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43d3fb6e885546bd9660c81fac9cfa12',ramdisk_id='',reservation_id='r-degm1zig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-674134420',owner_user_name='tempest-ServerRescueNegativeTestJSON-674134420-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T06:59:31Z,user_data=None,user_id='e6d8114db9fa47c09bc9675da9e19a8c',uuid=4ffc6429-3f3c-4a7e-98e5-0db984266eae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "vif_mac": "fa:16:3e:7a:2d:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converting VIF {"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "vif_mac": "fa:16:3e:7a:2d:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:2d:18,bridge_name='br-int',has_traffic_filtering=True,id=0b799ddb-c34b-457f-9412-d09c3ab04806,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b799ddb-c3') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.objects.instance [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ffc6429-3f3c-4a7e-98e5-0db984266eae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.objects.base [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Object Instance<4ffc6429-3f3c-4a7e-98e5-0db984266eae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:03:59 user nova-compute[75021]:   <uuid>4ffc6429-3f3c-4a7e-98e5-0db984266eae</uuid>
Dec 06 07:03:59 user nova-compute[75021]:   <name>instance-00000001</name>
Dec 06 07:03:59 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:03:59 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:03:59 user nova-compute[75021]:   <metadata>
Dec 06 07:03:59 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:03:59 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:03:59 user nova-compute[75021]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1331447466</nova:name>
Dec 06 07:03:59 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:03:59</nova:creationTime>
Dec 06 07:03:59 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:03:59 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:03:59 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:03:59 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:03:59 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:03:59 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:03:59 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:03:59 user nova-compute[75021]:       <nova:owner>
Dec 06 07:03:59 user nova-compute[75021]:         <nova:user uuid="e6d8114db9fa47c09bc9675da9e19a8c">tempest-ServerRescueNegativeTestJSON-674134420-project-member</nova:user>
Dec 06 07:03:59 user nova-compute[75021]:         <nova:project uuid="43d3fb6e885546bd9660c81fac9cfa12">tempest-ServerRescueNegativeTestJSON-674134420</nova:project>
Dec 06 07:03:59 user nova-compute[75021]:       </nova:owner>
Dec 06 07:03:59 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:03:59 user nova-compute[75021]:       <nova:ports>
Dec 06 07:03:59 user nova-compute[75021]:         <nova:port uuid="0b799ddb-c34b-457f-9412-d09c3ab04806">
Dec 06 07:03:59 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 07:03:59 user nova-compute[75021]:         </nova:port>
Dec 06 07:03:59 user nova-compute[75021]:       </nova:ports>
Dec 06 07:03:59 user nova-compute[75021]:     </nova:instance>
Dec 06 07:03:59 user nova-compute[75021]:   </metadata>
Dec 06 07:03:59 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:03:59 user nova-compute[75021]:     <system>
Dec 06 07:03:59 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:03:59 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:03:59 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:03:59 user nova-compute[75021]:       <entry name="serial">4ffc6429-3f3c-4a7e-98e5-0db984266eae</entry>
Dec 06 07:03:59 user nova-compute[75021]:       <entry name="uuid">4ffc6429-3f3c-4a7e-98e5-0db984266eae</entry>
Dec 06 07:03:59 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:03:59 user nova-compute[75021]:     </system>
Dec 06 07:03:59 user nova-compute[75021]:   </sysinfo>
Dec 06 07:03:59 user nova-compute[75021]:   <os>
Dec 06 07:03:59 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:03:59 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:03:59 user nova-compute[75021]:   </os>
Dec 06 07:03:59 user nova-compute[75021]:   <features>
Dec 06 07:03:59 user nova-compute[75021]:     <acpi/>
Dec 06 07:03:59 user nova-compute[75021]:     <apic/>
Dec 06 07:03:59 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:03:59 user nova-compute[75021]:   </features>
Dec 06 07:03:59 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:03:59 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:03:59 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:03:59 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:03:59 user nova-compute[75021]:   </clock>
Dec 06 07:03:59 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:03:59 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:03:59 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:03:59 user nova-compute[75021]:   </cpu>
Dec 06 07:03:59 user nova-compute[75021]:   <devices>
Dec 06 07:03:59 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:03:59 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:03:59 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk.rescue"/>
Dec 06 07:03:59 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:03:59 user nova-compute[75021]:     </disk>
Dec 06 07:03:59 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:03:59 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:03:59 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk"/>
Dec 06 07:03:59 user nova-compute[75021]:       <target dev="vdb" bus="virtio"/>
Dec 06 07:03:59 user nova-compute[75021]:     </disk>
Dec 06 07:03:59 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:03:59 user nova-compute[75021]:       <mac address="fa:16:3e:7a:2d:18"/>
Dec 06 07:03:59 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:03:59 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:03:59 user nova-compute[75021]:       <target dev="tap0b799ddb-c3"/>
Dec 06 07:03:59 user nova-compute[75021]:     </interface>
Dec 06 07:03:59 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:03:59 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/console.log" append="off"/>
Dec 06 07:03:59 user nova-compute[75021]:     </serial>
Dec 06 07:03:59 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:03:59 user nova-compute[75021]:     <video>
Dec 06 07:03:59 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:03:59 user nova-compute[75021]:     </video>
Dec 06 07:03:59 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:03:59 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:03:59 user nova-compute[75021]:     </rng>
Dec 06 07:03:59 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:03:59 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:03:59 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:03:59 user nova-compute[75021]:     </memballoon>
Dec 06 07:03:59 user nova-compute[75021]:   </devices>
Dec 06 07:03:59 user nova-compute[75021]: </domain>
Dec 06 07:03:59 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:03:59 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Instance destroyed successfully.
Dec 06 07:03:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No VIF found with MAC fa:16:3e:7a:2d:18, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:03:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-3a58981f-be2f-40d2-b2e5-e0da6b5c2d8c req-c31f4405-6915-4c50-8c50-a71de9de57b5 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:04:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3a58981f-be2f-40d2-b2e5-e0da6b5c2d8c req-c31f4405-6915-4c50-8c50-a71de9de57b5 service nova] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3a58981f-be2f-40d2-b2e5-e0da6b5c2d8c req-c31f4405-6915-4c50-8c50-a71de9de57b5 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3a58981f-be2f-40d2-b2e5-e0da6b5c2d8c req-c31f4405-6915-4c50-8c50-a71de9de57b5 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-3a58981f-be2f-40d2-b2e5-e0da6b5c2d8c req-c31f4405-6915-4c50-8c50-a71de9de57b5 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] No waiting events found dispatching network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:04:00 user nova-compute[75021]: WARNING nova.compute.manager [req-3a58981f-be2f-40d2-b2e5-e0da6b5c2d8c req-c31f4405-6915-4c50-8c50-a71de9de57b5 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received unexpected event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 for instance with vm_state active and task_state rescuing.
Dec 06 07:04:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:04:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-5bb5e62b-47e7-485e-b7db-dc75cedd62b7 req-4285a738-9d79-45b1-b114-e33a79bd02a4 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:04:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5bb5e62b-47e7-485e-b7db-dc75cedd62b7 req-4285a738-9d79-45b1-b114-e33a79bd02a4 service nova] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5bb5e62b-47e7-485e-b7db-dc75cedd62b7 req-4285a738-9d79-45b1-b114-e33a79bd02a4 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5bb5e62b-47e7-485e-b7db-dc75cedd62b7 req-4285a738-9d79-45b1-b114-e33a79bd02a4 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-5bb5e62b-47e7-485e-b7db-dc75cedd62b7 req-4285a738-9d79-45b1-b114-e33a79bd02a4 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] No waiting events found dispatching network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:04:02 user nova-compute[75021]: WARNING nova.compute.manager [req-5bb5e62b-47e7-485e-b7db-dc75cedd62b7 req-4285a738-9d79-45b1-b114-e33a79bd02a4 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received unexpected event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 for instance with vm_state active and task_state rescuing.
Dec 06 07:04:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-5bb5e62b-47e7-485e-b7db-dc75cedd62b7 req-4285a738-9d79-45b1-b114-e33a79bd02a4 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:04:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5bb5e62b-47e7-485e-b7db-dc75cedd62b7 req-4285a738-9d79-45b1-b114-e33a79bd02a4 service nova] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5bb5e62b-47e7-485e-b7db-dc75cedd62b7 req-4285a738-9d79-45b1-b114-e33a79bd02a4 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5bb5e62b-47e7-485e-b7db-dc75cedd62b7 req-4285a738-9d79-45b1-b114-e33a79bd02a4 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-5bb5e62b-47e7-485e-b7db-dc75cedd62b7 req-4285a738-9d79-45b1-b114-e33a79bd02a4 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] No waiting events found dispatching network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:04:02 user nova-compute[75021]: WARNING nova.compute.manager [req-5bb5e62b-47e7-485e-b7db-dc75cedd62b7 req-4285a738-9d79-45b1-b114-e33a79bd02a4 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received unexpected event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 for instance with vm_state active and task_state rescuing.
Dec 06 07:04:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-935baebf-0954-4a27-8671-ae920c35bc03 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:04:03 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:04:03 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:04:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7456MB free_disk=25.5440673828125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Applying migration context for instance 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf as it has an incoming, in-progress migration 99ebc416-4861-41d1-a463-6c587341ecbd. Migration status is finished {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 06 07:04:03 user nova-compute[75021]: INFO nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updating resource usage from migration 99ebc416-4861-41d1-a463-6c587341ecbd
Dec 06 07:04:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 7184c6b7-d34c-425a-ba1d-ddad75231f7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance f9275ae0-ccb1-4c73-b639-9cd243c6ff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5c50a6a8-2500-4408-a932-48f0116713b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Migration 99ebc416-4861-41d1-a463-6c587341ecbd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:04:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:04:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:04 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:04:04 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:04:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:04:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.627s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:04:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:04:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:04:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 07:04:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:04:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:04:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:04:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:04:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:04:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:04:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:04:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquiring lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:04:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:14 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:04:14 user nova-compute[75021]: INFO nova.compute.claims [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Claim successful on node user
Dec 06 07:04:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG nova.compute.manager [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG nova.compute.manager [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG nova.network.neutron [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:04:15 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:04:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG nova.compute.manager [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG nova.compute.manager [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:04:15 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Creating image(s)
Dec 06 07:04:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "/opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "/opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG nova.policy [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20baad167088455fbc6e027a6c679468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b8ff637e4c4e459bd698cc2c8341f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.209s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.217s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk 1073741824" returned: 0 in 0.085s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:16 user nova-compute[75021]: DEBUG nova.network.neutron [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Successfully created port: b51652b3-d921-4e2b-9b19-57064192e1fa {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:04:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.204s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:16 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:04:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:16 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Cannot resize image /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:04:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:04:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Ensure instance console log exists: /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:04:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.network.neutron [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Successfully updated port: b51652b3-d921-4e2b-9b19-57064192e1fa {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquiring lock "refresh_cache-9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquired lock "refresh_cache-9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.network.neutron [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.compute.manager [req-57345960-140f-4823-893c-b91016d78cce req-f3fc014e-ebf7-4bf9-8027-b143b95e04ea service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Received event network-changed-b51652b3-d921-4e2b-9b19-57064192e1fa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.compute.manager [req-57345960-140f-4823-893c-b91016d78cce req-f3fc014e-ebf7-4bf9-8027-b143b95e04ea service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Refreshing instance network info cache due to event network-changed-b51652b3-d921-4e2b-9b19-57064192e1fa. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-57345960-140f-4823-893c-b91016d78cce req-f3fc014e-ebf7-4bf9-8027-b143b95e04ea service nova] Acquiring lock "refresh_cache-9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.network.neutron [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.network.neutron [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Updating instance_info_cache with network_info: [{"id": "b51652b3-d921-4e2b-9b19-57064192e1fa", "address": "fa:16:3e:ff:0c:16", "network": {"id": "5f9c0afd-2c38-4f2a-8f56-11d0b016a438", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2085203827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b8ff637e4c4e459bd698cc2c8341f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51652b3-d9", "ovs_interfaceid": "b51652b3-d921-4e2b-9b19-57064192e1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Releasing lock "refresh_cache-9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Instance network_info: |[{"id": "b51652b3-d921-4e2b-9b19-57064192e1fa", "address": "fa:16:3e:ff:0c:16", "network": {"id": "5f9c0afd-2c38-4f2a-8f56-11d0b016a438", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2085203827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b8ff637e4c4e459bd698cc2c8341f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51652b3-d9", "ovs_interfaceid": "b51652b3-d921-4e2b-9b19-57064192e1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-57345960-140f-4823-893c-b91016d78cce req-f3fc014e-ebf7-4bf9-8027-b143b95e04ea service nova] Acquired lock "refresh_cache-9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.network.neutron [req-57345960-140f-4823-893c-b91016d78cce req-f3fc014e-ebf7-4bf9-8027-b143b95e04ea service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Refreshing network info cache for port b51652b3-d921-4e2b-9b19-57064192e1fa {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Start _get_guest_xml network_info=[{"id": "b51652b3-d921-4e2b-9b19-57064192e1fa", "address": "fa:16:3e:ff:0c:16", "network": {"id": "5f9c0afd-2c38-4f2a-8f56-11d0b016a438", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2085203827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b8ff637e4c4e459bd698cc2c8341f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51652b3-d9", "ovs_interfaceid": "b51652b3-d921-4e2b-9b19-57064192e1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:04:17 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:04:17 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-389833196',display_name='tempest-TestVolumeSwap-server-389833196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-389833196',id=17,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE53n2PdH954cItpSeePpt6kEwu4QgmZwO3vkGn0e9ZTbv2WbzipYDjiIa6qU9HqkgPBhS/ieE4VPdNgPK4MgeenBcEnEka+vJEmLM99E0sbCOjPRupmLYwjk4etAR653Q==',key_name='tempest-keypair-1099938136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b8ff637e4c4e459bd698cc2c8341f6',ramdisk_id='',reservation_id='r-6a0yb8z8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1030559181',owner_user_name='tempest-TestVolumeSwap-1030559181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:04:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20baad167088455fbc6e027a6c679468',uuid=9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b51652b3-d921-4e2b-9b19-57064192e1fa", "address": "fa:16:3e:ff:0c:16", "network": {"id": "5f9c0afd-2c38-4f2a-8f56-11d0b016a438", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2085203827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b8ff637e4c4e459bd698cc2c8341f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51652b3-d9", "ovs_interfaceid": "b51652b3-d921-4e2b-9b19-57064192e1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Converting VIF {"id": "b51652b3-d921-4e2b-9b19-57064192e1fa", "address": "fa:16:3e:ff:0c:16", "network": {"id": "5f9c0afd-2c38-4f2a-8f56-11d0b016a438", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2085203827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b8ff637e4c4e459bd698cc2c8341f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51652b3-d9", "ovs_interfaceid": "b51652b3-d921-4e2b-9b19-57064192e1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:0c:16,bridge_name='br-int',has_traffic_filtering=True,id=b51652b3-d921-4e2b-9b19-57064192e1fa,network=Network(5f9c0afd-2c38-4f2a-8f56-11d0b016a438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51652b3-d9') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.objects.instance [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:04:17 user nova-compute[75021]:   <uuid>9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f</uuid>
Dec 06 07:04:17 user nova-compute[75021]:   <name>instance-00000011</name>
Dec 06 07:04:17 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:04:17 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:04:17 user nova-compute[75021]:   <metadata>
Dec 06 07:04:17 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:04:17 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:04:17 user nova-compute[75021]:       <nova:name>tempest-TestVolumeSwap-server-389833196</nova:name>
Dec 06 07:04:17 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:04:17</nova:creationTime>
Dec 06 07:04:17 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:04:17 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:04:17 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:04:17 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:04:17 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:04:17 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:04:17 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:04:17 user nova-compute[75021]:       <nova:owner>
Dec 06 07:04:17 user nova-compute[75021]:         <nova:user uuid="20baad167088455fbc6e027a6c679468">tempest-TestVolumeSwap-1030559181-project-member</nova:user>
Dec 06 07:04:17 user nova-compute[75021]:         <nova:project uuid="f9b8ff637e4c4e459bd698cc2c8341f6">tempest-TestVolumeSwap-1030559181</nova:project>
Dec 06 07:04:17 user nova-compute[75021]:       </nova:owner>
Dec 06 07:04:17 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:04:17 user nova-compute[75021]:       <nova:ports>
Dec 06 07:04:17 user nova-compute[75021]:         <nova:port uuid="b51652b3-d921-4e2b-9b19-57064192e1fa">
Dec 06 07:04:17 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 07:04:17 user nova-compute[75021]:         </nova:port>
Dec 06 07:04:17 user nova-compute[75021]:       </nova:ports>
Dec 06 07:04:17 user nova-compute[75021]:     </nova:instance>
Dec 06 07:04:17 user nova-compute[75021]:   </metadata>
Dec 06 07:04:17 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:04:17 user nova-compute[75021]:     <system>
Dec 06 07:04:17 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:04:17 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:04:17 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:04:17 user nova-compute[75021]:       <entry name="serial">9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f</entry>
Dec 06 07:04:17 user nova-compute[75021]:       <entry name="uuid">9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f</entry>
Dec 06 07:04:17 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:04:17 user nova-compute[75021]:     </system>
Dec 06 07:04:17 user nova-compute[75021]:   </sysinfo>
Dec 06 07:04:17 user nova-compute[75021]:   <os>
Dec 06 07:04:17 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:04:17 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:04:17 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:04:17 user nova-compute[75021]:   </os>
Dec 06 07:04:17 user nova-compute[75021]:   <features>
Dec 06 07:04:17 user nova-compute[75021]:     <acpi/>
Dec 06 07:04:17 user nova-compute[75021]:     <apic/>
Dec 06 07:04:17 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:04:17 user nova-compute[75021]:   </features>
Dec 06 07:04:17 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:04:17 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:04:17 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:04:17 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:04:17 user nova-compute[75021]:   </clock>
Dec 06 07:04:17 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:04:17 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:04:17 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:04:17 user nova-compute[75021]:   </cpu>
Dec 06 07:04:17 user nova-compute[75021]:   <devices>
Dec 06 07:04:17 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:04:17 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:04:17 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk"/>
Dec 06 07:04:17 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:04:17 user nova-compute[75021]:     </disk>
Dec 06 07:04:17 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:04:17 user nova-compute[75021]:       <mac address="fa:16:3e:ff:0c:16"/>
Dec 06 07:04:17 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:04:17 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:04:17 user nova-compute[75021]:       <target dev="tapb51652b3-d9"/>
Dec 06 07:04:17 user nova-compute[75021]:     </interface>
Dec 06 07:04:17 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:04:17 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/console.log" append="off"/>
Dec 06 07:04:17 user nova-compute[75021]:     </serial>
Dec 06 07:04:17 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:04:17 user nova-compute[75021]:     <video>
Dec 06 07:04:17 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:04:17 user nova-compute[75021]:     </video>
Dec 06 07:04:17 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:04:17 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:04:17 user nova-compute[75021]:     </rng>
Dec 06 07:04:17 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:04:17 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:04:17 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:04:17 user nova-compute[75021]:     </memballoon>
Dec 06 07:04:17 user nova-compute[75021]:   </devices>
Dec 06 07:04:17 user nova-compute[75021]: </domain>
Dec 06 07:04:17 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-389833196',display_name='tempest-TestVolumeSwap-server-389833196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-389833196',id=17,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE53n2PdH954cItpSeePpt6kEwu4QgmZwO3vkGn0e9ZTbv2WbzipYDjiIa6qU9HqkgPBhS/ieE4VPdNgPK4MgeenBcEnEka+vJEmLM99E0sbCOjPRupmLYwjk4etAR653Q==',key_name='tempest-keypair-1099938136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b8ff637e4c4e459bd698cc2c8341f6',ramdisk_id='',reservation_id='r-6a0yb8z8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1030559181',owner_user_name='tempest-TestVolumeSwap-1030559181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:04:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20baad167088455fbc6e027a6c679468',uuid=9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b51652b3-d921-4e2b-9b19-57064192e1fa", "address": "fa:16:3e:ff:0c:16", "network": {"id": "5f9c0afd-2c38-4f2a-8f56-11d0b016a438", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2085203827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b8ff637e4c4e459bd698cc2c8341f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51652b3-d9", "ovs_interfaceid": "b51652b3-d921-4e2b-9b19-57064192e1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Converting VIF {"id": "b51652b3-d921-4e2b-9b19-57064192e1fa", "address": "fa:16:3e:ff:0c:16", "network": {"id": "5f9c0afd-2c38-4f2a-8f56-11d0b016a438", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2085203827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b8ff637e4c4e459bd698cc2c8341f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51652b3-d9", "ovs_interfaceid": "b51652b3-d921-4e2b-9b19-57064192e1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:0c:16,bridge_name='br-int',has_traffic_filtering=True,id=b51652b3-d921-4e2b-9b19-57064192e1fa,network=Network(5f9c0afd-2c38-4f2a-8f56-11d0b016a438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51652b3-d9') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG os_vif [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:0c:16,bridge_name='br-int',has_traffic_filtering=True,id=b51652b3-d921-4e2b-9b19-57064192e1fa,network=Network(5f9c0afd-2c38-4f2a-8f56-11d0b016a438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51652b3-d9') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29eb9910-b473-5826-98d3-21a4caae227c', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb51652b3-d9, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb51652b3-d9, col_values=(('qos', UUID('bc4daa6b-a1ec-4794-97f1-07d801ee7d5b')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb51652b3-d9, col_values=(('external_ids', {'iface-id': 'b51652b3-d921-4e2b-9b19-57064192e1fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:0c:16', 'vm-uuid': '9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:04:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:17 user nova-compute[75021]: INFO os_vif [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:0c:16,bridge_name='br-int',has_traffic_filtering=True,id=b51652b3-d921-4e2b-9b19-57064192e1fa,network=Network(5f9c0afd-2c38-4f2a-8f56-11d0b016a438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51652b3-d9')
Dec 06 07:04:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:04:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] No VIF found with MAC fa:16:3e:ff:0c:16, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:04:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:18 user nova-compute[75021]: DEBUG nova.network.neutron [req-57345960-140f-4823-893c-b91016d78cce req-f3fc014e-ebf7-4bf9-8027-b143b95e04ea service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Updated VIF entry in instance network info cache for port b51652b3-d921-4e2b-9b19-57064192e1fa. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:04:18 user nova-compute[75021]: DEBUG nova.network.neutron [req-57345960-140f-4823-893c-b91016d78cce req-f3fc014e-ebf7-4bf9-8027-b143b95e04ea service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Updating instance_info_cache with network_info: [{"id": "b51652b3-d921-4e2b-9b19-57064192e1fa", "address": "fa:16:3e:ff:0c:16", "network": {"id": "5f9c0afd-2c38-4f2a-8f56-11d0b016a438", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2085203827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b8ff637e4c4e459bd698cc2c8341f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51652b3-d9", "ovs_interfaceid": "b51652b3-d921-4e2b-9b19-57064192e1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:04:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-57345960-140f-4823-893c-b91016d78cce req-f3fc014e-ebf7-4bf9-8027-b143b95e04ea service nova] Releasing lock "refresh_cache-9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:04:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-ef09abd8-bca5-4c01-8760-e0e5025b7daf req-bc392295-64c8-41d1-b409-e5ccb551ec50 service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Received event network-vif-plugged-b51652b3-d921-4e2b-9b19-57064192e1fa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:04:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ef09abd8-bca5-4c01-8760-e0e5025b7daf req-bc392295-64c8-41d1-b409-e5ccb551ec50 service nova] Acquiring lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ef09abd8-bca5-4c01-8760-e0e5025b7daf req-bc392295-64c8-41d1-b409-e5ccb551ec50 service nova] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ef09abd8-bca5-4c01-8760-e0e5025b7daf req-bc392295-64c8-41d1-b409-e5ccb551ec50 service nova] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-ef09abd8-bca5-4c01-8760-e0e5025b7daf req-bc392295-64c8-41d1-b409-e5ccb551ec50 service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] No waiting events found dispatching network-vif-plugged-b51652b3-d921-4e2b-9b19-57064192e1fa {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:04:20 user nova-compute[75021]: WARNING nova.compute.manager [req-ef09abd8-bca5-4c01-8760-e0e5025b7daf req-bc392295-64c8-41d1-b409-e5ccb551ec50 service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Received unexpected event network-vif-plugged-b51652b3-d921-4e2b-9b19-57064192e1fa for instance with vm_state building and task_state spawning.
Dec 06 07:04:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:04:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Instance spawned successfully.
Dec 06 07:04:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:22 user nova-compute[75021]: INFO nova.compute.manager [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Took 6.74 seconds to spawn the instance on the hypervisor.
Dec 06 07:04:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:04:22 user nova-compute[75021]: INFO nova.compute.manager [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Took 7.64 seconds to build instance.
Dec 06 07:04:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-07eed24a-60af-492b-9d2c-29f72eaeeb5b tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.777s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-d41099c4-c8a3-4acc-a2e6-f83680b3b2be req-1f4434ed-2d7e-4a3a-be7e-bade5f2c0367 service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Received event network-vif-plugged-b51652b3-d921-4e2b-9b19-57064192e1fa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d41099c4-c8a3-4acc-a2e6-f83680b3b2be req-1f4434ed-2d7e-4a3a-be7e-bade5f2c0367 service nova] Acquiring lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d41099c4-c8a3-4acc-a2e6-f83680b3b2be req-1f4434ed-2d7e-4a3a-be7e-bade5f2c0367 service nova] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d41099c4-c8a3-4acc-a2e6-f83680b3b2be req-1f4434ed-2d7e-4a3a-be7e-bade5f2c0367 service nova] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-d41099c4-c8a3-4acc-a2e6-f83680b3b2be req-1f4434ed-2d7e-4a3a-be7e-bade5f2c0367 service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] No waiting events found dispatching network-vif-plugged-b51652b3-d921-4e2b-9b19-57064192e1fa {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:04:22 user nova-compute[75021]: WARNING nova.compute.manager [req-d41099c4-c8a3-4acc-a2e6-f83680b3b2be req-1f4434ed-2d7e-4a3a-be7e-bade5f2c0367 service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Received unexpected event network-vif-plugged-b51652b3-d921-4e2b-9b19-57064192e1fa for instance with vm_state active and task_state None.
Dec 06 07:04:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "68ca3b31-7de1-4522-a093-a5eb69274c0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:04:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:04:23 user nova-compute[75021]: INFO nova.compute.claims [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Claim successful on node user
Dec 06 07:04:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:23 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:04:23 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:04:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:23 user nova-compute[75021]: DEBUG nova.compute.manager [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:04:23 user nova-compute[75021]: DEBUG nova.compute.manager [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:04:23 user nova-compute[75021]: DEBUG nova.network.neutron [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:04:23 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:04:23 user nova-compute[75021]: DEBUG nova.compute.manager [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:04:23 user nova-compute[75021]: DEBUG nova.policy [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bec5e110057b47ac89c85ca77aaa56ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70aa47164bdf43a78448ce550774cc70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:04:23 user nova-compute[75021]: DEBUG nova.compute.manager [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:04:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:04:23 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Creating image(s)
Dec 06 07:04:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "/opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "/opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "/opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.239s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk 1073741824" returned: 0 in 0.071s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.172s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Cannot resize image /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Ensure instance console log exists: /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:24 user nova-compute[75021]: DEBUG nova.network.neutron [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Successfully created port: b7ad44e1-5205-44aa-84b4-1dbe16038048 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:04:26 user nova-compute[75021]: DEBUG nova.network.neutron [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Successfully updated port: b7ad44e1-5205-44aa-84b4-1dbe16038048 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:04:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "refresh_cache-68ca3b31-7de1-4522-a093-a5eb69274c0b" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:04:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquired lock "refresh_cache-68ca3b31-7de1-4522-a093-a5eb69274c0b" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:04:26 user nova-compute[75021]: DEBUG nova.network.neutron [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:04:26 user nova-compute[75021]: DEBUG nova.network.neutron [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:04:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-c9c089ad-df18-44e4-abae-f6e81d0fcaa7 req-28313bc1-1bb1-4668-923b-d70afd48d9aa service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Received event network-changed-b7ad44e1-5205-44aa-84b4-1dbe16038048 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:04:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-c9c089ad-df18-44e4-abae-f6e81d0fcaa7 req-28313bc1-1bb1-4668-923b-d70afd48d9aa service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Refreshing instance network info cache due to event network-changed-b7ad44e1-5205-44aa-84b4-1dbe16038048. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:04:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c9c089ad-df18-44e4-abae-f6e81d0fcaa7 req-28313bc1-1bb1-4668-923b-d70afd48d9aa service nova] Acquiring lock "refresh_cache-68ca3b31-7de1-4522-a093-a5eb69274c0b" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.network.neutron [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Updating instance_info_cache with network_info: [{"id": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "address": "fa:16:3e:76:2a:05", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad44e1-52", "ovs_interfaceid": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Releasing lock "refresh_cache-68ca3b31-7de1-4522-a093-a5eb69274c0b" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.compute.manager [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Instance network_info: |[{"id": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "address": "fa:16:3e:76:2a:05", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad44e1-52", "ovs_interfaceid": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c9c089ad-df18-44e4-abae-f6e81d0fcaa7 req-28313bc1-1bb1-4668-923b-d70afd48d9aa service nova] Acquired lock "refresh_cache-68ca3b31-7de1-4522-a093-a5eb69274c0b" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.network.neutron [req-c9c089ad-df18-44e4-abae-f6e81d0fcaa7 req-28313bc1-1bb1-4668-923b-d70afd48d9aa service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Refreshing network info cache for port b7ad44e1-5205-44aa-84b4-1dbe16038048 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Start _get_guest_xml network_info=[{"id": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "address": "fa:16:3e:76:2a:05", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad44e1-52", "ovs_interfaceid": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:04:27 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:04:27 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-658055119',display_name='tempest-ServersNegativeTestJSON-server-658055119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-658055119',id=18,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70aa47164bdf43a78448ce550774cc70',ramdisk_id='',reservation_id='r-zhqjjqdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1406242964',owner_user_name='tempest-ServersNegativeTestJSON-1406242964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:04:24Z,user_data=None,user_id='bec5e110057b47ac89c85ca77aaa56ec',uuid=68ca3b31-7de1-4522-a093-a5eb69274c0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "address": "fa:16:3e:76:2a:05", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad44e1-52", "ovs_interfaceid": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Converting VIF {"id": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "address": "fa:16:3e:76:2a:05", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad44e1-52", "ovs_interfaceid": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:2a:05,bridge_name='br-int',has_traffic_filtering=True,id=b7ad44e1-5205-44aa-84b4-1dbe16038048,network=Network(ab7aa0ea-4c08-4d4a-b74c-c47298834061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ad44e1-52') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.objects.instance [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lazy-loading 'pci_devices' on Instance uuid 68ca3b31-7de1-4522-a093-a5eb69274c0b {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:04:27 user nova-compute[75021]:   <uuid>68ca3b31-7de1-4522-a093-a5eb69274c0b</uuid>
Dec 06 07:04:27 user nova-compute[75021]:   <name>instance-00000012</name>
Dec 06 07:04:27 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:04:27 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:04:27 user nova-compute[75021]:   <metadata>
Dec 06 07:04:27 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:04:27 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:04:27 user nova-compute[75021]:       <nova:name>tempest-ServersNegativeTestJSON-server-658055119</nova:name>
Dec 06 07:04:27 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:04:27</nova:creationTime>
Dec 06 07:04:27 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:04:27 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:04:27 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:04:27 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:04:27 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:04:27 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:04:27 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:04:27 user nova-compute[75021]:       <nova:owner>
Dec 06 07:04:27 user nova-compute[75021]:         <nova:user uuid="bec5e110057b47ac89c85ca77aaa56ec">tempest-ServersNegativeTestJSON-1406242964-project-member</nova:user>
Dec 06 07:04:27 user nova-compute[75021]:         <nova:project uuid="70aa47164bdf43a78448ce550774cc70">tempest-ServersNegativeTestJSON-1406242964</nova:project>
Dec 06 07:04:27 user nova-compute[75021]:       </nova:owner>
Dec 06 07:04:27 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:04:27 user nova-compute[75021]:       <nova:ports>
Dec 06 07:04:27 user nova-compute[75021]:         <nova:port uuid="b7ad44e1-5205-44aa-84b4-1dbe16038048">
Dec 06 07:04:27 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 06 07:04:27 user nova-compute[75021]:         </nova:port>
Dec 06 07:04:27 user nova-compute[75021]:       </nova:ports>
Dec 06 07:04:27 user nova-compute[75021]:     </nova:instance>
Dec 06 07:04:27 user nova-compute[75021]:   </metadata>
Dec 06 07:04:27 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:04:27 user nova-compute[75021]:     <system>
Dec 06 07:04:27 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:04:27 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:04:27 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:04:27 user nova-compute[75021]:       <entry name="serial">68ca3b31-7de1-4522-a093-a5eb69274c0b</entry>
Dec 06 07:04:27 user nova-compute[75021]:       <entry name="uuid">68ca3b31-7de1-4522-a093-a5eb69274c0b</entry>
Dec 06 07:04:27 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:04:27 user nova-compute[75021]:     </system>
Dec 06 07:04:27 user nova-compute[75021]:   </sysinfo>
Dec 06 07:04:27 user nova-compute[75021]:   <os>
Dec 06 07:04:27 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:04:27 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:04:27 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:04:27 user nova-compute[75021]:   </os>
Dec 06 07:04:27 user nova-compute[75021]:   <features>
Dec 06 07:04:27 user nova-compute[75021]:     <acpi/>
Dec 06 07:04:27 user nova-compute[75021]:     <apic/>
Dec 06 07:04:27 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:04:27 user nova-compute[75021]:   </features>
Dec 06 07:04:27 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:04:27 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:04:27 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:04:27 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:04:27 user nova-compute[75021]:   </clock>
Dec 06 07:04:27 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:04:27 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:04:27 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:04:27 user nova-compute[75021]:   </cpu>
Dec 06 07:04:27 user nova-compute[75021]:   <devices>
Dec 06 07:04:27 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:04:27 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:04:27 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk"/>
Dec 06 07:04:27 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:04:27 user nova-compute[75021]:     </disk>
Dec 06 07:04:27 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:04:27 user nova-compute[75021]:       <mac address="fa:16:3e:76:2a:05"/>
Dec 06 07:04:27 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:04:27 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:04:27 user nova-compute[75021]:       <target dev="tapb7ad44e1-52"/>
Dec 06 07:04:27 user nova-compute[75021]:     </interface>
Dec 06 07:04:27 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:04:27 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/console.log" append="off"/>
Dec 06 07:04:27 user nova-compute[75021]:     </serial>
Dec 06 07:04:27 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:04:27 user nova-compute[75021]:     <video>
Dec 06 07:04:27 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:04:27 user nova-compute[75021]:     </video>
Dec 06 07:04:27 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:04:27 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:04:27 user nova-compute[75021]:     </rng>
Dec 06 07:04:27 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:04:27 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:04:27 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:04:27 user nova-compute[75021]:     </memballoon>
Dec 06 07:04:27 user nova-compute[75021]:   </devices>
Dec 06 07:04:27 user nova-compute[75021]: </domain>
Dec 06 07:04:27 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-658055119',display_name='tempest-ServersNegativeTestJSON-server-658055119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-658055119',id=18,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70aa47164bdf43a78448ce550774cc70',ramdisk_id='',reservation_id='r-zhqjjqdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1406242964',owner_user_name='tempest-ServersNegativeTestJSON-1406242964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:04:24Z,user_data=None,user_id='bec5e110057b47ac89c85ca77aaa56ec',uuid=68ca3b31-7de1-4522-a093-a5eb69274c0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "address": "fa:16:3e:76:2a:05", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad44e1-52", "ovs_interfaceid": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Converting VIF {"id": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "address": "fa:16:3e:76:2a:05", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad44e1-52", "ovs_interfaceid": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:2a:05,bridge_name='br-int',has_traffic_filtering=True,id=b7ad44e1-5205-44aa-84b4-1dbe16038048,network=Network(ab7aa0ea-4c08-4d4a-b74c-c47298834061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ad44e1-52') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG os_vif [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:2a:05,bridge_name='br-int',has_traffic_filtering=True,id=b7ad44e1-5205-44aa-84b4-1dbe16038048,network=Network(ab7aa0ea-4c08-4d4a-b74c-c47298834061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ad44e1-52') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7355c96f-ffe9-5d50-9084-4c016c15a22d', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7ad44e1-52, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7ad44e1-52, col_values=(('qos', UUID('f163beec-8895-4025-8a78-ab24e6d5b992')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7ad44e1-52, col_values=(('external_ids', {'iface-id': 'b7ad44e1-5205-44aa-84b4-1dbe16038048', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:2a:05', 'vm-uuid': '68ca3b31-7de1-4522-a093-a5eb69274c0b'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:27 user nova-compute[75021]: INFO os_vif [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:2a:05,bridge_name='br-int',has_traffic_filtering=True,id=b7ad44e1-5205-44aa-84b4-1dbe16038048,network=Network(ab7aa0ea-4c08-4d4a-b74c-c47298834061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ad44e1-52')
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] No VIF found with MAC fa:16:3e:76:2a:05, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.network.neutron [req-c9c089ad-df18-44e4-abae-f6e81d0fcaa7 req-28313bc1-1bb1-4668-923b-d70afd48d9aa service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Updated VIF entry in instance network info cache for port b7ad44e1-5205-44aa-84b4-1dbe16038048. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG nova.network.neutron [req-c9c089ad-df18-44e4-abae-f6e81d0fcaa7 req-28313bc1-1bb1-4668-923b-d70afd48d9aa service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Updating instance_info_cache with network_info: [{"id": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "address": "fa:16:3e:76:2a:05", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad44e1-52", "ovs_interfaceid": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:04:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c9c089ad-df18-44e4-abae-f6e81d0fcaa7 req-28313bc1-1bb1-4668-923b-d70afd48d9aa service nova] Releasing lock "refresh_cache-68ca3b31-7de1-4522-a093-a5eb69274c0b" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:04:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "b9372825-c75d-45a3-a48c-e111869d97a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "b9372825-c75d-45a3-a48c-e111869d97a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:04:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:28 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:04:28 user nova-compute[75021]: INFO nova.compute.claims [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Claim successful on node user
Dec 06 07:04:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-2965ae6b-7ce1-4634-b8ff-462791ac2ad9 req-f065a16a-95ef-4e29-9c76-b81f0322130c service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Received event network-vif-plugged-b7ad44e1-5205-44aa-84b4-1dbe16038048 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2965ae6b-7ce1-4634-b8ff-462791ac2ad9 req-f065a16a-95ef-4e29-9c76-b81f0322130c service nova] Acquiring lock "68ca3b31-7de1-4522-a093-a5eb69274c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2965ae6b-7ce1-4634-b8ff-462791ac2ad9 req-f065a16a-95ef-4e29-9c76-b81f0322130c service nova] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2965ae6b-7ce1-4634-b8ff-462791ac2ad9 req-f065a16a-95ef-4e29-9c76-b81f0322130c service nova] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-2965ae6b-7ce1-4634-b8ff-462791ac2ad9 req-f065a16a-95ef-4e29-9c76-b81f0322130c service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] No waiting events found dispatching network-vif-plugged-b7ad44e1-5205-44aa-84b4-1dbe16038048 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:04:29 user nova-compute[75021]: WARNING nova.compute.manager [req-2965ae6b-7ce1-4634-b8ff-462791ac2ad9 req-f065a16a-95ef-4e29-9c76-b81f0322130c service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Received unexpected event network-vif-plugged-b7ad44e1-5205-44aa-84b4-1dbe16038048 for instance with vm_state building and task_state spawning.
Dec 06 07:04:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.730s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG nova.compute.manager [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG nova.compute.manager [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG nova.network.neutron [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:04:29 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:04:29 user nova-compute[75021]: DEBUG nova.compute.manager [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG nova.policy [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0774aa1e3ee4b69b195b575d116ee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9895e43bf76d4760a26a5e64ea6d4e14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG nova.compute.manager [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:04:29 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Creating image(s)
Dec 06 07:04:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "/opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "/opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.223s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk 1073741824" returned: 0 in 0.229s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.460s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG nova.network.neutron [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Successfully created port: 94c8a95e-1a3a-435e-9f29-9acee536f79f {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.198s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Cannot resize image /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Ensure instance console log exists: /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.network.neutron [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Successfully updated port: 94c8a95e-1a3a-435e-9f29-9acee536f79f {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "refresh_cache-b9372825-c75d-45a3-a48c-e111869d97a5" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquired lock "refresh_cache-b9372825-c75d-45a3-a48c-e111869d97a5" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.network.neutron [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-ccbdbe62-4fe6-44b6-b483-96a13fc767b0 req-952353cd-cb62-4661-b5b1-4c8fe8fe12b1 service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Received event network-changed-94c8a95e-1a3a-435e-9f29-9acee536f79f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-ccbdbe62-4fe6-44b6-b483-96a13fc767b0 req-952353cd-cb62-4661-b5b1-4c8fe8fe12b1 service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Refreshing instance network info cache due to event network-changed-94c8a95e-1a3a-435e-9f29-9acee536f79f. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ccbdbe62-4fe6-44b6-b483-96a13fc767b0 req-952353cd-cb62-4661-b5b1-4c8fe8fe12b1 service nova] Acquiring lock "refresh_cache-b9372825-c75d-45a3-a48c-e111869d97a5" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-e7bc4ec6-9ff1-4e1a-8359-0ac75a9fd735 req-164334d6-1d67-4283-85ac-712460b89871 service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Received event network-vif-plugged-b7ad44e1-5205-44aa-84b4-1dbe16038048 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e7bc4ec6-9ff1-4e1a-8359-0ac75a9fd735 req-164334d6-1d67-4283-85ac-712460b89871 service nova] Acquiring lock "68ca3b31-7de1-4522-a093-a5eb69274c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e7bc4ec6-9ff1-4e1a-8359-0ac75a9fd735 req-164334d6-1d67-4283-85ac-712460b89871 service nova] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e7bc4ec6-9ff1-4e1a-8359-0ac75a9fd735 req-164334d6-1d67-4283-85ac-712460b89871 service nova] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-e7bc4ec6-9ff1-4e1a-8359-0ac75a9fd735 req-164334d6-1d67-4283-85ac-712460b89871 service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] No waiting events found dispatching network-vif-plugged-b7ad44e1-5205-44aa-84b4-1dbe16038048 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:04:31 user nova-compute[75021]: WARNING nova.compute.manager [req-e7bc4ec6-9ff1-4e1a-8359-0ac75a9fd735 req-164334d6-1d67-4283-85ac-712460b89871 service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Received unexpected event network-vif-plugged-b7ad44e1-5205-44aa-84b4-1dbe16038048 for instance with vm_state building and task_state spawning.
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.network.neutron [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:04:31 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Instance spawned successfully.
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:31 user nova-compute[75021]: INFO nova.compute.manager [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Took 7.33 seconds to spawn the instance on the hypervisor.
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:04:31 user nova-compute[75021]: INFO nova.compute.manager [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Took 8.40 seconds to build instance.
Dec 06 07:04:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-817f41c6-0ea4-4813-9309-fa51aa38b659 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.502s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.network.neutron [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Updating instance_info_cache with network_info: [{"id": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "address": "fa:16:3e:fb:4a:05", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c8a95e-1a", "ovs_interfaceid": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Releasing lock "refresh_cache-b9372825-c75d-45a3-a48c-e111869d97a5" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Instance network_info: |[{"id": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "address": "fa:16:3e:fb:4a:05", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c8a95e-1a", "ovs_interfaceid": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ccbdbe62-4fe6-44b6-b483-96a13fc767b0 req-952353cd-cb62-4661-b5b1-4c8fe8fe12b1 service nova] Acquired lock "refresh_cache-b9372825-c75d-45a3-a48c-e111869d97a5" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.network.neutron [req-ccbdbe62-4fe6-44b6-b483-96a13fc767b0 req-952353cd-cb62-4661-b5b1-4c8fe8fe12b1 service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Refreshing network info cache for port 94c8a95e-1a3a-435e-9f29-9acee536f79f {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Start _get_guest_xml network_info=[{"id": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "address": "fa:16:3e:fb:4a:05", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c8a95e-1a", "ovs_interfaceid": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:04:31 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:04:31 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:04:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-906679252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-906679252',id=19,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9895e43bf76d4760a26a5e64ea6d4e14',ramdisk_id='',reservation_id='r-2dqgtfat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:04:30Z,user_data=None,user_id='c0774aa1e3ee4b69b195b575d116ee96',uuid=b9372825-c75d-45a3-a48c-e111869d97a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "address": "fa:16:3e:fb:4a:05", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c8a95e-1a", "ovs_interfaceid": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converting VIF {"id": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "address": "fa:16:3e:fb:4a:05", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c8a95e-1a", "ovs_interfaceid": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4a:05,bridge_name='br-int',has_traffic_filtering=True,id=94c8a95e-1a3a-435e-9f29-9acee536f79f,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c8a95e-1a') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.objects.instance [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'pci_devices' on Instance uuid b9372825-c75d-45a3-a48c-e111869d97a5 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:04:31 user nova-compute[75021]:   <uuid>b9372825-c75d-45a3-a48c-e111869d97a5</uuid>
Dec 06 07:04:31 user nova-compute[75021]:   <name>instance-00000013</name>
Dec 06 07:04:31 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:04:31 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:04:31 user nova-compute[75021]:   <metadata>
Dec 06 07:04:31 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:04:31 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:04:31 user nova-compute[75021]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-906679252</nova:name>
Dec 06 07:04:31 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:04:31</nova:creationTime>
Dec 06 07:04:31 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:04:31 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:04:31 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:04:31 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:04:31 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:04:31 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:04:31 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:04:31 user nova-compute[75021]:       <nova:owner>
Dec 06 07:04:31 user nova-compute[75021]:         <nova:user uuid="c0774aa1e3ee4b69b195b575d116ee96">tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member</nova:user>
Dec 06 07:04:31 user nova-compute[75021]:         <nova:project uuid="9895e43bf76d4760a26a5e64ea6d4e14">tempest-ServerBootFromVolumeStableRescueTest-1272250883</nova:project>
Dec 06 07:04:31 user nova-compute[75021]:       </nova:owner>
Dec 06 07:04:31 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:04:31 user nova-compute[75021]:       <nova:ports>
Dec 06 07:04:31 user nova-compute[75021]:         <nova:port uuid="94c8a95e-1a3a-435e-9f29-9acee536f79f">
Dec 06 07:04:31 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 07:04:31 user nova-compute[75021]:         </nova:port>
Dec 06 07:04:31 user nova-compute[75021]:       </nova:ports>
Dec 06 07:04:31 user nova-compute[75021]:     </nova:instance>
Dec 06 07:04:31 user nova-compute[75021]:   </metadata>
Dec 06 07:04:31 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:04:31 user nova-compute[75021]:     <system>
Dec 06 07:04:31 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:04:31 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:04:31 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:04:31 user nova-compute[75021]:       <entry name="serial">b9372825-c75d-45a3-a48c-e111869d97a5</entry>
Dec 06 07:04:31 user nova-compute[75021]:       <entry name="uuid">b9372825-c75d-45a3-a48c-e111869d97a5</entry>
Dec 06 07:04:31 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:04:31 user nova-compute[75021]:     </system>
Dec 06 07:04:31 user nova-compute[75021]:   </sysinfo>
Dec 06 07:04:31 user nova-compute[75021]:   <os>
Dec 06 07:04:31 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:04:31 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:04:31 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:04:31 user nova-compute[75021]:   </os>
Dec 06 07:04:31 user nova-compute[75021]:   <features>
Dec 06 07:04:31 user nova-compute[75021]:     <acpi/>
Dec 06 07:04:31 user nova-compute[75021]:     <apic/>
Dec 06 07:04:31 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:04:31 user nova-compute[75021]:   </features>
Dec 06 07:04:31 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:04:31 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:04:31 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:04:31 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:04:31 user nova-compute[75021]:   </clock>
Dec 06 07:04:31 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:04:31 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:04:31 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:04:31 user nova-compute[75021]:   </cpu>
Dec 06 07:04:31 user nova-compute[75021]:   <devices>
Dec 06 07:04:31 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:04:31 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:04:31 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk"/>
Dec 06 07:04:31 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:04:31 user nova-compute[75021]:     </disk>
Dec 06 07:04:31 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:04:31 user nova-compute[75021]:       <mac address="fa:16:3e:fb:4a:05"/>
Dec 06 07:04:31 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:04:31 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:04:31 user nova-compute[75021]:       <target dev="tap94c8a95e-1a"/>
Dec 06 07:04:31 user nova-compute[75021]:     </interface>
Dec 06 07:04:31 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:04:31 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/console.log" append="off"/>
Dec 06 07:04:31 user nova-compute[75021]:     </serial>
Dec 06 07:04:31 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:04:31 user nova-compute[75021]:     <video>
Dec 06 07:04:31 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:04:31 user nova-compute[75021]:     </video>
Dec 06 07:04:31 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:04:31 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:04:31 user nova-compute[75021]:     </rng>
Dec 06 07:04:31 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:04:31 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:04:31 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:04:31 user nova-compute[75021]:     </memballoon>
Dec 06 07:04:31 user nova-compute[75021]:   </devices>
Dec 06 07:04:31 user nova-compute[75021]: </domain>
Dec 06 07:04:31 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:04:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-906679252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-906679252',id=19,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9895e43bf76d4760a26a5e64ea6d4e14',ramdisk_id='',reservation_id='r-2dqgtfat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:04:30Z,user_data=None,user_id='c0774aa1e3ee4b69b195b575d116ee96',uuid=b9372825-c75d-45a3-a48c-e111869d97a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "address": "fa:16:3e:fb:4a:05", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c8a95e-1a", "ovs_interfaceid": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converting VIF {"id": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "address": "fa:16:3e:fb:4a:05", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c8a95e-1a", "ovs_interfaceid": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4a:05,bridge_name='br-int',has_traffic_filtering=True,id=94c8a95e-1a3a-435e-9f29-9acee536f79f,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c8a95e-1a') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG os_vif [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4a:05,bridge_name='br-int',has_traffic_filtering=True,id=94c8a95e-1a3a-435e-9f29-9acee536f79f,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c8a95e-1a') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70640896-03ea-5ac6-907f-d2c4643bce2e', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94c8a95e-1a, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94c8a95e-1a, col_values=(('qos', UUID('37335de7-9ba4-4061-b46e-a90d6de78054')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94c8a95e-1a, col_values=(('external_ids', {'iface-id': '94c8a95e-1a3a-435e-9f29-9acee536f79f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:4a:05', 'vm-uuid': 'b9372825-c75d-45a3-a48c-e111869d97a5'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:31 user nova-compute[75021]: INFO os_vif [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:4a:05,bridge_name='br-int',has_traffic_filtering=True,id=94c8a95e-1a3a-435e-9f29-9acee536f79f,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c8a95e-1a')
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:04:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] No VIF found with MAC fa:16:3e:fb:4a:05, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:04:32 user nova-compute[75021]: DEBUG nova.network.neutron [req-ccbdbe62-4fe6-44b6-b483-96a13fc767b0 req-952353cd-cb62-4661-b5b1-4c8fe8fe12b1 service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Updated VIF entry in instance network info cache for port 94c8a95e-1a3a-435e-9f29-9acee536f79f. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:04:32 user nova-compute[75021]: DEBUG nova.network.neutron [req-ccbdbe62-4fe6-44b6-b483-96a13fc767b0 req-952353cd-cb62-4661-b5b1-4c8fe8fe12b1 service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Updating instance_info_cache with network_info: [{"id": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "address": "fa:16:3e:fb:4a:05", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c8a95e-1a", "ovs_interfaceid": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:04:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ccbdbe62-4fe6-44b6-b483-96a13fc767b0 req-952353cd-cb62-4661-b5b1-4c8fe8fe12b1 service nova] Releasing lock "refresh_cache-b9372825-c75d-45a3-a48c-e111869d97a5" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:04:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:33 user nova-compute[75021]: DEBUG nova.compute.manager [req-61ee2be3-86f8-48b5-943a-f88cfcc1daca req-46a840a3-1f7b-4fa0-b26c-7a1547d6f410 service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Received event network-vif-plugged-94c8a95e-1a3a-435e-9f29-9acee536f79f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:04:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-61ee2be3-86f8-48b5-943a-f88cfcc1daca req-46a840a3-1f7b-4fa0-b26c-7a1547d6f410 service nova] Acquiring lock "b9372825-c75d-45a3-a48c-e111869d97a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-61ee2be3-86f8-48b5-943a-f88cfcc1daca req-46a840a3-1f7b-4fa0-b26c-7a1547d6f410 service nova] Lock "b9372825-c75d-45a3-a48c-e111869d97a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-61ee2be3-86f8-48b5-943a-f88cfcc1daca req-46a840a3-1f7b-4fa0-b26c-7a1547d6f410 service nova] Lock "b9372825-c75d-45a3-a48c-e111869d97a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:33 user nova-compute[75021]: DEBUG nova.compute.manager [req-61ee2be3-86f8-48b5-943a-f88cfcc1daca req-46a840a3-1f7b-4fa0-b26c-7a1547d6f410 service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] No waiting events found dispatching network-vif-plugged-94c8a95e-1a3a-435e-9f29-9acee536f79f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:04:33 user nova-compute[75021]: WARNING nova.compute.manager [req-61ee2be3-86f8-48b5-943a-f88cfcc1daca req-46a840a3-1f7b-4fa0-b26c-7a1547d6f410 service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Received unexpected event network-vif-plugged-94c8a95e-1a3a-435e-9f29-9acee536f79f for instance with vm_state building and task_state spawning.
Dec 06 07:04:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-9453700e-d915-45ba-aed7-488501b95a11 req-210c5acd-b1a7-4689-87e7-517498afe8c3 service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Received event network-vif-plugged-94c8a95e-1a3a-435e-9f29-9acee536f79f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:04:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9453700e-d915-45ba-aed7-488501b95a11 req-210c5acd-b1a7-4689-87e7-517498afe8c3 service nova] Acquiring lock "b9372825-c75d-45a3-a48c-e111869d97a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9453700e-d915-45ba-aed7-488501b95a11 req-210c5acd-b1a7-4689-87e7-517498afe8c3 service nova] Lock "b9372825-c75d-45a3-a48c-e111869d97a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9453700e-d915-45ba-aed7-488501b95a11 req-210c5acd-b1a7-4689-87e7-517498afe8c3 service nova] Lock "b9372825-c75d-45a3-a48c-e111869d97a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-9453700e-d915-45ba-aed7-488501b95a11 req-210c5acd-b1a7-4689-87e7-517498afe8c3 service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] No waiting events found dispatching network-vif-plugged-94c8a95e-1a3a-435e-9f29-9acee536f79f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:04:35 user nova-compute[75021]: WARNING nova.compute.manager [req-9453700e-d915-45ba-aed7-488501b95a11 req-210c5acd-b1a7-4689-87e7-517498afe8c3 service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Received unexpected event network-vif-plugged-94c8a95e-1a3a-435e-9f29-9acee536f79f for instance with vm_state building and task_state spawning.
Dec 06 07:04:35 user nova-compute[75021]: DEBUG nova.compute.manager [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:04:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:04:35 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Instance spawned successfully.
Dec 06 07:04:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:04:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:04:35 user nova-compute[75021]: INFO nova.compute.manager [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Took 6.15 seconds to spawn the instance on the hypervisor.
Dec 06 07:04:35 user nova-compute[75021]: DEBUG nova.compute.manager [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:04:36 user nova-compute[75021]: INFO nova.compute.manager [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Took 7.43 seconds to build instance.
Dec 06 07:04:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-099be350-67d2-443c-9267-dec12753e9bd tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "b9372825-c75d-45a3-a48c-e111869d97a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.564s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:36 user nova-compute[75021]: INFO nova.compute.manager [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Terminating instance
Dec 06 07:04:36 user nova-compute[75021]: DEBUG nova.compute.manager [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:04:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:37 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Instance destroyed successfully.
Dec 06 07:04:37 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lazy-loading 'resources' on Instance uuid 7184c6b7-d34c-425a-ba1d-ddad75231f7e {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-b7e0e593-0040-4602-a9e0-2d1e80e08273 req-dc202732-b119-4e2e-bb04-1c117a467850 service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Received event network-vif-unplugged-6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b7e0e593-0040-4602-a9e0-2d1e80e08273 req-dc202732-b119-4e2e-bb04-1c117a467850 service nova] Acquiring lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b7e0e593-0040-4602-a9e0-2d1e80e08273 req-dc202732-b119-4e2e-bb04-1c117a467850 service nova] Lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b7e0e593-0040-4602-a9e0-2d1e80e08273 req-dc202732-b119-4e2e-bb04-1c117a467850 service nova] Lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-b7e0e593-0040-4602-a9e0-2d1e80e08273 req-dc202732-b119-4e2e-bb04-1c117a467850 service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] No waiting events found dispatching network-vif-unplugged-6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-b7e0e593-0040-4602-a9e0-2d1e80e08273 req-dc202732-b119-4e2e-bb04-1c117a467850 service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Received event network-vif-unplugged-6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-606964116',display_name='tempest-VolumesAdminNegativeTest-server-606964116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-606964116',id=14,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:02:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79e72540b430409b954290965f157c43',ramdisk_id='',reservation_id='r-dyfhrz4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1751614012',owner_user_name='tempest-VolumesAdminNegativeTest-1751614012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:02:45Z,user_data=None,user_id='6b2add3b5bca409e89667f7508b8450f',uuid=7184c6b7-d34c-425a-ba1d-ddad75231f7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "address": "fa:16:3e:d3:01:14", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4bf2b6-a5", "ovs_interfaceid": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Converting VIF {"id": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "address": "fa:16:3e:d3:01:14", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4bf2b6-a5", "ovs_interfaceid": "6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:01:14,bridge_name='br-int',has_traffic_filtering=True,id=6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4,network=Network(1bf2263d-db40-4f7c-bf4f-9839edad2d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4bf2b6-a5') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG os_vif [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:01:14,bridge_name='br-int',has_traffic_filtering=True,id=6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4,network=Network(1bf2263d-db40-4f7c-bf4f-9839edad2d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4bf2b6-a5') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a4bf2b6-a5, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3be4541d-a4d2-469b-89f3-848ce24ebbcd) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:37 user nova-compute[75021]: INFO os_vif [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:01:14,bridge_name='br-int',has_traffic_filtering=True,id=6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4,network=Network(1bf2263d-db40-4f7c-bf4f-9839edad2d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4bf2b6-a5')
Dec 06 07:04:37 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Deleting instance files /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e_del
Dec 06 07:04:37 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Deletion of /opt/stack/data/nova/instances/7184c6b7-d34c-425a-ba1d-ddad75231f7e_del complete
Dec 06 07:04:37 user nova-compute[75021]: INFO nova.compute.manager [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Took 1.01 seconds to destroy the instance on the hypervisor.
Dec 06 07:04:37 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:04:37 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:04:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:38 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:04:38 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Took 0.65 seconds to deallocate network for instance.
Dec 06 07:04:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:38 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:04:38 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:04:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.529s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:39 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Deleted allocations for instance 7184c6b7-d34c-425a-ba1d-ddad75231f7e
Dec 06 07:04:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fa546373-5705-413f-88b3-cc55c8dfca56 tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.460s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-03f2ace2-1fab-4b69-ad1e-3f4a07f73639 req-791bea5a-0e86-4397-8b03-88c02ca18e92 service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Received event network-vif-plugged-6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:04:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-03f2ace2-1fab-4b69-ad1e-3f4a07f73639 req-791bea5a-0e86-4397-8b03-88c02ca18e92 service nova] Acquiring lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-03f2ace2-1fab-4b69-ad1e-3f4a07f73639 req-791bea5a-0e86-4397-8b03-88c02ca18e92 service nova] Lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-03f2ace2-1fab-4b69-ad1e-3f4a07f73639 req-791bea5a-0e86-4397-8b03-88c02ca18e92 service nova] Lock "7184c6b7-d34c-425a-ba1d-ddad75231f7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-03f2ace2-1fab-4b69-ad1e-3f4a07f73639 req-791bea5a-0e86-4397-8b03-88c02ca18e92 service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] No waiting events found dispatching network-vif-plugged-6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:04:39 user nova-compute[75021]: WARNING nova.compute.manager [req-03f2ace2-1fab-4b69-ad1e-3f4a07f73639 req-791bea5a-0e86-4397-8b03-88c02ca18e92 service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Received unexpected event network-vif-plugged-6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 for instance with vm_state deleted and task_state None.
Dec 06 07:04:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-03f2ace2-1fab-4b69-ad1e-3f4a07f73639 req-791bea5a-0e86-4397-8b03-88c02ca18e92 service nova] [instance: 7184c6b7-d34c-425a-ba1d-ddad75231f7e] Received event network-vif-deleted-6a4bf2b6-a557-4c6f-93ef-811b1b23b5d4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:04:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:04:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:04:57 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:04:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:04:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:04:59 user nova-compute[75021]: INFO nova.compute.manager [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Detaching volume 239e00ec-bb8c-4be2-9e22-1cb61ee8b21c
Dec 06 07:04:59 user nova-compute[75021]: INFO nova.virt.block_device [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Attempting to driver detach volume 239e00ec-bb8c-4be2-9e22-1cb61ee8b21c from mountpoint /dev/vdc
Dec 06 07:04:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Attempting to detach device vdc from instance f9275ae0-ccb1-4c73-b639-9cd243c6ff60 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:04:59 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:04:59 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:04:59 user nova-compute[75021]:   <target dev="vdc" bus="virtio"/>
Dec 06 07:04:59 user nova-compute[75021]:   <serial>239e00ec-bb8c-4be2-9e22-1cb61ee8b21c</serial>
Dec 06 07:04:59 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 07:04:59 user nova-compute[75021]: </disk>
Dec 06 07:04:59 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:04:59 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Successfully detached device vdc from instance f9275ae0-ccb1-4c73-b639-9cd243c6ff60 from the persistent domain config.
Dec 06 07:04:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f9275ae0-ccb1-4c73-b639-9cd243c6ff60 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:04:59 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:04:59 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:04:59 user nova-compute[75021]:   <target dev="vdc" bus="virtio"/>
Dec 06 07:04:59 user nova-compute[75021]:   <serial>239e00ec-bb8c-4be2-9e22-1cb61ee8b21c</serial>
Dec 06 07:04:59 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 07:04:59 user nova-compute[75021]: </disk>
Dec 06 07:04:59 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f9275ae0-ccb1-4c73-b639-9cd243c6ff60 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:04:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:05:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:02 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:05:02 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:05:02 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7132MB free_disk=25.470172882080078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:05:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Applying migration context for instance 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf as it has an incoming, in-progress migration 99ebc416-4861-41d1-a463-6c587341ecbd. Migration status is finished {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 06 07:05:03 user nova-compute[75021]: INFO nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updating resource usage from migration 99ebc416-4861-41d1-a463-6c587341ecbd
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance f9275ae0-ccb1-4c73-b639-9cd243c6ff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5c50a6a8-2500-4408-a932-48f0116713b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Migration 99ebc416-4861-41d1-a463-6c587341ecbd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 68ca3b31-7de1-4522-a093-a5eb69274c0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.642s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] There are 0 instances to clean {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 07:05:03 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:05:04 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:05:04 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:05:04 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:05:04 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:05:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:05:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:05:04 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:05:04 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid 4ffc6429-3f3c-4a7e-98e5-0db984266eae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Updating instance_info_cache with network_info: [{"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 4ffc6429-3f3c-4a7e-98e5-0db984266eae {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid a613e2d6-d3f6-4729-aef7-24714608acc9 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid cd198206-4476-4b87-8399-dd5cb38fd3b1 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 68ca3b31-7de1-4522-a093-a5eb69274c0b {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid b9372825-c75d-45a3-a48c-e111869d97a5 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid f9275ae0-ccb1-4c73-b639-9cd243c6ff60 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "cd198206-4476-4b87-8399-dd5cb38fd3b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "68ca3b31-7de1-4522-a093-a5eb69274c0b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "b9372825-c75d-45a3-a48c-e111869d97a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "b9372825-c75d-45a3-a48c-e111869d97a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "b9372825-c75d-45a3-a48c-e111869d97a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.132s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-ae312753-66ad-4bee-b678-9e4c07f4000f req-f380d119-944f-463e-ba91-07d2cc372744 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Received event network-changed-7e699ac5-b079-428e-9728-ce1b30ed4feb {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-ae312753-66ad-4bee-b678-9e4c07f4000f req-f380d119-944f-463e-ba91-07d2cc372744 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Refreshing instance network info cache due to event network-changed-7e699ac5-b079-428e-9728-ce1b30ed4feb. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ae312753-66ad-4bee-b678-9e4c07f4000f req-f380d119-944f-463e-ba91-07d2cc372744 service nova] Acquiring lock "refresh_cache-5c50a6a8-2500-4408-a932-48f0116713b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ae312753-66ad-4bee-b678-9e4c07f4000f req-f380d119-944f-463e-ba91-07d2cc372744 service nova] Acquired lock "refresh_cache-5c50a6a8-2500-4408-a932-48f0116713b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:05:05 user nova-compute[75021]: DEBUG nova.network.neutron [req-ae312753-66ad-4bee-b678-9e4c07f4000f req-f380d119-944f-463e-ba91-07d2cc372744 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Refreshing network info cache for port 7e699ac5-b079-428e-9728-ce1b30ed4feb {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:05:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:05:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:05:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75021) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 07:05:06 user nova-compute[75021]: DEBUG nova.network.neutron [req-ae312753-66ad-4bee-b678-9e4c07f4000f req-f380d119-944f-463e-ba91-07d2cc372744 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Updated VIF entry in instance network info cache for port 7e699ac5-b079-428e-9728-ce1b30ed4feb. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:05:06 user nova-compute[75021]: DEBUG nova.network.neutron [req-ae312753-66ad-4bee-b678-9e4c07f4000f req-f380d119-944f-463e-ba91-07d2cc372744 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Updating instance_info_cache with network_info: [{"id": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "address": "fa:16:3e:f3:41:7d", "network": {"id": "6838b696-43bf-4794-ae4c-82828037f5cf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1983647302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ce66a727943c7a4e1cf96225c9ff1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e699ac5-b0", "ovs_interfaceid": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:05:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ae312753-66ad-4bee-b678-9e4c07f4000f req-f380d119-944f-463e-ba91-07d2cc372744 service nova] Releasing lock "refresh_cache-5c50a6a8-2500-4408-a932-48f0116713b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:05:07 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:05:07 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Port f48c57d0-3024-4f70-8989-454717799fe3 binding to destination host user is already ACTIVE {{(pid=75021) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 06 07:05:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:05:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquired lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:05:07 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:05:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updating instance_info_cache with network_info: [{"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Releasing lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Creating tmpfile /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/tmpjtu6l651 to verify with other compute node that the instance is on the same shared storage. {{(pid=75021) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9630}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:08 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Instance destroyed successfully.
Dec 06 07:05:08 user nova-compute[75021]: DEBUG nova.objects.instance [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lazy-loading 'resources' on Instance uuid 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-272299805',display_name='tempest-ServerActionsTestOtherB-server-272299805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-272299805',id=4,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDr10Uf7mSfaKxaWiZMlOkgp+3gz+zk9cuGM2WOwPxRQl0KGDW8m0MH0trEdCAhYZHvExMqqK1A+1XoEwjfDbN1X4V66K4XOiRtH4zqe8KgY/USo0EOIRMWD8nLuB034BA==',key_name='tempest-keypair-2107162455',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:03:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0482e21a6db45199f3c82f7f5913ec1',ramdisk_id='',reservation_id='r-lhdcj864',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1150715110',owner_user_name='tempest-ServerActionsTestOtherB-1150715110-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9273703a77bf425685228a99248f6d4e',uuid=2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converting VIF {"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG os_vif [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf48c57d0-30, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e46f799c-2908-4b87-90d0-1c74e85f6c9a) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:08 user nova-compute[75021]: INFO os_vif [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30')
Dec 06 07:05:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvehRiEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:05:08 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:05:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ad7bf3-8835-4450-bcf3-2de294c3052a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:05:08 user nova-compute[75021]: No targets found.
Dec 06 07:05:08 user nova-compute[75021]: iSNS:
Dec 06 07:05:08 user nova-compute[75021]: No targets found.
Dec 06 07:05:08 user nova-compute[75021]: STATIC:
Dec 06 07:05:08 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635
Dec 06 07:05:08 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:05:08 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:05:08 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c
Dec 06 07:05:08 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:05:08 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:05:08 user nova-compute[75021]: FIRMWARE:
Dec 06 07:05:08 user nova-compute[75021]: No targets found.
Dec 06 07:05:08 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:05:08 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:05:08 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[09454ebb-0c8d-40ea-b6fe-f6f28dc643ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3827bf03-19b2-4337-9fac-76f462eb6124]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)
Dec 06 07:05:09 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:05:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)
Dec 06 07:05:09 user nova-compute[75021]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:05:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89fc18a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635'): ({'sdc'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Removing single pathed devices sdc {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[684f1035-e1be-431e-b80e-c3e902b0ac4f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[070a96be-70ce-4bfb-aedc-035151cfa731]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Flushing IO for device /dev/sdc {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9d0e1b-100d-4cb7-8cbc-a13683eeaef3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e644605-b498-4ee1-a4ad-87dad12ae35e]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93d90f8-fd5a-4461-92e0-4a776eac088f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[396a8d9b-e3d5-40a9-b1dd-3016f84dd882]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260]
Dec 06 07:05:09 user nova-compute[75021]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260] successful.
Dec 06 07:05:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[71359eb9-637f-4464-9690-938b818dbe26]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] <== disconnect_volume: return (328ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lazy-loading 'flavor' on Instance uuid 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:09 user nova-compute[75021]: INFO nova.compute.manager [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Attaching volume 622ec1e7-06db-4745-ae36-707f409950e3 to /dev/vdb
Dec 06 07:05:09 user nova-compute[75021]: DEBUG os_brick.utils [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:05:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9cd610-c34f-41cc-9b71-48ea12bd1751]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[436e3a0a-6982-4010-a3dc-43c35b6cff56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3231f07f-7ad7-4aec-a2b8-94a5036cb8a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c9217e-5778-4a7f-8640-469242de6eea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:05:10 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fa5c50-83d4-450f-9bcd-1dc22fe4583d]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG os_brick.utils [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Updating existing volume attachment record: 566cd4ef-560c-4383-8751-958469240b4b {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-7e7a1090-8be7-4559-8a64-a2c4ca23a3a5 req-28b21253-8107-406d-8f87-4b21ef775be6 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-vif-unplugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7e7a1090-8be7-4559-8a64-a2c4ca23a3a5 req-28b21253-8107-406d-8f87-4b21ef775be6 service nova] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7e7a1090-8be7-4559-8a64-a2c4ca23a3a5 req-28b21253-8107-406d-8f87-4b21ef775be6 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7e7a1090-8be7-4559-8a64-a2c4ca23a3a5 req-28b21253-8107-406d-8f87-4b21ef775be6 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-7e7a1090-8be7-4559-8a64-a2c4ca23a3a5 req-28b21253-8107-406d-8f87-4b21ef775be6 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] No waiting events found dispatching network-vif-unplugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:10 user nova-compute[75021]: WARNING nova.compute.manager [req-7e7a1090-8be7-4559-8a64-a2c4ca23a3a5 req-28b21253-8107-406d-8f87-4b21ef775be6 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received unexpected event network-vif-unplugged-f48c57d0-3024-4f70-8989-454717799fe3 for instance with vm_state resized and task_state resize_reverting.
Dec 06 07:05:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-89c46197-c268-45f1-86bf-f1f78ebde376 req-8edc174d-4cc1-43f3-8a50-68f427d7b94c service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-89c46197-c268-45f1-86bf-f1f78ebde376 req-8edc174d-4cc1-43f3-8a50-68f427d7b94c service nova] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-89c46197-c268-45f1-86bf-f1f78ebde376 req-8edc174d-4cc1-43f3-8a50-68f427d7b94c service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-89c46197-c268-45f1-86bf-f1f78ebde376 req-8edc174d-4cc1-43f3-8a50-68f427d7b94c service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-89c46197-c268-45f1-86bf-f1f78ebde376 req-8edc174d-4cc1-43f3-8a50-68f427d7b94c service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] No waiting events found dispatching network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:12 user nova-compute[75021]: WARNING nova.compute.manager [req-89c46197-c268-45f1-86bf-f1f78ebde376 req-8edc174d-4cc1-43f3-8a50-68f427d7b94c service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received unexpected event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 for instance with vm_state resized and task_state resize_reverting.
Dec 06 07:05:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:13 user nova-compute[75021]: DEBUG nova.objects.instance [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lazy-loading 'migration_context' on Instance uuid 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:05:13 user nova-compute[75021]: DEBUG nova.objects.base [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Object Instance<2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf> lazy-loaded attributes: resources,migration_context {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:05:13 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Refreshing inventories for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 07:05:13 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Updating ProviderTree inventory for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 07:05:13 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Updating inventory in ProviderTree for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 07:05:13 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Refreshing aggregate associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, aggregates: None {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 07:05:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:13 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Refreshing trait associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, traits: HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 07:05:14 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:05:14 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:05:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.673s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:14 user nova-compute[75021]: INFO nova.compute.manager [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Swapping old allocation on dict_keys(['33dec8e2-b735-4a70-a668-4c31a23cece2']) held by migration 99ebc416-4861-41d1-a463-6c587341ecbd for instance
Dec 06 07:05:14 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Overwriting current allocation {'allocations': {'33dec8e2-b735-4a70-a668-4c31a23cece2': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 24}}, 'project_id': 'd0482e21a6db45199f3c82f7f5913ec1', 'user_id': '9273703a77bf425685228a99248f6d4e', 'consumer_generation': 1} on consumer 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf {{(pid=75021) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Dec 06 07:05:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:05:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquired lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:05:14 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updating instance_info_cache with network_info: [{"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Releasing lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG os_brick.utils [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25715d7-24fc-4326-8d97-9ca8e76e5a09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4de2130-2dec-40d6-a4b4-bf21d84a0991]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d290db54-8f3f-45ec-ac2f-8f8fb876598e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c09ad41-b398-408a-8ea8-a1cdb0c3784d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:05:15 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:05:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c9643d-2502-4ca2-b335-54bd1915817d]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG os_brick.utils [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:05:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:19 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f9275ae0-ccb1-4c73-b639-9cd243c6ff60 is timed out.
Dec 06 07:05:19 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Successfully detached device vdc from instance f9275ae0-ccb1-4c73-b639-9cd243c6ff60 from the live domain config.
Dec 06 07:05:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztumyJnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:05:19 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:05:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6e7b13-d0d0-49d5-8a54-d9de8a41a724]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:05:19 user nova-compute[75021]: No targets found.
Dec 06 07:05:19 user nova-compute[75021]: iSNS:
Dec 06 07:05:19 user nova-compute[75021]: No targets found.
Dec 06 07:05:19 user nova-compute[75021]: STATIC:
Dec 06 07:05:19 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c
Dec 06 07:05:19 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:05:19 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:05:19 user nova-compute[75021]: FIRMWARE:
Dec 06 07:05:19 user nova-compute[75021]: No targets found.
Dec 06 07:05:19 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:05:19 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:05:19 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[facaaf0f-42e5-49d0-9005-a4975c12dbf9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54a0ea0-6b08-4fa9-9ea5-4e9fd5be909a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)
Dec 06 07:05:19 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c (non-flash)
Dec 06 07:05:19 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d82de050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f156359c-3486-42e9-ab89-84dfa72ff082]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[17220684-cb98-447d-baaa-e41fb8ef5902]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b345310-ba86-4d05-90cc-a3520444a509]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:05:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d939c97-69d9-479d-a490-6a356e2b9a59]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecb743d-8d2f-4f35-8fe5-01432efc5b9c]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f3733f-b70b-456c-9fdb-5b0ddf281f2c]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c, portal: 172.16.0.220,3260]
Dec 06 07:05:20 user nova-compute[75021]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c, portal: 172.16.0.220,3260] successful.
Dec 06 07:05:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:239e00ec-bb8c-4be2-9e22-1cb61ee8b21c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[275394d3-91ff-45ad-8573-043c174bbbc5]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] <== disconnect_volume: return (314ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hqofkJEW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:05:20 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:05:20 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:05:20 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9318eb-7ffe-4d75-91e2-a61cc2cb7945]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:05:20 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12d9d84-6f65-419b-b737-f2b894ce1224]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3] added
Dec 06 07:05:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b3bb3b-f947-4623-b01f-5ec04fd946ff]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4b7c2f-4020-44cf-bcd1-08fc480fd771]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hqofkJEW {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hqofkJEW" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c629126-52d4-43d2-87df-db1af31ef528]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hqofkJEW'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7df8f1-fa0c-4b9f-af41-71c8f4a22fc3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[682c09f7-9045-430f-9f9b-b361c161828f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:05:20 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:05:20 user nova-compute[75021]:  {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:05:20 user nova-compute[75021]: WARNING os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 07:05:20 user nova-compute[75021]: 
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a041040-2aa9-41c4-b84b-66001f70f30a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3, portal: 172.16.0.220,3260]
Dec 06 07:05:20 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3, portal: 172.16.0.220,3260] successful.
Dec 06 07:05:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6744512-552f-4d19-8971-15580c0d48bd]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4b3fd7-f2c2-480f-8440-718b2ca13690]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 (non-flash)
Dec 06 07:05:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 (non-flash)
Dec 06 07:05:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[183e5382-0f7c-4e96-a40d-9e99edccb7cd]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hqofkJEW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:05:20 user nova-compute[75021]: DEBUG nova.objects.instance [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'flavor' on Instance uuid f9275ae0-ccb1-4c73-b639-9cd243c6ff60 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:05:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-09fff71c-e97b-4a14-89c8-8455e9cc9930 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.781s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.432s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:05:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26464383735393365', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:05:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464383735393365', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:05:21 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lazy-loading 'flavor' on Instance uuid 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:05:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:05:21 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:05:21 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:05:21 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:05:21 user nova-compute[75021]:   <serial>622ec1e7-06db-4745-ae36-707f409950e3</serial>
Dec 06 07:05:21 user nova-compute[75021]: </disk>
Dec 06 07:05:21 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:05:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:05:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:05:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] No VIF found with MAC fa:16:3e:f3:41:7d, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:05:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b301ef06-b575-47ac-8ffb-05ff0e8fbfe8 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.614s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG nova.compute.manager [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:05:23 user nova-compute[75021]: INFO nova.compute.claims [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Claim successful on node user
Dec 06 07:05:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-c2f69a0f-8753-4557-a677-eece5cc55a69 req-fc0aaca2-a512-4a39-b9e0-d5038b6d1f27 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Received event network-changed-1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-c2f69a0f-8753-4557-a677-eece5cc55a69 req-fc0aaca2-a512-4a39-b9e0-d5038b6d1f27 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Refreshing instance network info cache due to event network-changed-1f43de0b-bfae-4359-9a48-56a43f5dbdbf. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c2f69a0f-8753-4557-a677-eece5cc55a69 req-fc0aaca2-a512-4a39-b9e0-d5038b6d1f27 service nova] Acquiring lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c2f69a0f-8753-4557-a677-eece5cc55a69 req-fc0aaca2-a512-4a39-b9e0-d5038b6d1f27 service nova] Acquired lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG nova.network.neutron [req-c2f69a0f-8753-4557-a677-eece5cc55a69 req-fc0aaca2-a512-4a39-b9e0-d5038b6d1f27 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Refreshing network info cache for port 1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG nova.compute.manager [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG nova.compute.manager [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG nova.network.neutron [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:05:23 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:05:23 user nova-compute[75021]: DEBUG nova.compute.manager [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:23 user nova-compute[75021]: DEBUG nova.policy [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24f231f563c345b48a998200dbf1384a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e36b4acada439db308e5e816dbf9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:05:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:05:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:05:24 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Creating image(s)
Dec 06 07:05:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "/opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "/opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "/opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf.part --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:24 user nova-compute[75021]: DEBUG nova.virt.images [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] 53dd9568-7f3d-4c0f-a801-063320e5c6f8 was qcow2, converting to raw {{(pid=75021) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 07:05:24 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 07:05:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf.part /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf.converted {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:24 user nova-compute[75021]: DEBUG nova.network.neutron [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Successfully created port: c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:05:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf.part /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf.converted" returned: 0 in 0.228s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf.converted --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.076s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG nova.network.neutron [req-c2f69a0f-8753-4557-a677-eece5cc55a69 req-fc0aaca2-a512-4a39-b9e0-d5038b6d1f27 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Updated VIF entry in instance network info cache for port 1f43de0b-bfae-4359-9a48-56a43f5dbdbf. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG nova.network.neutron [req-c2f69a0f-8753-4557-a677-eece5cc55a69 req-fc0aaca2-a512-4a39-b9e0-d5038b6d1f27 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Updating instance_info_cache with network_info: [{"id": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "address": "fa:16:3e:b7:f2:e4", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f43de0b-bf", "ovs_interfaceid": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c2f69a0f-8753-4557-a677-eece5cc55a69 req-fc0aaca2-a512-4a39-b9e0-d5038b6d1f27 service nova] Releasing lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf --force-share --output=json" returned: 0 in 0.208s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf,backing_fmt=raw /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf,backing_fmt=raw /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk 1073741824" returned: 0 in 0.048s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG nova.network.neutron [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Successfully updated port: c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquired lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG nova.network.neutron [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-41dcc6ac-1eec-4d03-8a50-b45a98773a20 req-a678fc75-2151-4c84-ba1f-924971bf362b service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received event network-changed-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-41dcc6ac-1eec-4d03-8a50-b45a98773a20 req-a678fc75-2151-4c84-ba1f-924971bf362b service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Refreshing instance network info cache due to event network-changed-c77514ad-438b-4d06-8f57-a363cde54e16. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-41dcc6ac-1eec-4d03-8a50-b45a98773a20 req-a678fc75-2151-4c84-ba1f-924971bf362b service nova] Acquiring lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG nova.network.neutron [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Cannot resize image /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Ensure instance console log exists: /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.network.neutron [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Updating instance_info_cache with network_info: [{"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Releasing lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.compute.manager [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Instance network_info: |[{"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-41dcc6ac-1eec-4d03-8a50-b45a98773a20 req-a678fc75-2151-4c84-ba1f-924971bf362b service nova] Acquired lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.network.neutron [req-41dcc6ac-1eec-4d03-8a50-b45a98773a20 req-a678fc75-2151-4c84-ba1f-924971bf362b service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Refreshing network info cache for port c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Start _get_guest_xml network_info=[{"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T07:05:20Z,direct_url=<?>,disk_format='qcow2',id=53dd9568-7f3d-4c0f-a801-063320e5c6f8,min_disk=0,min_ram=0,name='tempest-scenario-img--1670605303',owner='78e36b4acada439db308e5e816dbf9a7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T07:05:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': '53dd9568-7f3d-4c0f-a801-063320e5c6f8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Starting finish_revert_migration {{(pid=75021) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11822}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Start _get_guest_xml network_info=[{"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b0f33803-ea46-4534-8588-2801c218db3f', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvehRiEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf', 'attached_at': '2023-12-06T07:05:26.000000', 'detached_at': '', 'volume_id': '7ccdd51d-7737-4a34-b5ab-e986a8a87635', 'serial': '7ccdd51d-7737-4a34-b5ab-e986a8a87635'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:05:26 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:05:26 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:05:26 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:05:26 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T07:05:20Z,direct_url=<?>,disk_format='qcow2',id=53dd9568-7f3d-4c0f-a801-063320e5c6f8,min_disk=0,min_ram=0,name='tempest-scenario-img--1670605303',owner='78e36b4acada439db308e5e816dbf9a7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T07:05:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-53112281',display_name='tempest-TestMinimumBasicScenario-server-53112281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-53112281',id=20,image_ref='53dd9568-7f3d-4c0f-a801-063320e5c6f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuSxZ13dd2/D7B877ZWXS1jgKRAmPhYOOiZJqhiReoBkb0kLSmdhOf4HykOJNldZ0vI0Uy/O1Rx4zDUeAdlHthJ4IX17YF8zgnD4tXiI5C/mOzfszeWX675LXbee/bjNA==',key_name='tempest-TestMinimumBasicScenario-1870415575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78e36b4acada439db308e5e816dbf9a7',ramdisk_id='',reservation_id='r-59xfjdud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53dd9568-7f3d-4c0f-a801-063320e5c6f8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-757290889',owner_user_name='tempest-TestMinimumBasicScenario-757290889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:05:24Z,user_data=None,user_id='24f231f563c345b48a998200dbf1384a',uuid=42b43ca7-a0fb-4811-b91b-2ecce2b7fb02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converting VIF {"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ee:82,bridge_name='br-int',has_traffic_filtering=True,id=c77514ad-438b-4d06-8f57-a363cde54e16,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77514ad-43') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.objects.instance [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lazy-loading 'pci_devices' on Instance uuid 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.objects.instance [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:05:26 user nova-compute[75021]:   <uuid>42b43ca7-a0fb-4811-b91b-2ecce2b7fb02</uuid>
Dec 06 07:05:26 user nova-compute[75021]:   <name>instance-00000014</name>
Dec 06 07:05:26 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:05:26 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:05:26 user nova-compute[75021]:   <metadata>
Dec 06 07:05:26 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:05:26 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:05:26 user nova-compute[75021]:       <nova:name>tempest-TestMinimumBasicScenario-server-53112281</nova:name>
Dec 06 07:05:26 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:05:26</nova:creationTime>
Dec 06 07:05:26 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:05:26 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:05:26 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:05:26 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:05:26 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:05:26 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:05:26 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:05:26 user nova-compute[75021]:       <nova:owner>
Dec 06 07:05:26 user nova-compute[75021]:         <nova:user uuid="24f231f563c345b48a998200dbf1384a">tempest-TestMinimumBasicScenario-757290889-project-member</nova:user>
Dec 06 07:05:26 user nova-compute[75021]:         <nova:project uuid="78e36b4acada439db308e5e816dbf9a7">tempest-TestMinimumBasicScenario-757290889</nova:project>
Dec 06 07:05:26 user nova-compute[75021]:       </nova:owner>
Dec 06 07:05:26 user nova-compute[75021]:       <nova:root type="image" uuid="53dd9568-7f3d-4c0f-a801-063320e5c6f8"/>
Dec 06 07:05:26 user nova-compute[75021]:       <nova:ports>
Dec 06 07:05:26 user nova-compute[75021]:         <nova:port uuid="c77514ad-438b-4d06-8f57-a363cde54e16">
Dec 06 07:05:26 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 07:05:26 user nova-compute[75021]:         </nova:port>
Dec 06 07:05:26 user nova-compute[75021]:       </nova:ports>
Dec 06 07:05:26 user nova-compute[75021]:     </nova:instance>
Dec 06 07:05:26 user nova-compute[75021]:   </metadata>
Dec 06 07:05:26 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:05:26 user nova-compute[75021]:     <system>
Dec 06 07:05:26 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:05:26 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:05:26 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:05:26 user nova-compute[75021]:       <entry name="serial">42b43ca7-a0fb-4811-b91b-2ecce2b7fb02</entry>
Dec 06 07:05:26 user nova-compute[75021]:       <entry name="uuid">42b43ca7-a0fb-4811-b91b-2ecce2b7fb02</entry>
Dec 06 07:05:26 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:05:26 user nova-compute[75021]:     </system>
Dec 06 07:05:26 user nova-compute[75021]:   </sysinfo>
Dec 06 07:05:26 user nova-compute[75021]:   <os>
Dec 06 07:05:26 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:05:26 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:05:26 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:05:26 user nova-compute[75021]:   </os>
Dec 06 07:05:26 user nova-compute[75021]:   <features>
Dec 06 07:05:26 user nova-compute[75021]:     <acpi/>
Dec 06 07:05:26 user nova-compute[75021]:     <apic/>
Dec 06 07:05:26 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:05:26 user nova-compute[75021]:   </features>
Dec 06 07:05:26 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:05:26 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:05:26 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:05:26 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:05:26 user nova-compute[75021]:   </clock>
Dec 06 07:05:26 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:05:26 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:05:26 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:05:26 user nova-compute[75021]:   </cpu>
Dec 06 07:05:26 user nova-compute[75021]:   <devices>
Dec 06 07:05:26 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:05:26 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:05:26 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk"/>
Dec 06 07:05:26 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:05:26 user nova-compute[75021]:     </disk>
Dec 06 07:05:26 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:05:26 user nova-compute[75021]:       <mac address="fa:16:3e:83:ee:82"/>
Dec 06 07:05:26 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:05:26 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:05:26 user nova-compute[75021]:       <target dev="tapc77514ad-43"/>
Dec 06 07:05:26 user nova-compute[75021]:     </interface>
Dec 06 07:05:26 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:05:26 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/console.log" append="off"/>
Dec 06 07:05:26 user nova-compute[75021]:     </serial>
Dec 06 07:05:26 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:05:26 user nova-compute[75021]:     <video>
Dec 06 07:05:26 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:05:26 user nova-compute[75021]:     </video>
Dec 06 07:05:26 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:05:26 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:05:26 user nova-compute[75021]:     </rng>
Dec 06 07:05:26 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:05:26 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:05:26 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:05:26 user nova-compute[75021]:     </memballoon>
Dec 06 07:05:26 user nova-compute[75021]:   </devices>
Dec 06 07:05:26 user nova-compute[75021]: </domain>
Dec 06 07:05:26 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-53112281',display_name='tempest-TestMinimumBasicScenario-server-53112281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-53112281',id=20,image_ref='53dd9568-7f3d-4c0f-a801-063320e5c6f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuSxZ13dd2/D7B877ZWXS1jgKRAmPhYOOiZJqhiReoBkb0kLSmdhOf4HykOJNldZ0vI0Uy/O1Rx4zDUeAdlHthJ4IX17YF8zgnD4tXiI5C/mOzfszeWX675LXbee/bjNA==',key_name='tempest-TestMinimumBasicScenario-1870415575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78e36b4acada439db308e5e816dbf9a7',ramdisk_id='',reservation_id='r-59xfjdud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53dd9568-7f3d-4c0f-a801-063320e5c6f8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-757290889',owner_user_name='tempest-TestMinimumBasicScenario-757290889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:05:24Z,user_data=None,user_id='24f231f563c345b48a998200dbf1384a',uuid=42b43ca7-a0fb-4811-b91b-2ecce2b7fb02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converting VIF {"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ee:82,bridge_name='br-int',has_traffic_filtering=True,id=c77514ad-438b-4d06-8f57-a363cde54e16,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77514ad-43') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_vif [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ee:82,bridge_name='br-int',has_traffic_filtering=True,id=c77514ad-438b-4d06-8f57-a363cde54e16,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77514ad-43') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cc56f85-c239-5c57-8dec-ba67e8c80750', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvehRiEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:05:26 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:05:26 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:05:26 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:05:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc77514ad-43, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc77514ad-43, col_values=(('qos', UUID('ccde2534-8306-4452-8aee-1f4ab3fd147a')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc77514ad-43, col_values=(('external_ids', {'iface-id': 'c77514ad-438b-4d06-8f57-a363cde54e16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:ee:82', 'vm-uuid': '42b43ca7-a0fb-4811-b91b-2ecce2b7fb02'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6289db7-769e-424e-a25a-ee76ea8674b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:05:26 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:26 user nova-compute[75021]: INFO os_vif [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ee:82,bridge_name='br-int',has_traffic_filtering=True,id=c77514ad-438b-4d06-8f57-a363cde54e16,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77514ad-43')
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d72db90-1f66-4f6a-ac2f-36c3f3c14e9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635] added
Dec 06 07:05:26 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f6c4ff-de25-47e1-b3f0-937592a376bf]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] No VIF found with MAC fa:16:3e:83:ee:82, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[273fc2f9-8f11-4218-9610-232e75eeb5e8]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvehRiEa {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvehRiEa" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fab164f-111c-4d50-bcc8-53ea5dcbac53]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvehRiEa'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95c8cb1-130e-4598-a6d6-149db4a3304e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[519b9122-afc7-42c1-9664-0a5bd46ca3f0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 (non-flash)
Dec 06 07:05:26 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 (non-flash)
Dec 06 07:05:26 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff57d97-7573-4e0a-a59a-c400d4d09410]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260]
Dec 06 07:05:26 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260] successful.
Dec 06 07:05:26 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda4c155-d8d6-44ce-a9f7-300f39e2a077]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd04ce2-1861-4645-8759-305974cf151d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 (non-flash)
Dec 06 07:05:26 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:05:26 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 (non-flash)
Dec 06 07:05:26 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:05:26 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.network.neutron [req-41dcc6ac-1eec-4d03-8a50-b45a98773a20 req-a678fc75-2151-4c84-ba1f-924971bf362b service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Updated VIF entry in instance network info cache for port c77514ad-438b-4d06-8f57-a363cde54e16. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG nova.network.neutron [req-41dcc6ac-1eec-4d03-8a50-b45a98773a20 req-a678fc75-2151-4c84-ba1f-924971bf362b service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Updating instance_info_cache with network_info: [{"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1fde91-a741-4e59-b0c4-036212e6d428]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvehRiEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-41dcc6ac-1eec-4d03-8a50-b45a98773a20 req-a678fc75-2151-4c84-ba1f-924971bf362b service nova] Releasing lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:05:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23233613435323961', 'path': '/dev/sdc'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233613435323961', 'path': '/dev/sdc'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-272299805',display_name='tempest-ServerActionsTestOtherB-server-272299805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-272299805',id=4,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDr10Uf7mSfaKxaWiZMlOkgp+3gz+zk9cuGM2WOwPxRQl0KGDW8m0MH0trEdCAhYZHvExMqqK1A+1XoEwjfDbN1X4V66K4XOiRtH4zqe8KgY/USo0EOIRMWD8nLuB034BA==',key_name='tempest-keypair-2107162455',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:03:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d0482e21a6db45199f3c82f7f5913ec1',ramdisk_id='',reservation_id='r-lhdcj864',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1150715110',owner_user_name='tempest-ServerActionsTestOtherB-1150715110-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9273703a77bf425685228a99248f6d4e',uuid=2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converting VIF {"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:05:28 user nova-compute[75021]:   <uuid>2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf</uuid>
Dec 06 07:05:28 user nova-compute[75021]:   <name>instance-00000004</name>
Dec 06 07:05:28 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:05:28 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:05:28 user nova-compute[75021]:   <metadata>
Dec 06 07:05:28 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:05:28 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:05:28 user nova-compute[75021]:       <nova:name>tempest-ServerActionsTestOtherB-server-272299805</nova:name>
Dec 06 07:05:28 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:05:26</nova:creationTime>
Dec 06 07:05:28 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:05:28 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:05:28 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:05:28 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:05:28 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:05:28 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:05:28 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:05:28 user nova-compute[75021]:       <nova:owner>
Dec 06 07:05:28 user nova-compute[75021]:         <nova:user uuid="9273703a77bf425685228a99248f6d4e">tempest-ServerActionsTestOtherB-1150715110-project-member</nova:user>
Dec 06 07:05:28 user nova-compute[75021]:         <nova:project uuid="d0482e21a6db45199f3c82f7f5913ec1">tempest-ServerActionsTestOtherB-1150715110</nova:project>
Dec 06 07:05:28 user nova-compute[75021]:       </nova:owner>
Dec 06 07:05:28 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:05:28 user nova-compute[75021]:       <nova:ports>
Dec 06 07:05:28 user nova-compute[75021]:         <nova:port uuid="f48c57d0-3024-4f70-8989-454717799fe3">
Dec 06 07:05:28 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 07:05:28 user nova-compute[75021]:         </nova:port>
Dec 06 07:05:28 user nova-compute[75021]:       </nova:ports>
Dec 06 07:05:28 user nova-compute[75021]:     </nova:instance>
Dec 06 07:05:28 user nova-compute[75021]:   </metadata>
Dec 06 07:05:28 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:05:28 user nova-compute[75021]:     <system>
Dec 06 07:05:28 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:05:28 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:05:28 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:05:28 user nova-compute[75021]:       <entry name="serial">2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf</entry>
Dec 06 07:05:28 user nova-compute[75021]:       <entry name="uuid">2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf</entry>
Dec 06 07:05:28 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:05:28 user nova-compute[75021]:     </system>
Dec 06 07:05:28 user nova-compute[75021]:   </sysinfo>
Dec 06 07:05:28 user nova-compute[75021]:   <os>
Dec 06 07:05:28 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:05:28 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:05:28 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:05:28 user nova-compute[75021]:   </os>
Dec 06 07:05:28 user nova-compute[75021]:   <features>
Dec 06 07:05:28 user nova-compute[75021]:     <acpi/>
Dec 06 07:05:28 user nova-compute[75021]:     <apic/>
Dec 06 07:05:28 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:05:28 user nova-compute[75021]:   </features>
Dec 06 07:05:28 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:05:28 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:05:28 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:05:28 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:05:28 user nova-compute[75021]:   </clock>
Dec 06 07:05:28 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:05:28 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:05:28 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:05:28 user nova-compute[75021]:   </cpu>
Dec 06 07:05:28 user nova-compute[75021]:   <devices>
Dec 06 07:05:28 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:05:28 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:05:28 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk"/>
Dec 06 07:05:28 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:05:28 user nova-compute[75021]:     </disk>
Dec 06 07:05:28 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:05:28 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:05:28 user nova-compute[75021]:       <source dev="/dev/sdc"/>
Dec 06 07:05:28 user nova-compute[75021]:       <target dev="vdb" bus="virtio"/>
Dec 06 07:05:28 user nova-compute[75021]:       <serial>7ccdd51d-7737-4a34-b5ab-e986a8a87635</serial>
Dec 06 07:05:28 user nova-compute[75021]:     </disk>
Dec 06 07:05:28 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:05:28 user nova-compute[75021]:       <mac address="fa:16:3e:43:60:12"/>
Dec 06 07:05:28 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:05:28 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:05:28 user nova-compute[75021]:       <target dev="tapf48c57d0-30"/>
Dec 06 07:05:28 user nova-compute[75021]:     </interface>
Dec 06 07:05:28 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:05:28 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/console.log" append="off"/>
Dec 06 07:05:28 user nova-compute[75021]:     </serial>
Dec 06 07:05:28 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:05:28 user nova-compute[75021]:     <video>
Dec 06 07:05:28 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:05:28 user nova-compute[75021]:     </video>
Dec 06 07:05:28 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:05:28 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:05:28 user nova-compute[75021]:     </rng>
Dec 06 07:05:28 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:05:28 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:05:28 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:05:28 user nova-compute[75021]:     </memballoon>
Dec 06 07:05:28 user nova-compute[75021]:   </devices>
Dec 06 07:05:28 user nova-compute[75021]: </domain>
Dec 06 07:05:28 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-272299805',display_name='tempest-ServerActionsTestOtherB-server-272299805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-272299805',id=4,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDr10Uf7mSfaKxaWiZMlOkgp+3gz+zk9cuGM2WOwPxRQl0KGDW8m0MH0trEdCAhYZHvExMqqK1A+1XoEwjfDbN1X4V66K4XOiRtH4zqe8KgY/USo0EOIRMWD8nLuB034BA==',key_name='tempest-keypair-2107162455',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:03:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d0482e21a6db45199f3c82f7f5913ec1',ramdisk_id='',reservation_id='r-lhdcj864',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1150715110',owner_user_name='tempest-ServerActionsTestOtherB-1150715110-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9273703a77bf425685228a99248f6d4e',uuid=2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converting VIF {"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG os_vif [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f24ba05-19aa-57a1-8786-2367e3ba21a0', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf48c57d0-30, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf48c57d0-30, col_values=(('qos', UUID('6c713136-0f90-4251-a6f3-c5e9434b724b')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf48c57d0-30, col_values=(('external_ids', {'iface-id': 'f48c57d0-3024-4f70-8989-454717799fe3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:60:12', 'vm-uuid': '2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:28 user nova-compute[75021]: INFO os_vif [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30')
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:30 user nova-compute[75021]: DEBUG nova.compute.manager [req-7de32e40-8cd9-48e8-b5e3-a384286657b0 req-e7d0db1d-eb8e-42e5-8c2d-2b74694fb5d1 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7de32e40-8cd9-48e8-b5e3-a384286657b0 req-e7d0db1d-eb8e-42e5-8c2d-2b74694fb5d1 service nova] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7de32e40-8cd9-48e8-b5e3-a384286657b0 req-e7d0db1d-eb8e-42e5-8c2d-2b74694fb5d1 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7de32e40-8cd9-48e8-b5e3-a384286657b0 req-e7d0db1d-eb8e-42e5-8c2d-2b74694fb5d1 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:30 user nova-compute[75021]: DEBUG nova.compute.manager [req-7de32e40-8cd9-48e8-b5e3-a384286657b0 req-e7d0db1d-eb8e-42e5-8c2d-2b74694fb5d1 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] No waiting events found dispatching network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:30 user nova-compute[75021]: WARNING nova.compute.manager [req-7de32e40-8cd9-48e8-b5e3-a384286657b0 req-e7d0db1d-eb8e-42e5-8c2d-2b74694fb5d1 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received unexpected event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 for instance with vm_state resized and task_state resize_reverting.
Dec 06 07:05:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:05:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:05:31 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Instance spawned successfully.
Dec 06 07:05:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:05:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:05:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:05:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:05:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:05:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:05:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:05:31 user nova-compute[75021]: INFO nova.compute.manager [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Took 7.89 seconds to spawn the instance on the hypervisor.
Dec 06 07:05:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:05:31 user nova-compute[75021]: INFO nova.compute.manager [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Took 8.73 seconds to build instance.
Dec 06 07:05:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-856db836-707f-4a2d-93ca-fb7c3652a8ec tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.830s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:32 user nova-compute[75021]: DEBUG nova.compute.manager [req-52f4901c-f0ac-40ee-8427-676abce2325a req-4b07b76c-6f00-42bc-bc0f-9808690f86a3 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-52f4901c-f0ac-40ee-8427-676abce2325a req-4b07b76c-6f00-42bc-bc0f-9808690f86a3 service nova] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-52f4901c-f0ac-40ee-8427-676abce2325a req-4b07b76c-6f00-42bc-bc0f-9808690f86a3 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-52f4901c-f0ac-40ee-8427-676abce2325a req-4b07b76c-6f00-42bc-bc0f-9808690f86a3 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:32 user nova-compute[75021]: DEBUG nova.compute.manager [req-52f4901c-f0ac-40ee-8427-676abce2325a req-4b07b76c-6f00-42bc-bc0f-9808690f86a3 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] No waiting events found dispatching network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:32 user nova-compute[75021]: WARNING nova.compute.manager [req-52f4901c-f0ac-40ee-8427-676abce2325a req-4b07b76c-6f00-42bc-bc0f-9808690f86a3 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received unexpected event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 for instance with vm_state resized and task_state resize_reverting.
Dec 06 07:05:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:05:32 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Instance running successfully.
Dec 06 07:05:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] finish_revert_migration finished successfully. {{(pid=75021) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11866}}
Dec 06 07:05:32 user nova-compute[75021]: INFO nova.compute.manager [None req-ca0a577e-07ac-427f-82fa-46c8eb0e42f6 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updating instance to original state: 'active'
Dec 06 07:05:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:33 user nova-compute[75021]: INFO nova.compute.manager [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Terminating instance
Dec 06 07:05:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-644cd470-f0ba-4c32-b75c-c169fcf54a3d req-2ca0d102-43a5-4b7d-9811-aac25f6ccb16 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Received event network-vif-unplugged-3c57d6ef-14c3-4e6f-8e82-e0b33416696d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-644cd470-f0ba-4c32-b75c-c169fcf54a3d req-2ca0d102-43a5-4b7d-9811-aac25f6ccb16 service nova] Acquiring lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-644cd470-f0ba-4c32-b75c-c169fcf54a3d req-2ca0d102-43a5-4b7d-9811-aac25f6ccb16 service nova] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-644cd470-f0ba-4c32-b75c-c169fcf54a3d req-2ca0d102-43a5-4b7d-9811-aac25f6ccb16 service nova] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-644cd470-f0ba-4c32-b75c-c169fcf54a3d req-2ca0d102-43a5-4b7d-9811-aac25f6ccb16 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] No waiting events found dispatching network-vif-unplugged-3c57d6ef-14c3-4e6f-8e82-e0b33416696d {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-644cd470-f0ba-4c32-b75c-c169fcf54a3d req-2ca0d102-43a5-4b7d-9811-aac25f6ccb16 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Received event network-vif-unplugged-3c57d6ef-14c3-4e6f-8e82-e0b33416696d for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-2f7c839b-1c84-4565-a5d7-df5e6e472823 req-69ec5524-e5dc-47bf-8107-1a92dfe4f696 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received event network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2f7c839b-1c84-4565-a5d7-df5e6e472823 req-69ec5524-e5dc-47bf-8107-1a92dfe4f696 service nova] Acquiring lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2f7c839b-1c84-4565-a5d7-df5e6e472823 req-69ec5524-e5dc-47bf-8107-1a92dfe4f696 service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2f7c839b-1c84-4565-a5d7-df5e6e472823 req-69ec5524-e5dc-47bf-8107-1a92dfe4f696 service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-2f7c839b-1c84-4565-a5d7-df5e6e472823 req-69ec5524-e5dc-47bf-8107-1a92dfe4f696 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] No waiting events found dispatching network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:34 user nova-compute[75021]: WARNING nova.compute.manager [req-2f7c839b-1c84-4565-a5d7-df5e6e472823 req-69ec5524-e5dc-47bf-8107-1a92dfe4f696 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received unexpected event network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 for instance with vm_state active and task_state None.
Dec 06 07:05:34 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Instance destroyed successfully.
Dec 06 07:05:34 user nova-compute[75021]: DEBUG nova.objects.instance [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lazy-loading 'resources' on Instance uuid 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-798112927',display_name='tempest-VolumesAdminNegativeTest-server-798112927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-798112927',id=7,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCh5h1ABaLhquTEhAAm7lt90Ql6YNdaXdiEO43OEcufPT+gQzOP/rFX1GTpCMqjWxMkSF3GNbhYI9VvePmWc/Q56QGDKTqbTRAtAC+BfLingkHxciODwQ8m2GIE+UBJ+iQ==',key_name='tempest-keypair-134819701',keypairs=<?>,launch_index=0,launched_at=2023-12-06T06:59:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79e72540b430409b954290965f157c43',ramdisk_id='',reservation_id='r-mkdd5ida',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1751614012',owner_user_name='tempest-VolumesAdminNegativeTest-1751614012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T06:59:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b2add3b5bca409e89667f7508b8450f',uuid=9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "address": "fa:16:3e:5f:22:74", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c57d6ef-14", "ovs_interfaceid": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Converting VIF {"id": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "address": "fa:16:3e:5f:22:74", "network": {"id": "1bf2263d-db40-4f7c-bf4f-9839edad2d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2144150855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e72540b430409b954290965f157c43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c57d6ef-14", "ovs_interfaceid": "3c57d6ef-14c3-4e6f-8e82-e0b33416696d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:22:74,bridge_name='br-int',has_traffic_filtering=True,id=3c57d6ef-14c3-4e6f-8e82-e0b33416696d,network=Network(1bf2263d-db40-4f7c-bf4f-9839edad2d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c57d6ef-14') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG os_vif [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:22:74,bridge_name='br-int',has_traffic_filtering=True,id=3c57d6ef-14c3-4e6f-8e82-e0b33416696d,network=Network(1bf2263d-db40-4f7c-bf4f-9839edad2d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c57d6ef-14') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c57d6ef-14, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c02dcebf-97ab-4d4d-b652-a9009ed6837f) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:05:34 user nova-compute[75021]: INFO os_vif [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:22:74,bridge_name='br-int',has_traffic_filtering=True,id=3c57d6ef-14c3-4e6f-8e82-e0b33416696d,network=Network(1bf2263d-db40-4f7c-bf4f-9839edad2d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c57d6ef-14')
Dec 06 07:05:34 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Deleting instance files /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a_del
Dec 06 07:05:34 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Deletion of /opt/stack/data/nova/instances/9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a_del complete
Dec 06 07:05:34 user nova-compute[75021]: INFO nova.compute.manager [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Took 0.98 seconds to destroy the instance on the hypervisor.
Dec 06 07:05:34 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:05:34 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-4be5240e-14e5-4cb7-a9e4-c8214a069ac1 req-924201f0-5aa1-4abb-af4c-17aba77d0982 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Received event network-vif-deleted-3c57d6ef-14c3-4e6f-8e82-e0b33416696d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:36 user nova-compute[75021]: INFO nova.compute.manager [req-4be5240e-14e5-4cb7-a9e4-c8214a069ac1 req-924201f0-5aa1-4abb-af4c-17aba77d0982 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Neutron deleted interface 3c57d6ef-14c3-4e6f-8e82-e0b33416696d; detaching it from the instance and deleting it from the info cache
Dec 06 07:05:36 user nova-compute[75021]: DEBUG nova.network.neutron [req-4be5240e-14e5-4cb7-a9e4-c8214a069ac1 req-924201f0-5aa1-4abb-af4c-17aba77d0982 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:05:36 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Took 1.17 seconds to deallocate network for instance.
Dec 06 07:05:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-4be5240e-14e5-4cb7-a9e4-c8214a069ac1 req-924201f0-5aa1-4abb-af4c-17aba77d0982 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Detach interface failed, port_id=3c57d6ef-14c3-4e6f-8e82-e0b33416696d, reason: Instance 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-5bf0f871-c948-44a3-a676-8be82e303cb3 req-0e618b39-5384-497f-beea-b025f00ede04 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Received event network-vif-plugged-3c57d6ef-14c3-4e6f-8e82-e0b33416696d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5bf0f871-c948-44a3-a676-8be82e303cb3 req-0e618b39-5384-497f-beea-b025f00ede04 service nova] Acquiring lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5bf0f871-c948-44a3-a676-8be82e303cb3 req-0e618b39-5384-497f-beea-b025f00ede04 service nova] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5bf0f871-c948-44a3-a676-8be82e303cb3 req-0e618b39-5384-497f-beea-b025f00ede04 service nova] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-5bf0f871-c948-44a3-a676-8be82e303cb3 req-0e618b39-5384-497f-beea-b025f00ede04 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] No waiting events found dispatching network-vif-plugged-3c57d6ef-14c3-4e6f-8e82-e0b33416696d {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:36 user nova-compute[75021]: WARNING nova.compute.manager [req-5bf0f871-c948-44a3-a676-8be82e303cb3 req-0e618b39-5384-497f-beea-b025f00ede04 service nova] [instance: 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a] Received unexpected event network-vif-plugged-3c57d6ef-14c3-4e6f-8e82-e0b33416696d for instance with vm_state deleted and task_state None.
Dec 06 07:05:36 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.578s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-a24942d2-d51f-45ba-99e1-96bfeb25143a req-d428f9d9-4748-4db0-a3e9-78e4a7244c84 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received event network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a24942d2-d51f-45ba-99e1-96bfeb25143a req-d428f9d9-4748-4db0-a3e9-78e4a7244c84 service nova] Acquiring lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a24942d2-d51f-45ba-99e1-96bfeb25143a req-d428f9d9-4748-4db0-a3e9-78e4a7244c84 service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a24942d2-d51f-45ba-99e1-96bfeb25143a req-d428f9d9-4748-4db0-a3e9-78e4a7244c84 service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-a24942d2-d51f-45ba-99e1-96bfeb25143a req-d428f9d9-4748-4db0-a3e9-78e4a7244c84 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] No waiting events found dispatching network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:36 user nova-compute[75021]: WARNING nova.compute.manager [req-a24942d2-d51f-45ba-99e1-96bfeb25143a req-d428f9d9-4748-4db0-a3e9-78e4a7244c84 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received unexpected event network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 for instance with vm_state active and task_state None.
Dec 06 07:05:36 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Deleted allocations for instance 9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a
Dec 06 07:05:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0ad73d09-ee30-4f11-87c9-7a79c070d23d tempest-VolumesAdminNegativeTest-1751614012 tempest-VolumesAdminNegativeTest-1751614012-project-member] Lock "9e7aeb70-a4ac-4a5c-936a-bb0364ebc89a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.938s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:40 user nova-compute[75021]: INFO nova.compute.manager [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Detaching volume 622ec1e7-06db-4745-ae36-707f409950e3
Dec 06 07:05:41 user nova-compute[75021]: INFO nova.virt.block_device [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Attempting to driver detach volume 622ec1e7-06db-4745-ae36-707f409950e3 from mountpoint /dev/vdb
Dec 06 07:05:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Attempting to detach device vdb from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:05:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:05:41 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:05:41 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:05:41 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:05:41 user nova-compute[75021]:   <serial>622ec1e7-06db-4745-ae36-707f409950e3</serial>
Dec 06 07:05:41 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:05:41 user nova-compute[75021]: </disk>
Dec 06 07:05:41 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:05:41 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Successfully detached device vdb from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the persistent domain config.
Dec 06 07:05:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:05:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:05:41 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:05:41 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:05:41 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:05:41 user nova-compute[75021]:   <serial>622ec1e7-06db-4745-ae36-707f409950e3</serial>
Dec 06 07:05:41 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:05:41 user nova-compute[75021]: </disk>
Dec 06 07:05:41 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:05:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:05:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "430c2ff8-2b09-43e8-b27e-caf8153ff892" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:05:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:42 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:05:42 user nova-compute[75021]: INFO nova.compute.claims [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Claim successful on node user
Dec 06 07:05:42 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:05:42 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:05:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:05:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:05:42 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:05:42 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:05:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:05:42 user nova-compute[75021]: DEBUG nova.policy [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76b72f254ecf4447b4fcaada0ce327d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd731b9dfe44549609091c48e8d19a1e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:05:43 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Creating image(s)
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "/opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "/opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "/opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk 1073741824" returned: 0 in 0.048s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.172s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Successfully created port: 541e273b-cc24-4f3c-bec6-f8f6f583dd31 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Cannot resize image /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Ensure instance console log exists: /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Successfully updated port: 541e273b-cc24-4f3c-bec6-f8f6f583dd31 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "refresh_cache-430c2ff8-2b09-43e8-b27e-caf8153ff892" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquired lock "refresh_cache-430c2ff8-2b09-43e8-b27e-caf8153ff892" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-e1872825-6445-4321-8146-7d2a6ebbfff0 req-fa23f217-2d3b-4583-aee8-6ad2914668b9 service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Received event network-changed-541e273b-cc24-4f3c-bec6-f8f6f583dd31 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-e1872825-6445-4321-8146-7d2a6ebbfff0 req-fa23f217-2d3b-4583-aee8-6ad2914668b9 service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Refreshing instance network info cache due to event network-changed-541e273b-cc24-4f3c-bec6-f8f6f583dd31. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e1872825-6445-4321-8146-7d2a6ebbfff0 req-fa23f217-2d3b-4583-aee8-6ad2914668b9 service nova] Acquiring lock "refresh_cache-430c2ff8-2b09-43e8-b27e-caf8153ff892" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Updating instance_info_cache with network_info: [{"id": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "address": "fa:16:3e:61:ae:ea", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541e273b-cc", "ovs_interfaceid": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Releasing lock "refresh_cache-430c2ff8-2b09-43e8-b27e-caf8153ff892" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Instance network_info: |[{"id": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "address": "fa:16:3e:61:ae:ea", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541e273b-cc", "ovs_interfaceid": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e1872825-6445-4321-8146-7d2a6ebbfff0 req-fa23f217-2d3b-4583-aee8-6ad2914668b9 service nova] Acquired lock "refresh_cache-430c2ff8-2b09-43e8-b27e-caf8153ff892" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.network.neutron [req-e1872825-6445-4321-8146-7d2a6ebbfff0 req-fa23f217-2d3b-4583-aee8-6ad2914668b9 service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Refreshing network info cache for port 541e273b-cc24-4f3c-bec6-f8f6f583dd31 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Start _get_guest_xml network_info=[{"id": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "address": "fa:16:3e:61:ae:ea", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541e273b-cc", "ovs_interfaceid": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:05:44 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:05:44 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-970341490',display_name='tempest-VolumesSnapshotTestJSON-instance-970341490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-970341490',id=21,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlUiW0nW00McIpdrGSb907MZNigiCPna3dMz7Xkh/TdHpHkO9RENbfwltareVfR4nTihFb5FDYs/lAgVm7XZxh1gS5abT9IPTinCvwTuD+ANGQa814aPxA9HIIwmI1juw==',key_name='tempest-keypair-1366890290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d731b9dfe44549609091c48e8d19a1e9',ramdisk_id='',reservation_id='r-pt9cagc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-591172318',owner_user_name='tempest-VolumesSnapshotTestJSON-591172318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b72f254ecf4447b4fcaada0ce327d6',uuid=430c2ff8-2b09-43e8-b27e-caf8153ff892,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "address": "fa:16:3e:61:ae:ea", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541e273b-cc", "ovs_interfaceid": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Converting VIF {"id": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "address": "fa:16:3e:61:ae:ea", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541e273b-cc", "ovs_interfaceid": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ae:ea,bridge_name='br-int',has_traffic_filtering=True,id=541e273b-cc24-4f3c-bec6-f8f6f583dd31,network=Network(a9cc5472-9cbe-42f2-bae2-532a8daa36e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap541e273b-cc') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lazy-loading 'pci_devices' on Instance uuid 430c2ff8-2b09-43e8-b27e-caf8153ff892 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:05:44 user nova-compute[75021]:   <uuid>430c2ff8-2b09-43e8-b27e-caf8153ff892</uuid>
Dec 06 07:05:44 user nova-compute[75021]:   <name>instance-00000015</name>
Dec 06 07:05:44 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:05:44 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:05:44 user nova-compute[75021]:   <metadata>
Dec 06 07:05:44 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:05:44 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:05:44 user nova-compute[75021]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-970341490</nova:name>
Dec 06 07:05:44 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:05:44</nova:creationTime>
Dec 06 07:05:44 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:05:44 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:05:44 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:05:44 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:05:44 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:05:44 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:05:44 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:05:44 user nova-compute[75021]:       <nova:owner>
Dec 06 07:05:44 user nova-compute[75021]:         <nova:user uuid="76b72f254ecf4447b4fcaada0ce327d6">tempest-VolumesSnapshotTestJSON-591172318-project-member</nova:user>
Dec 06 07:05:44 user nova-compute[75021]:         <nova:project uuid="d731b9dfe44549609091c48e8d19a1e9">tempest-VolumesSnapshotTestJSON-591172318</nova:project>
Dec 06 07:05:44 user nova-compute[75021]:       </nova:owner>
Dec 06 07:05:44 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:05:44 user nova-compute[75021]:       <nova:ports>
Dec 06 07:05:44 user nova-compute[75021]:         <nova:port uuid="541e273b-cc24-4f3c-bec6-f8f6f583dd31">
Dec 06 07:05:44 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 07:05:44 user nova-compute[75021]:         </nova:port>
Dec 06 07:05:44 user nova-compute[75021]:       </nova:ports>
Dec 06 07:05:44 user nova-compute[75021]:     </nova:instance>
Dec 06 07:05:44 user nova-compute[75021]:   </metadata>
Dec 06 07:05:44 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:05:44 user nova-compute[75021]:     <system>
Dec 06 07:05:44 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:05:44 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:05:44 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:05:44 user nova-compute[75021]:       <entry name="serial">430c2ff8-2b09-43e8-b27e-caf8153ff892</entry>
Dec 06 07:05:44 user nova-compute[75021]:       <entry name="uuid">430c2ff8-2b09-43e8-b27e-caf8153ff892</entry>
Dec 06 07:05:44 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:05:44 user nova-compute[75021]:     </system>
Dec 06 07:05:44 user nova-compute[75021]:   </sysinfo>
Dec 06 07:05:44 user nova-compute[75021]:   <os>
Dec 06 07:05:44 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:05:44 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:05:44 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:05:44 user nova-compute[75021]:   </os>
Dec 06 07:05:44 user nova-compute[75021]:   <features>
Dec 06 07:05:44 user nova-compute[75021]:     <acpi/>
Dec 06 07:05:44 user nova-compute[75021]:     <apic/>
Dec 06 07:05:44 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:05:44 user nova-compute[75021]:   </features>
Dec 06 07:05:44 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:05:44 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:05:44 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:05:44 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:05:44 user nova-compute[75021]:   </clock>
Dec 06 07:05:44 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:05:44 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:05:44 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:05:44 user nova-compute[75021]:   </cpu>
Dec 06 07:05:44 user nova-compute[75021]:   <devices>
Dec 06 07:05:44 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:05:44 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:05:44 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk"/>
Dec 06 07:05:44 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:05:44 user nova-compute[75021]:     </disk>
Dec 06 07:05:44 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:05:44 user nova-compute[75021]:       <mac address="fa:16:3e:61:ae:ea"/>
Dec 06 07:05:44 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:05:44 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:05:44 user nova-compute[75021]:       <target dev="tap541e273b-cc"/>
Dec 06 07:05:44 user nova-compute[75021]:     </interface>
Dec 06 07:05:44 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:05:44 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/console.log" append="off"/>
Dec 06 07:05:44 user nova-compute[75021]:     </serial>
Dec 06 07:05:44 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:05:44 user nova-compute[75021]:     <video>
Dec 06 07:05:44 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:05:44 user nova-compute[75021]:     </video>
Dec 06 07:05:44 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:05:44 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:05:44 user nova-compute[75021]:     </rng>
Dec 06 07:05:44 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:05:44 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:05:44 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:05:44 user nova-compute[75021]:     </memballoon>
Dec 06 07:05:44 user nova-compute[75021]:   </devices>
Dec 06 07:05:44 user nova-compute[75021]: </domain>
Dec 06 07:05:44 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-970341490',display_name='tempest-VolumesSnapshotTestJSON-instance-970341490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-970341490',id=21,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlUiW0nW00McIpdrGSb907MZNigiCPna3dMz7Xkh/TdHpHkO9RENbfwltareVfR4nTihFb5FDYs/lAgVm7XZxh1gS5abT9IPTinCvwTuD+ANGQa814aPxA9HIIwmI1juw==',key_name='tempest-keypair-1366890290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d731b9dfe44549609091c48e8d19a1e9',ramdisk_id='',reservation_id='r-pt9cagc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-591172318',owner_user_name='tempest-VolumesSnapshotTestJSON-591172318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b72f254ecf4447b4fcaada0ce327d6',uuid=430c2ff8-2b09-43e8-b27e-caf8153ff892,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "address": "fa:16:3e:61:ae:ea", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541e273b-cc", "ovs_interfaceid": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Converting VIF {"id": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "address": "fa:16:3e:61:ae:ea", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541e273b-cc", "ovs_interfaceid": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ae:ea,bridge_name='br-int',has_traffic_filtering=True,id=541e273b-cc24-4f3c-bec6-f8f6f583dd31,network=Network(a9cc5472-9cbe-42f2-bae2-532a8daa36e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap541e273b-cc') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG os_vif [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ae:ea,bridge_name='br-int',has_traffic_filtering=True,id=541e273b-cc24-4f3c-bec6-f8f6f583dd31,network=Network(a9cc5472-9cbe-42f2-bae2-532a8daa36e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap541e273b-cc') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5aef4f29-9e34-5b80-9eae-ec20ee7e152f', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap541e273b-cc, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap541e273b-cc, col_values=(('qos', UUID('3d919cfa-597d-44e0-9a12-10775e061fb9')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap541e273b-cc, col_values=(('external_ids', {'iface-id': '541e273b-cc24-4f3c-bec6-f8f6f583dd31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:ae:ea', 'vm-uuid': '430c2ff8-2b09-43e8-b27e-caf8153ff892'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:44 user nova-compute[75021]: INFO os_vif [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ae:ea,bridge_name='br-int',has_traffic_filtering=True,id=541e273b-cc24-4f3c-bec6-f8f6f583dd31,network=Network(a9cc5472-9cbe-42f2-bae2-532a8daa36e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap541e273b-cc')
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:05:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] No VIF found with MAC fa:16:3e:61:ae:ea, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:05:45 user nova-compute[75021]: DEBUG nova.network.neutron [req-e1872825-6445-4321-8146-7d2a6ebbfff0 req-fa23f217-2d3b-4583-aee8-6ad2914668b9 service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Updated VIF entry in instance network info cache for port 541e273b-cc24-4f3c-bec6-f8f6f583dd31. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:05:45 user nova-compute[75021]: DEBUG nova.network.neutron [req-e1872825-6445-4321-8146-7d2a6ebbfff0 req-fa23f217-2d3b-4583-aee8-6ad2914668b9 service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Updating instance_info_cache with network_info: [{"id": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "address": "fa:16:3e:61:ae:ea", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541e273b-cc", "ovs_interfaceid": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:05:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e1872825-6445-4321-8146-7d2a6ebbfff0 req-fa23f217-2d3b-4583-aee8-6ad2914668b9 service nova] Releasing lock "refresh_cache-430c2ff8-2b09-43e8-b27e-caf8153ff892" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:05:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-d37be325-9797-4be6-8b79-b8580ab72289 req-5dc992fc-376a-48e8-83c7-eacf6018814b service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Received event network-vif-plugged-541e273b-cc24-4f3c-bec6-f8f6f583dd31 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d37be325-9797-4be6-8b79-b8580ab72289 req-5dc992fc-376a-48e8-83c7-eacf6018814b service nova] Acquiring lock "430c2ff8-2b09-43e8-b27e-caf8153ff892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d37be325-9797-4be6-8b79-b8580ab72289 req-5dc992fc-376a-48e8-83c7-eacf6018814b service nova] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d37be325-9797-4be6-8b79-b8580ab72289 req-5dc992fc-376a-48e8-83c7-eacf6018814b service nova] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-d37be325-9797-4be6-8b79-b8580ab72289 req-5dc992fc-376a-48e8-83c7-eacf6018814b service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] No waiting events found dispatching network-vif-plugged-541e273b-cc24-4f3c-bec6-f8f6f583dd31 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:46 user nova-compute[75021]: WARNING nova.compute.manager [req-d37be325-9797-4be6-8b79-b8580ab72289 req-5dc992fc-376a-48e8-83c7-eacf6018814b service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Received unexpected event network-vif-plugged-541e273b-cc24-4f3c-bec6-f8f6f583dd31 for instance with vm_state building and task_state spawning.
Dec 06 07:05:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:48 user nova-compute[75021]: INFO nova.compute.manager [None req-228aa1ff-60da-48c0-8fc0-4267499f89e4 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Unrescuing
Dec 06 07:05:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-228aa1ff-60da-48c0-8fc0-4267499f89e4 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-228aa1ff-60da-48c0-8fc0-4267499f89e4 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquired lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG nova.network.neutron [None req-228aa1ff-60da-48c0-8fc0-4267499f89e4 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:05:48 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Instance spawned successfully.
Dec 06 07:05:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:05:48 user nova-compute[75021]: INFO nova.compute.manager [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Took 5.44 seconds to spawn the instance on the hypervisor.
Dec 06 07:05:48 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-dc847562-6bb3-4a2f-b2d1-6eb9e5fdb4d1 req-3ed78d55-822a-49b3-adc3-d2eaed615ad4 service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Received event network-vif-plugged-541e273b-cc24-4f3c-bec6-f8f6f583dd31 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dc847562-6bb3-4a2f-b2d1-6eb9e5fdb4d1 req-3ed78d55-822a-49b3-adc3-d2eaed615ad4 service nova] Acquiring lock "430c2ff8-2b09-43e8-b27e-caf8153ff892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dc847562-6bb3-4a2f-b2d1-6eb9e5fdb4d1 req-3ed78d55-822a-49b3-adc3-d2eaed615ad4 service nova] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dc847562-6bb3-4a2f-b2d1-6eb9e5fdb4d1 req-3ed78d55-822a-49b3-adc3-d2eaed615ad4 service nova] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-dc847562-6bb3-4a2f-b2d1-6eb9e5fdb4d1 req-3ed78d55-822a-49b3-adc3-d2eaed615ad4 service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] No waiting events found dispatching network-vif-plugged-541e273b-cc24-4f3c-bec6-f8f6f583dd31 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:48 user nova-compute[75021]: WARNING nova.compute.manager [req-dc847562-6bb3-4a2f-b2d1-6eb9e5fdb4d1 req-3ed78d55-822a-49b3-adc3-d2eaed615ad4 service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Received unexpected event network-vif-plugged-541e273b-cc24-4f3c-bec6-f8f6f583dd31 for instance with vm_state building and task_state spawning.
Dec 06 07:05:48 user nova-compute[75021]: INFO nova.compute.manager [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Took 6.28 seconds to build instance.
Dec 06 07:05:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d091271e-06ac-43e0-8c97-92f8cf79c0ec tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.375s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG nova.network.neutron [None req-228aa1ff-60da-48c0-8fc0-4267499f89e4 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Updating instance_info_cache with network_info: [{"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-228aa1ff-60da-48c0-8fc0-4267499f89e4 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Releasing lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG nova.objects.instance [None req-228aa1ff-60da-48c0-8fc0-4267499f89e4 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'flavor' on Instance uuid 4ffc6429-3f3c-4a7e-98e5-0db984266eae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-c58bcb04-93f0-4822-8957-7f4b984b1d4c req-9ede842a-460a-4b7b-9098-53c96ed8ce39 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received event network-vif-unplugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c58bcb04-93f0-4822-8957-7f4b984b1d4c req-9ede842a-460a-4b7b-9098-53c96ed8ce39 service nova] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c58bcb04-93f0-4822-8957-7f4b984b1d4c req-9ede842a-460a-4b7b-9098-53c96ed8ce39 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c58bcb04-93f0-4822-8957-7f4b984b1d4c req-9ede842a-460a-4b7b-9098-53c96ed8ce39 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-c58bcb04-93f0-4822-8957-7f4b984b1d4c req-9ede842a-460a-4b7b-9098-53c96ed8ce39 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] No waiting events found dispatching network-vif-unplugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:49 user nova-compute[75021]: WARNING nova.compute.manager [req-c58bcb04-93f0-4822-8957-7f4b984b1d4c req-9ede842a-460a-4b7b-9098-53c96ed8ce39 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received unexpected event network-vif-unplugged-0b799ddb-c34b-457f-9412-d09c3ab04806 for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:05:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:49 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Instance destroyed successfully.
Dec 06 07:05:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:49 user nova-compute[75021]: INFO nova.compute.manager [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Terminating instance
Dec 06 07:05:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:50 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Instance destroyed successfully.
Dec 06 07:05:50 user nova-compute[75021]: DEBUG nova.objects.instance [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'resources' on Instance uuid f9275ae0-ccb1-4c73-b639-9cd243c6ff60 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T06:59:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2135327261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2135327261',id=5,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3Lr/kdf8MqVfMx/TeUSMAfVzvaX8ereHkjXoBa9ETDzmMjMiQ9csySNchdYnRT2yeIOuwNGKkvlDgg8mH04y1O/ltV6AdPBXl6ROzuZndpgBoI4b+/RQCPqcSHuavY/Q==',key_name='tempest-keypair-400149348',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:03:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d75ae216dcb345c79a5c2a4d38e51b38',ramdisk_id='',reservation_id='r-mbynyqjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1923852465',owner_user_name='tempest-AttachVolumeShelveTestJSON-1923852465-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4daf20c071c4b5cb826452811323abd',uuid=f9275ae0-ccb1-4c73-b639-9cd243c6ff60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converting VIF {"id": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "address": "fa:16:3e:a3:19:e2", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605d9e6-fc", "ovs_interfaceid": "c605d9e6-fce9-495d-b4f3-e2f1e4952633", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=c605d9e6-fce9-495d-b4f3-e2f1e4952633,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605d9e6-fc') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG os_vif [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=c605d9e6-fce9-495d-b4f3-e2f1e4952633,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605d9e6-fc') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc605d9e6-fc, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb53938e-fffe-4230-a037-d2a8fdf8de97) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:05:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:50 user nova-compute[75021]: INFO os_vif [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:19:e2,bridge_name='br-int',has_traffic_filtering=True,id=c605d9e6-fce9-495d-b4f3-e2f1e4952633,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605d9e6-fc')
Dec 06 07:05:50 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Deleting instance files /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60_del
Dec 06 07:05:50 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Deletion of /opt/stack/data/nova/instances/f9275ae0-ccb1-4c73-b639-9cd243c6ff60_del complete
Dec 06 07:05:51 user nova-compute[75021]: INFO nova.compute.manager [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Took 1.36 seconds to destroy the instance on the hypervisor.
Dec 06 07:05:51 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] No waiting events found dispatching network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:51 user nova-compute[75021]: WARNING nova.compute.manager [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received unexpected event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:05:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received event network-vif-unplugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] Acquiring lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] No waiting events found dispatching network-vif-unplugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received event network-vif-unplugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received event network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] Acquiring lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] No waiting events found dispatching network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:51 user nova-compute[75021]: WARNING nova.compute.manager [req-f8eaa7cb-ad7e-482c-b6d0-ebac113e8eee req-15744446-8279-44c9-a3bc-9c2a54e3da99 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received unexpected event network-vif-plugged-c605d9e6-fce9-495d-b4f3-e2f1e4952633 for instance with vm_state active and task_state deleting.
Dec 06 07:05:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:52 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:05:52 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Took 1.01 seconds to deallocate network for instance.
Dec 06 07:05:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:52 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:05:52 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:05:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.579s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:52 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Deleted allocations for instance f9275ae0-ccb1-4c73-b639-9cd243c6ff60
Dec 06 07:05:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8a12badb-859e-46f4-8249-4c60bc460696 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "f9275ae0-ccb1-4c73-b639-9cd243c6ff60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.156s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-2aa45e0a-357d-43ba-ac8b-24750a803863 req-53bda17e-6b77-4d55-887d-a7088cec0754 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2aa45e0a-357d-43ba-ac8b-24750a803863 req-53bda17e-6b77-4d55-887d-a7088cec0754 service nova] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2aa45e0a-357d-43ba-ac8b-24750a803863 req-53bda17e-6b77-4d55-887d-a7088cec0754 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2aa45e0a-357d-43ba-ac8b-24750a803863 req-53bda17e-6b77-4d55-887d-a7088cec0754 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-2aa45e0a-357d-43ba-ac8b-24750a803863 req-53bda17e-6b77-4d55-887d-a7088cec0754 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] No waiting events found dispatching network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:53 user nova-compute[75021]: WARNING nova.compute.manager [req-2aa45e0a-357d-43ba-ac8b-24750a803863 req-53bda17e-6b77-4d55-887d-a7088cec0754 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received unexpected event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:05:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-2aa45e0a-357d-43ba-ac8b-24750a803863 req-53bda17e-6b77-4d55-887d-a7088cec0754 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2aa45e0a-357d-43ba-ac8b-24750a803863 req-53bda17e-6b77-4d55-887d-a7088cec0754 service nova] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2aa45e0a-357d-43ba-ac8b-24750a803863 req-53bda17e-6b77-4d55-887d-a7088cec0754 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2aa45e0a-357d-43ba-ac8b-24750a803863 req-53bda17e-6b77-4d55-887d-a7088cec0754 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-2aa45e0a-357d-43ba-ac8b-24750a803863 req-53bda17e-6b77-4d55-887d-a7088cec0754 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] No waiting events found dispatching network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:05:53 user nova-compute[75021]: WARNING nova.compute.manager [req-2aa45e0a-357d-43ba-ac8b-24750a803863 req-53bda17e-6b77-4d55-887d-a7088cec0754 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received unexpected event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:05:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-2aa45e0a-357d-43ba-ac8b-24750a803863 req-53bda17e-6b77-4d55-887d-a7088cec0754 service nova] [instance: f9275ae0-ccb1-4c73-b639-9cd243c6ff60] Received event network-vif-deleted-c605d9e6-fce9-495d-b4f3-e2f1e4952633 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:05:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-228aa1ff-60da-48c0-8fc0-4267499f89e4 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:05:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:58 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:05:58 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:05:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:05:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:05:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:05:58 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:05:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:05:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:05:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:05:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5c50a6a8-2500-4408-a932-48f0116713b8 is timed out.
Dec 06 07:06:01 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Successfully detached device vdb from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the live domain config.
Dec 06 07:06:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hqofkJEW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:06:01 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad79a5aa-2fa3-4870-835b-f1fe9f416859]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:06:01 user nova-compute[75021]: No targets found.
Dec 06 07:06:01 user nova-compute[75021]: iSNS:
Dec 06 07:06:01 user nova-compute[75021]: No targets found.
Dec 06 07:06:01 user nova-compute[75021]: STATIC:
Dec 06 07:06:01 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3
Dec 06 07:06:01 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:06:01 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:06:01 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635
Dec 06 07:06:01 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:06:01 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:06:01 user nova-compute[75021]: FIRMWARE:
Dec 06 07:06:01 user nova-compute[75021]: No targets found.
Dec 06 07:06:01 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:06:01 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:06:01 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4089e001-83a5-416a-a396-4bbd527b428e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee544437-22e8-40c6-983c-c230bfa283ae]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 (non-flash)
Dec 06 07:06:01 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:01 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 (non-flash)
Dec 06 07:06:01 user nova-compute[75021]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:01 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89fc189ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[656539d0-2912-458f-9b2f-a88eee83c835]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd57ff4d-5d9f-4134-bc4f-5037a5a58ab3]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b1996b-96d8-4d1b-905c-53a9836dfe7f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[702401ac-add0-4b92-80a8-033eb3289ecb]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.137s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80a07a8-e7e6-4b59-b469-b8f884c09d7a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[668de14c-9c21-4735-a686-2f7f53326f78]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3, portal: 172.16.0.220,3260]
Dec 06 07:06:01 user nova-compute[75021]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3, portal: 172.16.0.220,3260] successful.
Dec 06 07:06:01 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:622ec1e7-06db-4745-ae36-707f409950e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[850f7787-28c5-4bae-9531-fa8e03e43d2a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] <== disconnect_volume: return (454ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:06:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:06:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:02 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lazy-loading 'flavor' on Instance uuid 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:06:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d7bcdb80-14b8-4876-88d1-2c9fdf5dc9f2 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.941s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:03 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:06:03 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7301MB free_disk=25.43994140625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5c50a6a8-2500-4408-a932-48f0116713b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 68ca3b31-7de1-4522-a093-a5eb69274c0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 430c2ff8-2b09-43e8-b27e-caf8153ff892 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:06:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:04 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:06:04 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:06:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:06:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:06:04 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:06:05 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Updating instance_info_cache with network_info: [{"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:06:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:06:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:06:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:06:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:06:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:06:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:06:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-e6768721-4b48-4273-8404-b43fb7aa3b25 req-93e20b1c-fcd5-423d-b534-11733a71f2dc service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Received event network-changed-b51652b3-d921-4e2b-9b19-57064192e1fa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:06:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-e6768721-4b48-4273-8404-b43fb7aa3b25 req-93e20b1c-fcd5-423d-b534-11733a71f2dc service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Refreshing instance network info cache due to event network-changed-b51652b3-d921-4e2b-9b19-57064192e1fa. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:06:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e6768721-4b48-4273-8404-b43fb7aa3b25 req-93e20b1c-fcd5-423d-b534-11733a71f2dc service nova] Acquiring lock "refresh_cache-9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:06:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e6768721-4b48-4273-8404-b43fb7aa3b25 req-93e20b1c-fcd5-423d-b534-11733a71f2dc service nova] Acquired lock "refresh_cache-9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:06:05 user nova-compute[75021]: DEBUG nova.network.neutron [req-e6768721-4b48-4273-8404-b43fb7aa3b25 req-93e20b1c-fcd5-423d-b534-11733a71f2dc service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Refreshing network info cache for port b51652b3-d921-4e2b-9b19-57064192e1fa {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:06:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquiring lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lazy-loading 'flavor' on Instance uuid 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG nova.network.neutron [req-e6768721-4b48-4273-8404-b43fb7aa3b25 req-93e20b1c-fcd5-423d-b534-11733a71f2dc service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Updated VIF entry in instance network info cache for port b51652b3-d921-4e2b-9b19-57064192e1fa. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG nova.network.neutron [req-e6768721-4b48-4273-8404-b43fb7aa3b25 req-93e20b1c-fcd5-423d-b534-11733a71f2dc service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Updating instance_info_cache with network_info: [{"id": "b51652b3-d921-4e2b-9b19-57064192e1fa", "address": "fa:16:3e:ff:0c:16", "network": {"id": "5f9c0afd-2c38-4f2a-8f56-11d0b016a438", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2085203827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b8ff637e4c4e459bd698cc2c8341f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51652b3-d9", "ovs_interfaceid": "b51652b3-d921-4e2b-9b19-57064192e1fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e6768721-4b48-4273-8404-b43fb7aa3b25 req-93e20b1c-fcd5-423d-b534-11733a71f2dc service nova] Releasing lock "refresh_cache-9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquiring lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:06 user nova-compute[75021]: INFO nova.compute.manager [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Attaching volume e59eb44d-c006-4ede-a512-61fe9de82087 to /dev/vdb
Dec 06 07:06:06 user nova-compute[75021]: DEBUG os_brick.utils [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93118f9-919b-45f4-8263-c7fe50ce085e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d11cd52-8137-4c1c-a0fd-aeaf2eca7868]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4000b9e8-4e9f-42dd-87c1-880cc88c5c98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d812ac-6d74-4475-80f1-22dff59dc446]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:06:06 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:06:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6717852f-9cd1-4c15-9692-b1ff24fed62b]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG os_brick.utils [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:06:06 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Updating existing volume attachment record: 39a5dd58-2f3f-4205-b58e-af47dec25df8 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:06:07 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:06:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:09 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:06:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "68ca3b31-7de1-4522-a093-a5eb69274c0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "68ca3b31-7de1-4522-a093-a5eb69274c0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:13 user nova-compute[75021]: INFO nova.compute.manager [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Terminating instance
Dec 06 07:06:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-1e5c4721-944e-4461-92b4-4a6c9c736d97 req-f2261605-ce67-4aa9-88be-52e39afc42b7 service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Received event network-vif-unplugged-b7ad44e1-5205-44aa-84b4-1dbe16038048 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1e5c4721-944e-4461-92b4-4a6c9c736d97 req-f2261605-ce67-4aa9-88be-52e39afc42b7 service nova] Acquiring lock "68ca3b31-7de1-4522-a093-a5eb69274c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1e5c4721-944e-4461-92b4-4a6c9c736d97 req-f2261605-ce67-4aa9-88be-52e39afc42b7 service nova] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1e5c4721-944e-4461-92b4-4a6c9c736d97 req-f2261605-ce67-4aa9-88be-52e39afc42b7 service nova] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-1e5c4721-944e-4461-92b4-4a6c9c736d97 req-f2261605-ce67-4aa9-88be-52e39afc42b7 service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] No waiting events found dispatching network-vif-unplugged-b7ad44e1-5205-44aa-84b4-1dbe16038048 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:06:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-1e5c4721-944e-4461-92b4-4a6c9c736d97 req-f2261605-ce67-4aa9-88be-52e39afc42b7 service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Received event network-vif-unplugged-b7ad44e1-5205-44aa-84b4-1dbe16038048 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:06:14 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Instance destroyed successfully.
Dec 06 07:06:14 user nova-compute[75021]: DEBUG nova.objects.instance [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lazy-loading 'resources' on Instance uuid 68ca3b31-7de1-4522-a093-a5eb69274c0b {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-658055119',display_name='tempest-ServersNegativeTestJSON-server-658055119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-658055119',id=18,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:04:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70aa47164bdf43a78448ce550774cc70',ramdisk_id='',reservation_id='r-zhqjjqdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1406242964',owner_user_name='tempest-ServersNegativeTestJSON-1406242964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:04:31Z,user_data=None,user_id='bec5e110057b47ac89c85ca77aaa56ec',uuid=68ca3b31-7de1-4522-a093-a5eb69274c0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "address": "fa:16:3e:76:2a:05", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad44e1-52", "ovs_interfaceid": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Converting VIF {"id": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "address": "fa:16:3e:76:2a:05", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad44e1-52", "ovs_interfaceid": "b7ad44e1-5205-44aa-84b4-1dbe16038048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:2a:05,bridge_name='br-int',has_traffic_filtering=True,id=b7ad44e1-5205-44aa-84b4-1dbe16038048,network=Network(ab7aa0ea-4c08-4d4a-b74c-c47298834061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ad44e1-52') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG os_vif [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:2a:05,bridge_name='br-int',has_traffic_filtering=True,id=b7ad44e1-5205-44aa-84b4-1dbe16038048,network=Network(ab7aa0ea-4c08-4d4a-b74c-c47298834061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ad44e1-52') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7ad44e1-52, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f163beec-8895-4025-8a78-ab24e6d5b992) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:14 user nova-compute[75021]: INFO os_vif [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:2a:05,bridge_name='br-int',has_traffic_filtering=True,id=b7ad44e1-5205-44aa-84b4-1dbe16038048,network=Network(ab7aa0ea-4c08-4d4a-b74c-c47298834061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ad44e1-52')
Dec 06 07:06:14 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Deleting instance files /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b_del
Dec 06 07:06:14 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Deletion of /opt/stack/data/nova/instances/68ca3b31-7de1-4522-a093-a5eb69274c0b_del complete
Dec 06 07:06:14 user nova-compute[75021]: INFO nova.compute.manager [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Took 0.65 seconds to destroy the instance on the hypervisor.
Dec 06 07:06:14 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:06:14 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Took 0.60 seconds to deallocate network for instance.
Dec 06 07:06:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:15 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Deleted allocations for instance 68ca3b31-7de1-4522-a093-a5eb69274c0b
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aab592e2-b08a-47a7-889f-c1eddb61743e tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.809s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvJsGZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:06:15 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:06:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:06:15 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:06:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:06:15 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2a735e-1868-407c-ac84-f3b6c20dd342]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:06:15 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2554ad-17ce-4cc0-8deb-18ef1e38f3a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087] added
Dec 06 07:06:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.078s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d9509e-29e0-49ea-9016-95596db6bbdb]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0681b3-852e-4354-8063-800e87bda5dc]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvJsGZrD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvJsGZrD" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[66519380-1295-4421-950a-d573a303c054]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YvJsGZrD'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3482ad9b-ae53-42f8-accd-da16d80547dc]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-1d8f76a7-420b-4edc-9643-131da6684969 req-1f866694-3abc-4828-8131-4e75eda0f16d service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Received event network-vif-plugged-b7ad44e1-5205-44aa-84b4-1dbe16038048 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1d8f76a7-420b-4edc-9643-131da6684969 req-1f866694-3abc-4828-8131-4e75eda0f16d service nova] Acquiring lock "68ca3b31-7de1-4522-a093-a5eb69274c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1d8f76a7-420b-4edc-9643-131da6684969 req-1f866694-3abc-4828-8131-4e75eda0f16d service nova] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1d8f76a7-420b-4edc-9643-131da6684969 req-1f866694-3abc-4828-8131-4e75eda0f16d service nova] Lock "68ca3b31-7de1-4522-a093-a5eb69274c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-1d8f76a7-420b-4edc-9643-131da6684969 req-1f866694-3abc-4828-8131-4e75eda0f16d service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] No waiting events found dispatching network-vif-plugged-b7ad44e1-5205-44aa-84b4-1dbe16038048 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:06:15 user nova-compute[75021]: WARNING nova.compute.manager [req-1d8f76a7-420b-4edc-9643-131da6684969 req-1f866694-3abc-4828-8131-4e75eda0f16d service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Received unexpected event network-vif-plugged-b7ad44e1-5205-44aa-84b4-1dbe16038048 for instance with vm_state deleted and task_state None.
Dec 06 07:06:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-1d8f76a7-420b-4edc-9643-131da6684969 req-1f866694-3abc-4828-8131-4e75eda0f16d service nova] [instance: 68ca3b31-7de1-4522-a093-a5eb69274c0b] Received event network-vif-deleted-b7ad44e1-5205-44aa-84b4-1dbe16038048 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:06:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ce32a7-c0f0-40b2-96d9-1ef889f6e98c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01a7464-b2f6-41df-9fe1-3dbde47bf5db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260]
Dec 06 07:06:16 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260] successful.
Dec 06 07:06:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad93788-4fed-4812-9c11-92b840b57c85]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0552a5ef-ece0-4408-9a00-464d88e47381]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:16 user nova-compute[75021]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:06:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:16 user nova-compute[75021]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:06:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d0593f-160c-4dfb-8c36-847bdefa68f5]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:06:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvJsGZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:06:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:06:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26332626265303666', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:06:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332626265303666', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:06:17 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lazy-loading 'flavor' on Instance uuid 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:06:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:06:17 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:06:17 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:06:17 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:06:17 user nova-compute[75021]:   <serial>e59eb44d-c006-4ede-a512-61fe9de82087</serial>
Dec 06 07:06:17 user nova-compute[75021]: </disk>
Dec 06 07:06:17 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:06:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:06:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:06:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] No VIF found with MAC fa:16:3e:ff:0c:16, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:06:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d5d7ec70-cb60-4af0-abab-85cbaa0acd67 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.378s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Acquiring lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG os_brick.utils [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5531c9ad-e373-416e-8c9c-dd4f3aefcb2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f3550f-9923-431e-b2b3-b9f8ef0fe7ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5994df-264b-46be-9cae-4abf2a41de7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[559d0f0a-fda2-49e4-908e-2f21a3012d56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:06:18 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:06:18 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[723f05c7-fb60-41c3-a6d7-a8c07f53b387]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:06:18 user nova-compute[75021]: DEBUG os_brick.utils [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:06:18 user nova-compute[75021]: INFO nova.compute.manager [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Swapping volume e59eb44d-c006-4ede-a512-61fe9de82087 for a9c0c1f5-2aa5-4012-989b-fe664a53518d
Dec 06 07:06:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:06:19 user nova-compute[75021]: INFO nova.compute.manager [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] instance snapshotting
Dec 06 07:06:19 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Beginning live snapshot process
Dec 06 07:06:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json -f qcow2 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json -f qcow2 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzqz2becd/b05c6b88a35147dda42e0af9b62d784d.delta 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzqz2becd/b05c6b88a35147dda42e0af9b62d784d.delta 1073741824" returned: 0 in 0.102s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:20 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 06 07:06:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:21 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 06 07:06:21 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 07:06:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzqz2becd/b05c6b88a35147dda42e0af9b62d784d.delta /opt/stack/data/nova/instances/snapshots/tmpzqz2becd/b05c6b88a35147dda42e0af9b62d784d {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzqz2becd/b05c6b88a35147dda42e0af9b62d784d.delta /opt/stack/data/nova/instances/snapshots/tmpzqz2becd/b05c6b88a35147dda42e0af9b62d784d" returned: 0 in 0.646s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Snapshot extracted, beginning image upload
Dec 06 07:06:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:24 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Snapshot image upload complete
Dec 06 07:06:24 user nova-compute[75021]: INFO nova.compute.manager [None req-35ca423d-0f61-4173-bff0-595d6a87c802 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Took 5.51 seconds to snapshot the instance on the hypervisor.
Dec 06 07:06:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfmKGFzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9c0c1f5-2aa5-4012-989b-fe664a53518d', 'serial': 'a9c0c1f5-2aa5-4012-989b-fe664a53518d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvJsGZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e59eb44d-c006-4ede-a512-61fe9de82087', 'serial'} {{(pid=75021) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfmKGFzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:06:28 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:06:28 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:06:28 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[081d7df0-f034-4440-bbb2-88829910137f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:06:28 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d763d0ea-1feb-44e1-a650-0d29f0a63ec3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d] added
Dec 06 07:06:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3520074-b282-4d3a-93f5-6e57b7f34caa]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9e3abb-b7c9-4c47-b378-9f92f0be386f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hfmKGFzM {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hfmKGFzM" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed06c374-97fb-48b1-9c25-3cb0fc7ebc10]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hfmKGFzM'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6842b27-77a4-4d20-ba3e-cde07f7b2864]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b86c59f-1a19-4f0e-a3b2-50d4bf81f126]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:28 user nova-compute[75021]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:06:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:28 user nova-compute[75021]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:06:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed4f032-c408-401b-9102-0ebb33674e7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d, portal: 172.16.0.220,3260]
Dec 06 07:06:28 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d, portal: 172.16.0.220,3260] successful.
Dec 06 07:06:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b88aa4-8601-406b-af25-6b10e689820d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55465da-b1e4-4ade-9477-b298182f31b4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:28 user nova-compute[75021]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:06:28 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)
Dec 06 07:06:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:28 user nova-compute[75021]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:06:28 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)
Dec 06 07:06:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[701b655e-5357-49ee-b596-0e7aecd2ccdd]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:06:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:06:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfmKGFzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:06:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:06:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23039363031613334', 'path': '/dev/sdd'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:06:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039363031613334', 'path': '/dev/sdd'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:06:29 user nova-compute[75021]: DEBUG nova.objects.instance [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lazy-loading 'flavor' on Instance uuid 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:06:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 162529280 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 317718528 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 486539264 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 625999872 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 761266176 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 897581056 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 1038090240 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG nova.objects.instance [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lazy-loading 'flavor' on Instance uuid 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvJsGZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:06:34 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9234871-dda8-4195-8b6a-5166b0d629a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:06:34 user nova-compute[75021]: No targets found.
Dec 06 07:06:34 user nova-compute[75021]: iSNS:
Dec 06 07:06:34 user nova-compute[75021]: No targets found.
Dec 06 07:06:34 user nova-compute[75021]: STATIC:
Dec 06 07:06:34 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635
Dec 06 07:06:34 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:06:34 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:06:34 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087
Dec 06 07:06:34 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:06:34 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:06:34 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d
Dec 06 07:06:34 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:06:34 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:06:34 user nova-compute[75021]: FIRMWARE:
Dec 06 07:06:34 user nova-compute[75021]: No targets found.
Dec 06 07:06:34 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:06:34 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:06:34 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee028306-35c1-46d2-9853-019faf4e87f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b896ed-c52a-44fa-9f10-0a2e56e44916]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:34 user nova-compute[75021]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:06:34 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)
Dec 06 07:06:34 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:34 user nova-compute[75021]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:06:34 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)
Dec 06 07:06:34 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b4629630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9709b0a-8e66-4eea-8b2c-c0698584271b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dc6fca-9a93-404d-b4ac-b1c77efac78f]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[118f3fc2-6ddd-4fa1-bf31-a6e4befdb1d2]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:34 user nova-compute[75021]: INFO nova.compute.manager [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Attaching volume 9db1e01e-f449-42f9-9fcf-b625db1590ce to /dev/vdb
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[29487599-ed29-4b1e-84b0-a23573345b6b]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[42915e8e-b879-4025-89ea-83dbea5d6b9e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.utils [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dfb508-d102-4403-a80f-377a93563c89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25c1049-b742-4d9c-94ed-a4c7e1290bfd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdfe595-bd70-4a4d-ad83-02580d5f11e5]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260]
Dec 06 07:06:34 user nova-compute[75021]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260] successful.
Dec 06 07:06:34 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94ef45f-1c68-46fb-b3e2-3bee1df791bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[80421f6e-c19e-4534-84d9-25686c5f03e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe893b9-56f1-4c4f-84fc-818796adb2e6]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] <== disconnect_volume: return (369ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:06:34 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:06:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[becfad13-c81f-44de-90eb-beb47c7d1dbc]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG os_brick.utils [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Updating existing volume attachment record: cb8d9152-9b75-4747-9e12-1f46725f930e {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfmKGFzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9c0c1f5-2aa5-4012-989b-fe664a53518d', 'serial'} {{(pid=75021) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 06 07:06:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] swap_volume: removing Cinder connection for volume e59eb44d-c006-4ede-a512-61fe9de82087 {{(pid=75021) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 06 07:06:35 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] swap_volume: Updating volume e59eb44d-c006-4ede-a512-61fe9de82087 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "hfmKGFzM", "auth_password": "dZ4pcV5HKDafNU", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "a9c0c1f5-2aa5-4012-989b-fe664a53518d"}, "status": "reserved", "instance": "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f", "attached_at": "", "detached_at": "", "volume_id": "a9c0c1f5-2aa5-4012-989b-fe664a53518d", "serial": "a9c0c1f5-2aa5-4012-989b-fe664a53518d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a9c0c1f5-2aa5-4012-989b-fe664a53518d', 'no_device': None, 'attachment_id': 'caa25b74-0769-41ee-9967-9433d99cd351'} {{(pid=75021) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 06 07:06:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7922217d-dbd8-4220-b681-4f3c7db0cf68 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.821s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Acquiring lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG os_brick.utils [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b708ec-c0fb-4295-99cc-cffdea5624e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd57be9-fb0e-4154-93ef-255bffd18674]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[568ca5bd-e75d-4618-b0fd-dadffdb48daa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4091021-b95c-418f-a2ee-be3611fbd146]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:06:36 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:06:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85c0f40-479d-4310-959e-aa757bdf2aa7]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:06:36 user nova-compute[75021]: DEBUG os_brick.utils [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:06:36 user nova-compute[75021]: INFO nova.compute.manager [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Swapping volume a9c0c1f5-2aa5-4012-989b-fe664a53518d for e59eb44d-c006-4ede-a512-61fe9de82087
Dec 06 07:06:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "e600e40b-0b08-4341-a48e-652da530e59c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "e600e40b-0b08-4341-a48e-652da530e59c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:06:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:43 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:06:43 user nova-compute[75021]: INFO nova.compute.claims [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Claim successful on node user
Dec 06 07:06:43 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:06:43 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:06:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:06:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:06:43 user nova-compute[75021]: DEBUG nova.network.neutron [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:06:43 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:06:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:06:43 user nova-compute[75021]: DEBUG nova.policy [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4daf20c071c4b5cb826452811323abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75ae216dcb345c79a5c2a4d38e51b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:06:44 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Creating image(s)
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "/opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "/opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "/opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.205s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ynFlRbHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:06:44 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:06:44 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:06:44 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.198s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[42357486-57aa-4cbc-b2f0-28fc3c2fee2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:06:44 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk 1073741824" returned: 0 in 0.050s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7566d2e-313e-43b5-8b9e-00037ca89db2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce] added
Dec 06 07:06:44 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[deee0a8e-033f-4e33-be69-5b60d7fb0f1b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e7f8e1-086b-4140-86d1-064cdc8107c6]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ynFlRbHB {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ynFlRbHB" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e56321-4b35-4a4e-8908-77bf383707d4]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ynFlRbHB'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17eb631-3a5e-41ae-bbb1-d867ff8d7647]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG nova.network.neutron [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Successfully created port: d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4394e9-5217-4f44-9fc9-0e10b5a3153c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:44 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)
Dec 06 07:06:44 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:44 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)
Dec 06 07:06:44 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.207s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bc9a87-f256-4522-a391-53f84cc831a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce, portal: 172.16.0.220,3260]
Dec 06 07:06:44 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce, portal: 172.16.0.220,3260] successful.
Dec 06 07:06:44 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fc5935-c34f-4f73-bcaf-1f6c8809df14]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c5721d-5101-4280-9901-8c468a73223b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:44 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)
Dec 06 07:06:44 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce (non-flash)
Dec 06 07:06:44 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:44 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)
Dec 06 07:06:44 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce (non-flash)
Dec 06 07:06:44 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.418s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f9df31-e99f-49d9-8036-27642c7e7463]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Cannot resize image /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Ensure instance console log exists: /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Successfully updated port: d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquired lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-64d646af-e738-44ae-bed4-d8fcd091114d req-929a58dd-937b-4eba-9efc-997bd00f056d service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received event network-changed-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-64d646af-e738-44ae-bed4-d8fcd091114d req-929a58dd-937b-4eba-9efc-997bd00f056d service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Refreshing instance network info cache due to event network-changed-d18bb07e-28df-49e3-b5b2-5e7cec5adee4. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-64d646af-e738-44ae-bed4-d8fcd091114d req-929a58dd-937b-4eba-9efc-997bd00f056d service nova] Acquiring lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Updating instance_info_cache with network_info: [{"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Releasing lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Instance network_info: |[{"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-64d646af-e738-44ae-bed4-d8fcd091114d req-929a58dd-937b-4eba-9efc-997bd00f056d service nova] Acquired lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.network.neutron [req-64d646af-e738-44ae-bed4-d8fcd091114d req-929a58dd-937b-4eba-9efc-997bd00f056d service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Refreshing network info cache for port d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Start _get_guest_xml network_info=[{"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:06:45 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:06:45 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1837730268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1837730268',id=22,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5hWtq5TK0J0vpeo8aXAbvXCQ9ENJgvBGr2J66uQaNfFfPKHwNmVUNM2CHMhzie5xHYDXLzmEqeLL/Q6avdg1NwA1Dnzt6JyxnqTPO0wuy2VUmBr2q/1R0+cnZW8dXADA==',key_name='tempest-keypair-1138365958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d75ae216dcb345c79a5c2a4d38e51b38',ramdisk_id='',reservation_id='r-98ifjfwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1923852465',owner_user_name='tempest-AttachVolumeShelveTestJSON-1923852465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:06:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4daf20c071c4b5cb826452811323abd',uuid=e600e40b-0b08-4341-a48e-652da530e59c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converting VIF {"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:13:29,bridge_name='br-int',has_traffic_filtering=True,id=d18bb07e-28df-49e3-b5b2-5e7cec5adee4,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bb07e-28') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.objects.instance [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'pci_devices' on Instance uuid e600e40b-0b08-4341-a48e-652da530e59c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:06:45 user nova-compute[75021]:   <uuid>e600e40b-0b08-4341-a48e-652da530e59c</uuid>
Dec 06 07:06:45 user nova-compute[75021]:   <name>instance-00000016</name>
Dec 06 07:06:45 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:06:45 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:06:45 user nova-compute[75021]:   <metadata>
Dec 06 07:06:45 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:06:45 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:06:45 user nova-compute[75021]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1837730268</nova:name>
Dec 06 07:06:45 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:06:45</nova:creationTime>
Dec 06 07:06:45 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:06:45 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:06:45 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:06:45 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:06:45 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:06:45 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:06:45 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:06:45 user nova-compute[75021]:       <nova:owner>
Dec 06 07:06:45 user nova-compute[75021]:         <nova:user uuid="b4daf20c071c4b5cb826452811323abd">tempest-AttachVolumeShelveTestJSON-1923852465-project-member</nova:user>
Dec 06 07:06:45 user nova-compute[75021]:         <nova:project uuid="d75ae216dcb345c79a5c2a4d38e51b38">tempest-AttachVolumeShelveTestJSON-1923852465</nova:project>
Dec 06 07:06:45 user nova-compute[75021]:       </nova:owner>
Dec 06 07:06:45 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:06:45 user nova-compute[75021]:       <nova:ports>
Dec 06 07:06:45 user nova-compute[75021]:         <nova:port uuid="d18bb07e-28df-49e3-b5b2-5e7cec5adee4">
Dec 06 07:06:45 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 07:06:45 user nova-compute[75021]:         </nova:port>
Dec 06 07:06:45 user nova-compute[75021]:       </nova:ports>
Dec 06 07:06:45 user nova-compute[75021]:     </nova:instance>
Dec 06 07:06:45 user nova-compute[75021]:   </metadata>
Dec 06 07:06:45 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:06:45 user nova-compute[75021]:     <system>
Dec 06 07:06:45 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:06:45 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:06:45 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:06:45 user nova-compute[75021]:       <entry name="serial">e600e40b-0b08-4341-a48e-652da530e59c</entry>
Dec 06 07:06:45 user nova-compute[75021]:       <entry name="uuid">e600e40b-0b08-4341-a48e-652da530e59c</entry>
Dec 06 07:06:45 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:06:45 user nova-compute[75021]:     </system>
Dec 06 07:06:45 user nova-compute[75021]:   </sysinfo>
Dec 06 07:06:45 user nova-compute[75021]:   <os>
Dec 06 07:06:45 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:06:45 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:06:45 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:06:45 user nova-compute[75021]:   </os>
Dec 06 07:06:45 user nova-compute[75021]:   <features>
Dec 06 07:06:45 user nova-compute[75021]:     <acpi/>
Dec 06 07:06:45 user nova-compute[75021]:     <apic/>
Dec 06 07:06:45 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:06:45 user nova-compute[75021]:   </features>
Dec 06 07:06:45 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:06:45 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:06:45 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:06:45 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:06:45 user nova-compute[75021]:   </clock>
Dec 06 07:06:45 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:06:45 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:06:45 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:06:45 user nova-compute[75021]:   </cpu>
Dec 06 07:06:45 user nova-compute[75021]:   <devices>
Dec 06 07:06:45 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:06:45 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:06:45 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk"/>
Dec 06 07:06:45 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:06:45 user nova-compute[75021]:     </disk>
Dec 06 07:06:45 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:06:45 user nova-compute[75021]:       <mac address="fa:16:3e:a4:13:29"/>
Dec 06 07:06:45 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:06:45 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:06:45 user nova-compute[75021]:       <target dev="tapd18bb07e-28"/>
Dec 06 07:06:45 user nova-compute[75021]:     </interface>
Dec 06 07:06:45 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:06:45 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/console.log" append="off"/>
Dec 06 07:06:45 user nova-compute[75021]:     </serial>
Dec 06 07:06:45 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:06:45 user nova-compute[75021]:     <video>
Dec 06 07:06:45 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:06:45 user nova-compute[75021]:     </video>
Dec 06 07:06:45 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:06:45 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:06:45 user nova-compute[75021]:     </rng>
Dec 06 07:06:45 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:06:45 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:06:45 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:06:45 user nova-compute[75021]:     </memballoon>
Dec 06 07:06:45 user nova-compute[75021]:   </devices>
Dec 06 07:06:45 user nova-compute[75021]: </domain>
Dec 06 07:06:45 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1837730268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1837730268',id=22,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5hWtq5TK0J0vpeo8aXAbvXCQ9ENJgvBGr2J66uQaNfFfPKHwNmVUNM2CHMhzie5xHYDXLzmEqeLL/Q6avdg1NwA1Dnzt6JyxnqTPO0wuy2VUmBr2q/1R0+cnZW8dXADA==',key_name='tempest-keypair-1138365958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d75ae216dcb345c79a5c2a4d38e51b38',ramdisk_id='',reservation_id='r-98ifjfwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1923852465',owner_user_name='tempest-AttachVolumeShelveTestJSON-1923852465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:06:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4daf20c071c4b5cb826452811323abd',uuid=e600e40b-0b08-4341-a48e-652da530e59c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converting VIF {"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:13:29,bridge_name='br-int',has_traffic_filtering=True,id=d18bb07e-28df-49e3-b5b2-5e7cec5adee4,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bb07e-28') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG os_vif [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:13:29,bridge_name='br-int',has_traffic_filtering=True,id=d18bb07e-28df-49e3-b5b2-5e7cec5adee4,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bb07e-28') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08374cc1-5c9c-5ac7-9213-092c0b62eb1d', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ynFlRbHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '23930333131373633', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930333131373633', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd18bb07e-28, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd18bb07e-28, col_values=(('qos', UUID('9e7158f2-bac3-46f5-bd72-c01a2caf1a43')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd18bb07e-28, col_values=(('external_ids', {'iface-id': 'd18bb07e-28df-49e3-b5b2-5e7cec5adee4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:13:29', 'vm-uuid': 'e600e40b-0b08-4341-a48e-652da530e59c'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.objects.instance [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lazy-loading 'flavor' on Instance uuid 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:45 user nova-compute[75021]: INFO os_vif [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:13:29,bridge_name='br-int',has_traffic_filtering=True,id=d18bb07e-28df-49e3-b5b2-5e7cec5adee4,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bb07e-28')
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:06:45 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:06:45 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:06:45 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:06:45 user nova-compute[75021]:   <serial>9db1e01e-f449-42f9-9fcf-b625db1590ce</serial>
Dec 06 07:06:45 user nova-compute[75021]: </disk>
Dec 06 07:06:45 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:06:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] No VIF found with MAC fa:16:3e:a4:13:29, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG nova.network.neutron [req-64d646af-e738-44ae-bed4-d8fcd091114d req-929a58dd-937b-4eba-9efc-997bd00f056d service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Updated VIF entry in instance network info cache for port d18bb07e-28df-49e3-b5b2-5e7cec5adee4. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG nova.network.neutron [req-64d646af-e738-44ae-bed4-d8fcd091114d req-929a58dd-937b-4eba-9efc-997bd00f056d service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Updating instance_info_cache with network_info: [{"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-64d646af-e738-44ae-bed4-d8fcd091114d req-929a58dd-937b-4eba-9efc-997bd00f056d service nova] Releasing lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] No VIF found with MAC fa:16:3e:f3:41:7d, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvJsGZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e59eb44d-c006-4ede-a512-61fe9de82087', 'serial': 'e59eb44d-c006-4ede-a512-61fe9de82087'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfmKGFzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'a9c0c1f5-2aa5-4012-989b-fe664a53518d'}, 'status': 'reserved', 'instance': '9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9c0c1f5-2aa5-4012-989b-fe664a53518d', 'serial'} {{(pid=75021) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvJsGZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:06:46 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:06:46 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:06:46 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c0bc44-9b5b-426c-8cb7-1a3ec05bafbf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:06:46 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[795ddd79-d950-4d69-baf3-a717590bed41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087] added
Dec 06 07:06:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[76870118-9b6c-473f-965d-48d932cf8874]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3ce0ea96-cf39-453e-8fa2-6239df35f370 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.163s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e16d2ce-46ea-4cdf-a8e3-1d9cc36eea33]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvJsGZrD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvJsGZrD" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[459d3842-caa1-4261-a183-ab37f08b7232]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YvJsGZrD'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b23acb-8b18-4054-be7a-cc309c2ef39a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b62d3c-9a78-4aad-8302-909123b59f7e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:46 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)
Dec 06 07:06:46 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce (non-flash)
Dec 06 07:06:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:46 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)
Dec 06 07:06:46 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce (non-flash)
Dec 06 07:06:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fd9888-6e48-4d36-9899-3d98f06c806b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260]
Dec 06 07:06:46 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260] successful.
Dec 06 07:06:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfc4e0e-cb6a-448d-93e3-f43a22335513]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb2a335-3789-49eb-bbf2-c37d038a937e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:46 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)
Dec 06 07:06:46 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce (non-flash)
Dec 06 07:06:46 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:06:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:46 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)
Dec 06 07:06:46 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce (non-flash)
Dec 06 07:06:46 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:06:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3311557d-90e8-409e-a4aa-9ab3c148b518]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:06:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvJsGZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:06:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:06:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26332626265303666', 'path': '/dev/sde'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:06:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332626265303666', 'path': '/dev/sde'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:06:47 user nova-compute[75021]: DEBUG nova.objects.instance [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lazy-loading 'flavor' on Instance uuid 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:06:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-5e31e849-613a-4416-9c8c-d4efff8dc399 req-80c16e21-e50a-4c0d-992c-fabffa8c00d5 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received event network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:06:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5e31e849-613a-4416-9c8c-d4efff8dc399 req-80c16e21-e50a-4c0d-992c-fabffa8c00d5 service nova] Acquiring lock "e600e40b-0b08-4341-a48e-652da530e59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5e31e849-613a-4416-9c8c-d4efff8dc399 req-80c16e21-e50a-4c0d-992c-fabffa8c00d5 service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5e31e849-613a-4416-9c8c-d4efff8dc399 req-80c16e21-e50a-4c0d-992c-fabffa8c00d5 service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-5e31e849-613a-4416-9c8c-d4efff8dc399 req-80c16e21-e50a-4c0d-992c-fabffa8c00d5 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] No waiting events found dispatching network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:06:47 user nova-compute[75021]: WARNING nova.compute.manager [req-5e31e849-613a-4416-9c8c-d4efff8dc399 req-80c16e21-e50a-4c0d-992c-fabffa8c00d5 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received unexpected event network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 for instance with vm_state building and task_state spawning.
Dec 06 07:06:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 12582912 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:48 user nova-compute[75021]: INFO nova.compute.manager [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Detaching volume 9db1e01e-f449-42f9-9fcf-b625db1590ce
Dec 06 07:06:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 150994944 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:48 user nova-compute[75021]: INFO nova.virt.block_device [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Attempting to driver detach volume 9db1e01e-f449-42f9-9fcf-b625db1590ce from mountpoint /dev/vdb
Dec 06 07:06:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Attempting to detach device vdb from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:06:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:06:48 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:06:48 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:06:48 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:06:48 user nova-compute[75021]:   <serial>9db1e01e-f449-42f9-9fcf-b625db1590ce</serial>
Dec 06 07:06:48 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:06:48 user nova-compute[75021]: </disk>
Dec 06 07:06:48 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:06:48 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Successfully detached device vdb from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the persistent domain config.
Dec 06 07:06:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:06:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:06:48 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:06:48 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:06:48 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:06:48 user nova-compute[75021]:   <serial>9db1e01e-f449-42f9-9fcf-b625db1590ce</serial>
Dec 06 07:06:48 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:06:48 user nova-compute[75021]: </disk>
Dec 06 07:06:48 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:06:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 314572800 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:06:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 494927872 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-9dabb2b8-5f4f-4a5c-b3d0-e7ac560e7bde req-eb66b3c3-2457-4042-bc4a-61ea20985cf6 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received event network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:06:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9dabb2b8-5f4f-4a5c-b3d0-e7ac560e7bde req-eb66b3c3-2457-4042-bc4a-61ea20985cf6 service nova] Acquiring lock "e600e40b-0b08-4341-a48e-652da530e59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9dabb2b8-5f4f-4a5c-b3d0-e7ac560e7bde req-eb66b3c3-2457-4042-bc4a-61ea20985cf6 service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9dabb2b8-5f4f-4a5c-b3d0-e7ac560e7bde req-eb66b3c3-2457-4042-bc4a-61ea20985cf6 service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-9dabb2b8-5f4f-4a5c-b3d0-e7ac560e7bde req-eb66b3c3-2457-4042-bc4a-61ea20985cf6 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] No waiting events found dispatching network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:06:49 user nova-compute[75021]: WARNING nova.compute.manager [req-9dabb2b8-5f4f-4a5c-b3d0-e7ac560e7bde req-eb66b3c3-2457-4042-bc4a-61ea20985cf6 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received unexpected event network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 for instance with vm_state building and task_state spawning.
Dec 06 07:06:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 679477248 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:50 user nova-compute[75021]: DEBUG nova.compute.manager [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:06:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:06:50 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Instance spawned successfully.
Dec 06 07:06:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:06:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:06:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:06:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:06:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:06:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:06:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:06:50 user nova-compute[75021]: INFO nova.compute.manager [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Took 6.83 seconds to spawn the instance on the hypervisor.
Dec 06 07:06:50 user nova-compute[75021]: DEBUG nova.compute.manager [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:06:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 851443712 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:50 user nova-compute[75021]: INFO nova.compute.manager [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Took 7.64 seconds to build instance.
Dec 06 07:06:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-caec59d3-b163-4881-9146-b246c926f741 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "e600e40b-0b08-4341-a48e-652da530e59c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.755s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 1033895936 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hfmKGFzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'a9c0c1f5-2aa5-4012-989b-fe664a53518d'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:06:52 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[597d2f3a-6cf8-4959-b5c6-be6f80f74fc3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:06:52 user nova-compute[75021]: No targets found.
Dec 06 07:06:52 user nova-compute[75021]: iSNS:
Dec 06 07:06:52 user nova-compute[75021]: No targets found.
Dec 06 07:06:52 user nova-compute[75021]: STATIC:
Dec 06 07:06:52 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635
Dec 06 07:06:52 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:06:52 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:06:52 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087
Dec 06 07:06:52 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:06:52 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:06:52 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce
Dec 06 07:06:52 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:06:52 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:06:52 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d
Dec 06 07:06:52 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:06:52 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:06:52 user nova-compute[75021]: FIRMWARE:
Dec 06 07:06:52 user nova-compute[75021]: No targets found.
Dec 06 07:06:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:06:52 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:06:52 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ec8b26-b909-4310-8685-cb5ff1d23166]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[524dc346-6ce8-42dc-a3ad-84d0e102d126]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:52 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)
Dec 06 07:06:52 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce (non-flash)
Dec 06 07:06:52 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:06:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:06:52 user nova-compute[75021]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d (non-flash)
Dec 06 07:06:52 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce (non-flash)
Dec 06 07:06:52 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:06:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b4773370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d'): ({'sdd'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Removing single pathed devices sdd {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bd056f-687a-48f1-b267-139d90dd2469]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[66151863-dee3-48d9-b1a3-61e31c0b5930]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Flushing IO for device /dev/sdd {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fa5b29-4c8c-4f7e-92fa-b8ea64a4f204]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3626fc1d-f272-4ef7-8111-5c2833a15208]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e945de4-68c5-4fd2-adfe-7b21ad8f320f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed13404-4177-4316-a6e1-225cfc41ef34]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d, portal: 172.16.0.220,3260]
Dec 06 07:06:52 user nova-compute[75021]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d, portal: 172.16.0.220,3260] successful.
Dec 06 07:06:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0c1f5-2aa5-4012-989b-fe664a53518d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24704fe-1b89-4eef-a453-c57c1f0d1e45]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] <== disconnect_volume: return (304ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG nova.compute.manager [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvJsGZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e59eb44d-c006-4ede-a512-61fe9de82087', 'serial'} {{(pid=75021) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 06 07:06:52 user nova-compute[75021]: DEBUG nova.compute.manager [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] swap_volume: removing Cinder connection for volume a9c0c1f5-2aa5-4012-989b-fe664a53518d {{(pid=75021) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 06 07:06:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] swap_volume: Updating volume a9c0c1f5-2aa5-4012-989b-fe664a53518d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "YvJsGZrD", "auth_password": "Hb5nZED7MUoYqh", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "e59eb44d-c006-4ede-a512-61fe9de82087"}, "status": "reserved", "instance": "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f", "attached_at": "", "detached_at": "", "volume_id": "e59eb44d-c006-4ede-a512-61fe9de82087", "serial": "e59eb44d-c006-4ede-a512-61fe9de82087"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e59eb44d-c006-4ede-a512-61fe9de82087', 'no_device': None, 'attachment_id': '084140df-1141-47dd-8992-b827a285a668'} {{(pid=75021) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 06 07:06:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5e384850-9bc6-458d-b233-56063c170262 tempest-TestVolumeSwap-1358538036 tempest-TestVolumeSwap-1358538036-project-admin] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.080s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquiring lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:54 user nova-compute[75021]: INFO nova.compute.manager [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Detaching volume e59eb44d-c006-4ede-a512-61fe9de82087
Dec 06 07:06:54 user nova-compute[75021]: INFO nova.virt.block_device [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Attempting to driver detach volume e59eb44d-c006-4ede-a512-61fe9de82087 from mountpoint /dev/vdb
Dec 06 07:06:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Attempting to detach device vdb from instance 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:06:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:06:54 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:06:54 user nova-compute[75021]:   <source dev="/dev/sde"/>
Dec 06 07:06:54 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:06:54 user nova-compute[75021]:   <serial>e59eb44d-c006-4ede-a512-61fe9de82087</serial>
Dec 06 07:06:54 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:06:54 user nova-compute[75021]: </disk>
Dec 06 07:06:54 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:06:54 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Successfully detached device vdb from instance 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f from the persistent domain config.
Dec 06 07:06:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:06:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:06:54 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:06:54 user nova-compute[75021]:   <source dev="/dev/sde"/>
Dec 06 07:06:54 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:06:54 user nova-compute[75021]:   <serial>e59eb44d-c006-4ede-a512-61fe9de82087</serial>
Dec 06 07:06:54 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:06:54 user nova-compute[75021]: </disk>
Dec 06 07:06:54 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:06:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:06:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:06:59 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:06:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:06:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:06:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:06:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:06:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:06:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:06:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:07:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:04 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:07:04 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7293MB free_disk=25.377269744873047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5c50a6a8-2500-4408-a932-48f0116713b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 430c2ff8-2b09-43e8-b27e-caf8153ff892 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance e600e40b-0b08-4341-a48e-652da530e59c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:07:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:07:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:07:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:07:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:07:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:07:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:07:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:07:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:07:05 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:07:06 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updating instance_info_cache with network_info: [{"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:07:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:07:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:07:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:07:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:07:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:07:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:07:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:07:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:07:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:07:08 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:07:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:07:09 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5c50a6a8-2500-4408-a932-48f0116713b8 is timed out.
Dec 06 07:07:09 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Successfully detached device vdb from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the live domain config.
Dec 06 07:07:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ynFlRbHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:07:09 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17197f0-18e8-4d9f-ac04-95d1c7d47089]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:07:09 user nova-compute[75021]: No targets found.
Dec 06 07:07:09 user nova-compute[75021]: iSNS:
Dec 06 07:07:09 user nova-compute[75021]: No targets found.
Dec 06 07:07:09 user nova-compute[75021]: STATIC:
Dec 06 07:07:09 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635
Dec 06 07:07:09 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:07:09 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:07:09 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087
Dec 06 07:07:09 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:07:09 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:07:09 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce
Dec 06 07:07:09 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:07:09 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:07:09 user nova-compute[75021]: FIRMWARE:
Dec 06 07:07:09 user nova-compute[75021]: No targets found.
Dec 06 07:07:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:07:09 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:07:09 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[582f0e34-5a68-4194-9a50-7970ef7e7b2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ba919b-16fe-4ba4-9d39-7f4cf0c60898]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:09 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce (non-flash)
Dec 06 07:07:09 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:07:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:09 user nova-compute[75021]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce (non-flash)
Dec 06 07:07:09 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:07:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d82ddf30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3929e7a9-dda2-4661-8d63-eaf0a657d9ae]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8932af6e-a5aa-469e-8ca3-31797cdc2d30]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4d4dd6-0d34-44ea-a3bc-5688642dc600]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e398555-2b24-46c8-bdcb-e310a42b45c6]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[525039c6-903d-472b-a720-e21a4b1fe418]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[689ea50f-5cb8-4d2a-80a6-23a35cefac38]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce, portal: 172.16.0.220,3260]
Dec 06 07:07:09 user nova-compute[75021]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce, portal: 172.16.0.220,3260] successful.
Dec 06 07:07:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9db1e01e-f449-42f9-9fcf-b625db1590ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3961e151-5ff8-4dbf-80c0-ee12194e8c40]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] <== disconnect_volume: return (293ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:07:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:07:10 user nova-compute[75021]: DEBUG nova.objects.instance [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lazy-loading 'flavor' on Instance uuid 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-40585827-e72d-4e52-a693-211825b32328 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.812s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:14 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f is timed out.
Dec 06 07:07:14 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Successfully detached device vdb from instance 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f from the live domain config.
Dec 06 07:07:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvJsGZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'e59eb44d-c006-4ede-a512-61fe9de82087'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:07:14 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e49839-7458-4920-b466-9584764627f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:07:14 user nova-compute[75021]: No targets found.
Dec 06 07:07:14 user nova-compute[75021]: iSNS:
Dec 06 07:07:14 user nova-compute[75021]: No targets found.
Dec 06 07:07:14 user nova-compute[75021]: STATIC:
Dec 06 07:07:14 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635
Dec 06 07:07:14 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:07:14 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:07:14 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087
Dec 06 07:07:14 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:07:14 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:07:14 user nova-compute[75021]: FIRMWARE:
Dec 06 07:07:14 user nova-compute[75021]: No targets found.
Dec 06 07:07:14 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:07:14 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:07:14 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7837b9-5175-4734-8510-e378d0937169]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fb1339-9df9-4f50-ac8e-08d01e86c8e2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:14 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:07:14 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:14 user nova-compute[75021]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 (non-flash)
Dec 06 07:07:14 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d879f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087'): ({'sde'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Removing single pathed devices sde {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1338fc-6a2f-493f-bf08-7230c59353cf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fd2751-6cd5-4582-ae1a-c9333d24427c]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Flushing IO for device /dev/sde {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[15455a74-b09b-4263-b6f7-735e7c733663]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd09037-a1a3-45f4-91e5-2dc7b0ea62e0]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d6cecb-865f-4a58-ace4-2af53fd30370]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9ca962-deb5-4b49-a732-fb4a927c2be8]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260]
Dec 06 07:07:14 user nova-compute[75021]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087, portal: 172.16.0.220,3260] successful.
Dec 06 07:07:14 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59eb44d-c006-4ede-a512-61fe9de82087 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7d11ea-c41f-4426-a20a-41b4dc985331]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:07:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] <== disconnect_volume: return (289ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:07:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:07:15 user nova-compute[75021]: DEBUG nova.objects.instance [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lazy-loading 'flavor' on Instance uuid 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c5d8f5fa-b7f0-4cc6-8642-f437a8457f9f tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.948s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:16 user nova-compute[75021]: DEBUG nova.objects.instance [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lazy-loading 'flavor' on Instance uuid 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:16 user nova-compute[75021]: INFO nova.compute.manager [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Attaching volume 16792f29-a35a-46ed-96e5-528d37062d8b to /dev/vdb
Dec 06 07:07:17 user nova-compute[75021]: DEBUG os_brick.utils [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e719c47-995c-48e8-accd-52c5179a1fb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb3745f-9107-4832-8b96-0ed121b7c1d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5ac718-566e-4fc6-b814-824625e9d9ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d994fc7-8244-4861-a8bf-31792f930455]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:07:17 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:07:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e85dbe-7309-4ff2-a7ae-949fec9ddeff]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG os_brick.utils [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:07:17 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Updating existing volume attachment record: 84f37bf3-2622-444c-ad9c-6d1139863b49 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:07:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:07:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:18 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:07:18 user nova-compute[75021]: INFO nova.compute.claims [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Claim successful on node user
Dec 06 07:07:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:18 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:07:18 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:07:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:07:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:07:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:07:18 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:07:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG nova.policy [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3369c937ad24537a114a71eb4674750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f011c1a70ac1465d8eb31e20850fdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:07:19 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Creating image(s)
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "/opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "/opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk 1073741824" returned: 0 in 0.047s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Successfully created port: 6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.199s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Cannot resize image /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Ensure instance console log exists: /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Successfully updated port: 6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "refresh_cache-bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquired lock "refresh_cache-bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-408fe528-abe6-428e-b465-035fb2f23cda req-c94d3cb0-6e56-4c81-b535-c832f72d7bf2 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received event network-changed-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-408fe528-abe6-428e-b465-035fb2f23cda req-c94d3cb0-6e56-4c81-b535-c832f72d7bf2 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Refreshing instance network info cache due to event network-changed-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-408fe528-abe6-428e-b465-035fb2f23cda req-c94d3cb0-6e56-4c81-b535-c832f72d7bf2 service nova] Acquiring lock "refresh_cache-bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Updating instance_info_cache with network_info: [{"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Releasing lock "refresh_cache-bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Instance network_info: |[{"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-408fe528-abe6-428e-b465-035fb2f23cda req-c94d3cb0-6e56-4c81-b535-c832f72d7bf2 service nova] Acquired lock "refresh_cache-bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.network.neutron [req-408fe528-abe6-428e-b465-035fb2f23cda req-c94d3cb0-6e56-4c81-b535-c832f72d7bf2 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Refreshing network info cache for port 6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Start _get_guest_xml network_info=[{"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:07:20 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:07:20 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:07:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-539874617',display_name='tempest-tempest.common.compute-instance-539874617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-539874617',id=23,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxMZDJearrqT1wUGZvs3O52CzZfwP1GjFMeARj7hE5D0gbwuEL8g69EQlk0/Gaz87I7q8l13RwvXJO8/uCJGPJUARCdsIZV2q0Xn5wU6S7uMKYYqJ1LfnAJ/jSYJUWTQA==',key_name='tempest-keypair-1224381594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f011c1a70ac1465d8eb31e20850fdbad',ramdisk_id='',reservation_id='r-p5qweqeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1761792884',owner_user_name='tempest-ServerActionsTestOtherA-1761792884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:07:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3369c937ad24537a114a71eb4674750',uuid=bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converting VIF {"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:9c:c0,bridge_name='br-int',has_traffic_filtering=True,id=6a9c80ab-da5d-4fd5-b757-3c09fa3c1563,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c80ab-da') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.objects.instance [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lazy-loading 'pci_devices' on Instance uuid bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:07:20 user nova-compute[75021]:   <uuid>bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a</uuid>
Dec 06 07:07:20 user nova-compute[75021]:   <name>instance-00000017</name>
Dec 06 07:07:20 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:07:20 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:07:20 user nova-compute[75021]:   <metadata>
Dec 06 07:07:20 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:07:20 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:07:20 user nova-compute[75021]:       <nova:name>tempest-tempest.common.compute-instance-539874617</nova:name>
Dec 06 07:07:20 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:07:20</nova:creationTime>
Dec 06 07:07:20 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:07:20 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:07:20 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:07:20 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:07:20 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:07:20 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:07:20 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:07:20 user nova-compute[75021]:       <nova:owner>
Dec 06 07:07:20 user nova-compute[75021]:         <nova:user uuid="e3369c937ad24537a114a71eb4674750">tempest-ServerActionsTestOtherA-1761792884-project-member</nova:user>
Dec 06 07:07:20 user nova-compute[75021]:         <nova:project uuid="f011c1a70ac1465d8eb31e20850fdbad">tempest-ServerActionsTestOtherA-1761792884</nova:project>
Dec 06 07:07:20 user nova-compute[75021]:       </nova:owner>
Dec 06 07:07:20 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:07:20 user nova-compute[75021]:       <nova:ports>
Dec 06 07:07:20 user nova-compute[75021]:         <nova:port uuid="6a9c80ab-da5d-4fd5-b757-3c09fa3c1563">
Dec 06 07:07:20 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 07:07:20 user nova-compute[75021]:         </nova:port>
Dec 06 07:07:20 user nova-compute[75021]:       </nova:ports>
Dec 06 07:07:20 user nova-compute[75021]:     </nova:instance>
Dec 06 07:07:20 user nova-compute[75021]:   </metadata>
Dec 06 07:07:20 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:07:20 user nova-compute[75021]:     <system>
Dec 06 07:07:20 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:07:20 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:07:20 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:07:20 user nova-compute[75021]:       <entry name="serial">bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a</entry>
Dec 06 07:07:20 user nova-compute[75021]:       <entry name="uuid">bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a</entry>
Dec 06 07:07:20 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:07:20 user nova-compute[75021]:     </system>
Dec 06 07:07:20 user nova-compute[75021]:   </sysinfo>
Dec 06 07:07:20 user nova-compute[75021]:   <os>
Dec 06 07:07:20 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:07:20 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:07:20 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:07:20 user nova-compute[75021]:   </os>
Dec 06 07:07:20 user nova-compute[75021]:   <features>
Dec 06 07:07:20 user nova-compute[75021]:     <acpi/>
Dec 06 07:07:20 user nova-compute[75021]:     <apic/>
Dec 06 07:07:20 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:07:20 user nova-compute[75021]:   </features>
Dec 06 07:07:20 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:07:20 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:07:20 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:07:20 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:07:20 user nova-compute[75021]:   </clock>
Dec 06 07:07:20 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:07:20 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:07:20 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:07:20 user nova-compute[75021]:   </cpu>
Dec 06 07:07:20 user nova-compute[75021]:   <devices>
Dec 06 07:07:20 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:07:20 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:07:20 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk"/>
Dec 06 07:07:20 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:07:20 user nova-compute[75021]:     </disk>
Dec 06 07:07:20 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:07:20 user nova-compute[75021]:       <mac address="fa:16:3e:11:9c:c0"/>
Dec 06 07:07:20 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:07:20 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:07:20 user nova-compute[75021]:       <target dev="tap6a9c80ab-da"/>
Dec 06 07:07:20 user nova-compute[75021]:     </interface>
Dec 06 07:07:20 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:07:20 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/console.log" append="off"/>
Dec 06 07:07:20 user nova-compute[75021]:     </serial>
Dec 06 07:07:20 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:07:20 user nova-compute[75021]:     <video>
Dec 06 07:07:20 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:07:20 user nova-compute[75021]:     </video>
Dec 06 07:07:20 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:07:20 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:07:20 user nova-compute[75021]:     </rng>
Dec 06 07:07:20 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:07:20 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:07:20 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:07:20 user nova-compute[75021]:     </memballoon>
Dec 06 07:07:20 user nova-compute[75021]:   </devices>
Dec 06 07:07:20 user nova-compute[75021]: </domain>
Dec 06 07:07:20 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:07:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-539874617',display_name='tempest-tempest.common.compute-instance-539874617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-539874617',id=23,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxMZDJearrqT1wUGZvs3O52CzZfwP1GjFMeARj7hE5D0gbwuEL8g69EQlk0/Gaz87I7q8l13RwvXJO8/uCJGPJUARCdsIZV2q0Xn5wU6S7uMKYYqJ1LfnAJ/jSYJUWTQA==',key_name='tempest-keypair-1224381594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f011c1a70ac1465d8eb31e20850fdbad',ramdisk_id='',reservation_id='r-p5qweqeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1761792884',owner_user_name='tempest-ServerActionsTestOtherA-1761792884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:07:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3369c937ad24537a114a71eb4674750',uuid=bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converting VIF {"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:9c:c0,bridge_name='br-int',has_traffic_filtering=True,id=6a9c80ab-da5d-4fd5-b757-3c09fa3c1563,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c80ab-da') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG os_vif [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:9c:c0,bridge_name='br-int',has_traffic_filtering=True,id=6a9c80ab-da5d-4fd5-b757-3c09fa3c1563,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c80ab-da') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae4e008e-aa5c-593b-8206-d0f561fd5c7f', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a9c80ab-da, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a9c80ab-da, col_values=(('qos', UUID('2b9a0900-0e78-4e55-a7ef-a72a8069d92c')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a9c80ab-da, col_values=(('external_ids', {'iface-id': '6a9c80ab-da5d-4fd5-b757-3c09fa3c1563', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:9c:c0', 'vm-uuid': 'bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:07:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:20 user nova-compute[75021]: INFO os_vif [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:9c:c0,bridge_name='br-int',has_traffic_filtering=True,id=6a9c80ab-da5d-4fd5-b757-3c09fa3c1563,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c80ab-da')
Dec 06 07:07:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:07:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] No VIF found with MAC fa:16:3e:11:9c:c0, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:07:21 user nova-compute[75021]: DEBUG nova.network.neutron [req-408fe528-abe6-428e-b465-035fb2f23cda req-c94d3cb0-6e56-4c81-b535-c832f72d7bf2 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Updated VIF entry in instance network info cache for port 6a9c80ab-da5d-4fd5-b757-3c09fa3c1563. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:07:21 user nova-compute[75021]: DEBUG nova.network.neutron [req-408fe528-abe6-428e-b465-035fb2f23cda req-c94d3cb0-6e56-4c81-b535-c832f72d7bf2 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Updating instance_info_cache with network_info: [{"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:07:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-408fe528-abe6-428e-b465-035fb2f23cda req-c94d3cb0-6e56-4c81-b535-c832f72d7bf2 service nova] Releasing lock "refresh_cache-bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:07:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4026618-3e17-43e1-862e-a3bd1623788c req-7ad43c94-150b-4544-b89c-63a3e21da199 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received event network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4026618-3e17-43e1-862e-a3bd1623788c req-7ad43c94-150b-4544-b89c-63a3e21da199 service nova] Acquiring lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4026618-3e17-43e1-862e-a3bd1623788c req-7ad43c94-150b-4544-b89c-63a3e21da199 service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4026618-3e17-43e1-862e-a3bd1623788c req-7ad43c94-150b-4544-b89c-63a3e21da199 service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4026618-3e17-43e1-862e-a3bd1623788c req-7ad43c94-150b-4544-b89c-63a3e21da199 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] No waiting events found dispatching network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:07:22 user nova-compute[75021]: WARNING nova.compute.manager [req-d4026618-3e17-43e1-862e-a3bd1623788c req-7ad43c94-150b-4544-b89c-63a3e21da199 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received unexpected event network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 for instance with vm_state building and task_state spawning.
Dec 06 07:07:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:07:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:07:24 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Instance spawned successfully.
Dec 06 07:07:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:07:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-c6247bcb-cde6-431c-8e49-36c4cada1971 req-89da029b-ed23-419a-bfc2-ea2b2ed994b4 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received event network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c6247bcb-cde6-431c-8e49-36c4cada1971 req-89da029b-ed23-419a-bfc2-ea2b2ed994b4 service nova] Acquiring lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c6247bcb-cde6-431c-8e49-36c4cada1971 req-89da029b-ed23-419a-bfc2-ea2b2ed994b4 service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c6247bcb-cde6-431c-8e49-36c4cada1971 req-89da029b-ed23-419a-bfc2-ea2b2ed994b4 service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-c6247bcb-cde6-431c-8e49-36c4cada1971 req-89da029b-ed23-419a-bfc2-ea2b2ed994b4 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] No waiting events found dispatching network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:07:24 user nova-compute[75021]: WARNING nova.compute.manager [req-c6247bcb-cde6-431c-8e49-36c4cada1971 req-89da029b-ed23-419a-bfc2-ea2b2ed994b4 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received unexpected event network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 for instance with vm_state building and task_state spawning.
Dec 06 07:07:24 user nova-compute[75021]: INFO nova.compute.manager [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Took 5.69 seconds to spawn the instance on the hypervisor.
Dec 06 07:07:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:07:24 user nova-compute[75021]: INFO nova.compute.manager [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Took 6.55 seconds to build instance.
Dec 06 07:07:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ead10474-8798-4cce-91d4-c8295d4354bd tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.699s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uySvnlTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:07:27 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:07:27 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:07:27 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc0cf22-ab8a-41e8-8961-f192e71e798e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:07:27 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[320bad29-4749-44ce-ae4c-0b4180017d36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b] added
Dec 06 07:07:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[95658da2-4bc3-4be6-97a0-7e440ec6373e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[374604cd-fa32-4a31-b456-d79512b95071]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uySvnlTk {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uySvnlTk" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5830fabb-5a4c-4a98-93ed-1250ff58bc49]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uySvnlTk'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cb4b6c-4576-4e4f-908c-9a2172c8dfa1]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG nova.compute.manager [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6905992e-e717-4b3a-acaf-725b6a0db59e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[283574fb-f092-4d19-b00a-bd1373a07ccf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260]
Dec 06 07:07:27 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260] successful.
Dec 06 07:07:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b125ef0e-6c3b-4892-944f-601fb7ea4315]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:07:27 user nova-compute[75021]: INFO nova.compute.claims [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Claim successful on node user
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3348c6-8b3b-4d2b-ba98-c5e874a57d89]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:27 user nova-compute[75021]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:27 user nova-compute[75021]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[40218f0b-a0f4-49c9-961a-ffeacdfaf2a2]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:07:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uySvnlTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:07:28 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:07:28 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:07:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:07:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:07:28 user nova-compute[75021]: DEBUG nova.network.neutron [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:07:28 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:07:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:07:28 user nova-compute[75021]: DEBUG nova.policy [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0774aa1e3ee4b69b195b575d116ee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9895e43bf76d4760a26a5e64ea6d4e14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:07:28 user nova-compute[75021]: INFO nova.virt.block_device [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Booting with blank volume at /dev/vda
Dec 06 07:07:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:07:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23336393532306361', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:07:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336393532306361', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:07:28 user nova-compute[75021]: DEBUG nova.objects.instance [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lazy-loading 'flavor' on Instance uuid 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:07:28 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:07:28 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:07:28 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:07:28 user nova-compute[75021]:   <serial>16792f29-a35a-46ed-96e5-528d37062d8b</serial>
Dec 06 07:07:28 user nova-compute[75021]: </disk>
Dec 06 07:07:28 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:07:28 user nova-compute[75021]: DEBUG nova.network.neutron [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Successfully created port: a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] No VIF found with MAC fa:16:3e:83:ee:82, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-520e13d7-67da-45ba-9b2e-884fddffe791 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.293s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG nova.network.neutron [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Successfully updated port: a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquired lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG nova.network.neutron [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-98e3972d-3ff3-45b3-a239-e4c57803feb2 req-a7668a39-5904-4532-95bd-544fd506ee60 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received event network-changed-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-98e3972d-3ff3-45b3-a239-e4c57803feb2 req-a7668a39-5904-4532-95bd-544fd506ee60 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Refreshing instance network info cache due to event network-changed-a3831721-6988-44ee-89a6-35d80066e41b. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-98e3972d-3ff3-45b3-a239-e4c57803feb2 req-a7668a39-5904-4532-95bd-544fd506ee60 service nova] Acquiring lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG nova.network.neutron [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG nova.network.neutron [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Updating instance_info_cache with network_info: [{"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Releasing lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG nova.compute.manager [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Instance network_info: |[{"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-98e3972d-3ff3-45b3-a239-e4c57803feb2 req-a7668a39-5904-4532-95bd-544fd506ee60 service nova] Acquired lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:07:29 user nova-compute[75021]: DEBUG nova.network.neutron [req-98e3972d-3ff3-45b3-a239-e4c57803feb2 req-a7668a39-5904-4532-95bd-544fd506ee60 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Refreshing network info cache for port a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:07:30 user nova-compute[75021]: DEBUG nova.network.neutron [req-98e3972d-3ff3-45b3-a239-e4c57803feb2 req-a7668a39-5904-4532-95bd-544fd506ee60 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Updated VIF entry in instance network info cache for port a3831721-6988-44ee-89a6-35d80066e41b. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:07:30 user nova-compute[75021]: DEBUG nova.network.neutron [req-98e3972d-3ff3-45b3-a239-e4c57803feb2 req-a7668a39-5904-4532-95bd-544fd506ee60 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Updating instance_info_cache with network_info: [{"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:07:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-98e3972d-3ff3-45b3-a239-e4c57803feb2 req-a7668a39-5904-4532-95bd-544fd506ee60 service nova] Releasing lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:07:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:07:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:07:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:07:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:07:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG os_brick.utils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4af54e7-dc58-4e5c-bc78-effafab946a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab89dd72-bb93-4d49-8dd2-ee7a16102936]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c86552c-3add-45f8-8dd5-89a39cf1f7d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ad7940-bbde-4d11-91a6-30a3a6c4cb28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:07:33 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:07:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[97491595-0439-4dd6-9628-6338dc56f937]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG os_brick.utils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:07:33 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Updating existing volume attachment record: d70a7a65-5737-420a-97a7-68cb015fcb06 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-b7ed5646-d4cd-44e8-bffe-e4229cd6ce6e req-23c34092-f5c4-4a11-a72a-6a2f0d29499b service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Received event network-changed-541e273b-cc24-4f3c-bec6-f8f6f583dd31 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-b7ed5646-d4cd-44e8-bffe-e4229cd6ce6e req-23c34092-f5c4-4a11-a72a-6a2f0d29499b service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Refreshing instance network info cache due to event network-changed-541e273b-cc24-4f3c-bec6-f8f6f583dd31. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b7ed5646-d4cd-44e8-bffe-e4229cd6ce6e req-23c34092-f5c4-4a11-a72a-6a2f0d29499b service nova] Acquiring lock "refresh_cache-430c2ff8-2b09-43e8-b27e-caf8153ff892" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b7ed5646-d4cd-44e8-bffe-e4229cd6ce6e req-23c34092-f5c4-4a11-a72a-6a2f0d29499b service nova] Acquired lock "refresh_cache-430c2ff8-2b09-43e8-b27e-caf8153ff892" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-b7ed5646-d4cd-44e8-bffe-e4229cd6ce6e req-23c34092-f5c4-4a11-a72a-6a2f0d29499b service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Refreshing network info cache for port 541e273b-cc24-4f3c-bec6-f8f6f583dd31 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "430c2ff8-2b09-43e8-b27e-caf8153ff892" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG nova.objects.instance [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lazy-loading 'flavor' on Instance uuid 430c2ff8-2b09-43e8-b27e-caf8153ff892 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:34 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Ignoring supplied device name: /dev/vdb
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "430c2ff8-2b09-43e8-b27e-caf8153ff892" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:34 user nova-compute[75021]: INFO nova.compute.manager [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Attaching volume 0b811bd4-8223-46da-8b48-aa0af240b4f0 to /dev/vdb
Dec 06 07:07:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-b7ed5646-d4cd-44e8-bffe-e4229cd6ce6e req-23c34092-f5c4-4a11-a72a-6a2f0d29499b service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Updated VIF entry in instance network info cache for port 541e273b-cc24-4f3c-bec6-f8f6f583dd31. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-b7ed5646-d4cd-44e8-bffe-e4229cd6ce6e req-23c34092-f5c4-4a11-a72a-6a2f0d29499b service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Updating instance_info_cache with network_info: [{"id": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "address": "fa:16:3e:61:ae:ea", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541e273b-cc", "ovs_interfaceid": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b7ed5646-d4cd-44e8-bffe-e4229cd6ce6e req-23c34092-f5c4-4a11-a72a-6a2f0d29499b service nova] Releasing lock "refresh_cache-430c2ff8-2b09-43e8-b27e-caf8153ff892" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG os_brick.utils [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.035s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0317ea-ceef-4cf2-86b2-6a33256c467e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ce126b-3481-4ce5-aa90-0d86b9735c46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74c6708-af04-4a76-a70e-435c090c4af9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[af54b9b4-875b-4047-bab9-20f2d27a5b09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:07:34 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:07:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[053e7269-ac97-469b-954c-173a047d3dee]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG os_brick.utils [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:07:34 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Updating existing volume attachment record: 92f0b79d-0d9f-46f8-9a5e-b37e8245e499 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:07:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-13cdf76b-53e7-46c8-aa55-dd78b5a5cf8c req-d7d69a1d-0d49-42ee-ad0b-3f57160a6dfd service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received event network-changed-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-13cdf76b-53e7-46c8-aa55-dd78b5a5cf8c req-d7d69a1d-0d49-42ee-ad0b-3f57160a6dfd service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Refreshing instance network info cache due to event network-changed-c77514ad-438b-4d06-8f57-a363cde54e16. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:07:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-13cdf76b-53e7-46c8-aa55-dd78b5a5cf8c req-d7d69a1d-0d49-42ee-ad0b-3f57160a6dfd service nova] Acquiring lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:07:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-13cdf76b-53e7-46c8-aa55-dd78b5a5cf8c req-d7d69a1d-0d49-42ee-ad0b-3f57160a6dfd service nova] Acquired lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:07:37 user nova-compute[75021]: DEBUG nova.network.neutron [req-13cdf76b-53e7-46c8-aa55-dd78b5a5cf8c req-d7d69a1d-0d49-42ee-ad0b-3f57160a6dfd service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Refreshing network info cache for port c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:07:38 user nova-compute[75021]: DEBUG nova.network.neutron [req-13cdf76b-53e7-46c8-aa55-dd78b5a5cf8c req-d7d69a1d-0d49-42ee-ad0b-3f57160a6dfd service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Updated VIF entry in instance network info cache for port c77514ad-438b-4d06-8f57-a363cde54e16. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:07:38 user nova-compute[75021]: DEBUG nova.network.neutron [req-13cdf76b-53e7-46c8-aa55-dd78b5a5cf8c req-d7d69a1d-0d49-42ee-ad0b-3f57160a6dfd service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Updating instance_info_cache with network_info: [{"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:07:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-13cdf76b-53e7-46c8-aa55-dd78b5a5cf8c req-d7d69a1d-0d49-42ee-ad0b-3f57160a6dfd service nova] Releasing lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:07:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-c5786728-19f5-4ffe-86d1-dee768d68515 req-16f166f6-b596-431c-8b26-f1c85ff21017 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received event network-changed-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-c5786728-19f5-4ffe-86d1-dee768d68515 req-16f166f6-b596-431c-8b26-f1c85ff21017 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Refreshing instance network info cache due to event network-changed-c77514ad-438b-4d06-8f57-a363cde54e16. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:07:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c5786728-19f5-4ffe-86d1-dee768d68515 req-16f166f6-b596-431c-8b26-f1c85ff21017 service nova] Acquiring lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:07:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c5786728-19f5-4ffe-86d1-dee768d68515 req-16f166f6-b596-431c-8b26-f1c85ff21017 service nova] Acquired lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:07:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-c5786728-19f5-4ffe-86d1-dee768d68515 req-16f166f6-b596-431c-8b26-f1c85ff21017 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Refreshing network info cache for port c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:07:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-c5786728-19f5-4ffe-86d1-dee768d68515 req-16f166f6-b596-431c-8b26-f1c85ff21017 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Updated VIF entry in instance network info cache for port c77514ad-438b-4d06-8f57-a363cde54e16. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:07:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-c5786728-19f5-4ffe-86d1-dee768d68515 req-16f166f6-b596-431c-8b26-f1c85ff21017 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Updating instance_info_cache with network_info: [{"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:07:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c5786728-19f5-4ffe-86d1-dee768d68515 req-16f166f6-b596-431c-8b26-f1c85ff21017 service nova] Releasing lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:07:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:42 user nova-compute[75021]: DEBUG nova.objects.instance [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lazy-loading 'flavor' on Instance uuid 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:42 user nova-compute[75021]: INFO nova.compute.manager [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Attaching volume c415fdf2-6f39-4723-a317-386f933cb045 to /dev/vdb
Dec 06 07:07:43 user nova-compute[75021]: DEBUG os_brick.utils [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aea8e6-ae2b-43dc-8af8-5f1ac021dad5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[233f0eef-5786-401b-9807-af2f1cb9e6d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9438f014-0e01-4692-9299-2614f9dfe0b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[596cd126-0e8d-4ff2-aa64-7d647cc744ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:07:43 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:07:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[121096ab-6b1e-4d14-8161-17abde71eb4d]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG os_brick.utils [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Updating existing volume attachment record: d8fcf05f-1a84-4587-9787-c300f51dc0fe {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:07:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:07:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Creating image(s)
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Ensure instance console log exists: /opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Start _get_guest_xml network_info=[{"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd70a7a65-5737-420a-97a7-68cb015fcb06', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujAilWOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '828f5456-6310-4664-87b3-ee0ed6787d3f', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5a03d75-07a1-4973-9127-073695e5fa44', 'serial': 'f5a03d75-07a1-4973-9127-073695e5fa44'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:07:45 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:07:45 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujAilWOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:07:45 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:07:45 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:07:45 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquiring lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquiring lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:45 user nova-compute[75021]: INFO nova.compute.manager [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Terminating instance
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "8b8eb320-6348-4038-a57e-02bf1e015174" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56cf391-4e26-40b1-9b1e-cebf6b6694fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:07:45 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a1b135-a6ff-4d3c-920a-cce7df8a03b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44] added
Dec 06 07:07:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e144972a-544f-4531-8041-ce8cda5d25a2]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5f60f3-9175-4b21-90ce-90d46b4a1eca]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ujAilWOc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ujAilWOc" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dc1b87-342a-4427-9e5a-98dd2319bf4f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ujAilWOc'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d74be62-e276-4514-b6bb-d1c7598bb467]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c74669-2187-49cd-afce-89156e9c2ac0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:45 user nova-compute[75021]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:45 user nova-compute[75021]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:07:45 user nova-compute[75021]: INFO nova.compute.claims [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Claim successful on node user
Dec 06 07:07:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0506c400-87da-46a5-8c5b-e96f2a45af82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44, portal: 172.16.0.220,3260]
Dec 06 07:07:45 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44, portal: 172.16.0.220,3260] successful.
Dec 06 07:07:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c941026-3240-4764-96b4-f5b7503cc794]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b527be-aac5-43e1-b240-1ad38b30b5f1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:45 user nova-compute[75021]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:45 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:45 user nova-compute[75021]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:45 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75cd9d7-3a73-45d3-8202-376ddba50b2f]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujAilWOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYEiwapg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:07:45 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:07:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-4bff5e9f-db91-456d-9447-5ddd0470d730 req-d39f318e-22ae-4c11-8812-b95cfe95e99f service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Received event network-vif-unplugged-b51652b3-d921-4e2b-9b19-57064192e1fa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4bff5e9f-db91-456d-9447-5ddd0470d730 req-d39f318e-22ae-4c11-8812-b95cfe95e99f service nova] Acquiring lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4bff5e9f-db91-456d-9447-5ddd0470d730 req-d39f318e-22ae-4c11-8812-b95cfe95e99f service nova] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4bff5e9f-db91-456d-9447-5ddd0470d730 req-d39f318e-22ae-4c11-8812-b95cfe95e99f service nova] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-4bff5e9f-db91-456d-9447-5ddd0470d730 req-d39f318e-22ae-4c11-8812-b95cfe95e99f service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] No waiting events found dispatching network-vif-unplugged-b51652b3-d921-4e2b-9b19-57064192e1fa {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-4bff5e9f-db91-456d-9447-5ddd0470d730 req-d39f318e-22ae-4c11-8812-b95cfe95e99f service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Received event network-vif-unplugged-b51652b3-d921-4e2b-9b19-57064192e1fa for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:45 user nova-compute[75021]: INFO nova.compute.manager [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Rebooting instance
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:07:46 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Instance destroyed successfully.
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.objects.instance [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lazy-loading 'resources' on Instance uuid 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-389833196',display_name='tempest-TestVolumeSwap-server-389833196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-389833196',id=17,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE53n2PdH954cItpSeePpt6kEwu4QgmZwO3vkGn0e9ZTbv2WbzipYDjiIa6qU9HqkgPBhS/ieE4VPdNgPK4MgeenBcEnEka+vJEmLM99E0sbCOjPRupmLYwjk4etAR653Q==',key_name='tempest-keypair-1099938136',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:04:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9b8ff637e4c4e459bd698cc2c8341f6',ramdisk_id='',reservation_id='r-6a0yb8z8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1030559181',owner_user_name='tempest-TestVolumeSwap-1030559181-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20baad167088455fbc6e027a6c679468',uuid=9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b51652b3-d921-4e2b-9b19-57064192e1fa", "address": "fa:16:3e:ff:0c:16", "network": {"id": "5f9c0afd-2c38-4f2a-8f56-11d0b016a438", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2085203827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b8ff637e4c4e459bd698cc2c8341f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51652b3-d9", "ovs_interfaceid": "b51652b3-d921-4e2b-9b19-57064192e1fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Converting VIF {"id": "b51652b3-d921-4e2b-9b19-57064192e1fa", "address": "fa:16:3e:ff:0c:16", "network": {"id": "5f9c0afd-2c38-4f2a-8f56-11d0b016a438", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2085203827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b8ff637e4c4e459bd698cc2c8341f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb51652b3-d9", "ovs_interfaceid": "b51652b3-d921-4e2b-9b19-57064192e1fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:0c:16,bridge_name='br-int',has_traffic_filtering=True,id=b51652b3-d921-4e2b-9b19-57064192e1fa,network=Network(5f9c0afd-2c38-4f2a-8f56-11d0b016a438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51652b3-d9') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG os_vif [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:0c:16,bridge_name='br-int',has_traffic_filtering=True,id=b51652b3-d921-4e2b-9b19-57064192e1fa,network=Network(5f9c0afd-2c38-4f2a-8f56-11d0b016a438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51652b3-d9') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb51652b3-d9, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc4daa6b-a1ec-4794-97f1-07d801ee7d5b) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.689s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:07:46 user nova-compute[75021]: INFO os_vif [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:0c:16,bridge_name='br-int',has_traffic_filtering=True,id=b51652b3-d921-4e2b-9b19-57064192e1fa,network=Network(5f9c0afd-2c38-4f2a-8f56-11d0b016a438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb51652b3-d9')
Dec 06 07:07:46 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Deleting instance files /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f_del
Dec 06 07:07:46 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Deletion of /opt/stack/data/nova/instances/9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f_del complete
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquired lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.network.neutron [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:07:46 user nova-compute[75021]: INFO nova.compute.manager [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Took 0.95 seconds to destroy the instance on the hypervisor.
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:07:46 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.policy [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6d8114db9fa47c09bc9675da9e19a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d3fb6e885546bd9660c81fac9cfa12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:07:46 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Creating image(s)
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "/opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "/opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23032313031336662', 'path': '/dev/sdd'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032313031336662', 'path': '/dev/sdd'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.996s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:07:46 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:07:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:07:46 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cbc625-4be1-4295-8cf6-a9c495644ece]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:07:46 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1548788729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1548788729',id=24,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9895e43bf76d4760a26a5e64ea6d4e14',ramdisk_id='',reservation_id='r-papxt6p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:07:28Z,user_data=None,user_id='c0774aa1e3ee4b69b195b575d116ee96',uuid=828f5456-6310-4664-87b3-ee0ed6787d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converting VIF {"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:ed:50,bridge_name='br-int',has_traffic_filtering=True,id=a3831721-6988-44ee-89a6-35d80066e41b,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3831721-69') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.objects.instance [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'pci_devices' on Instance uuid 828f5456-6310-4664-87b3-ee0ed6787d3f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adee2bf-6068-42fa-bf0c-f1f9f6af926f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.network.neutron [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Updating instance_info_cache with network_info: [{"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0] added
Dec 06 07:07:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:07:46 user nova-compute[75021]:   <uuid>828f5456-6310-4664-87b3-ee0ed6787d3f</uuid>
Dec 06 07:07:46 user nova-compute[75021]:   <name>instance-00000018</name>
Dec 06 07:07:46 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:07:46 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:07:46 user nova-compute[75021]:   <metadata>
Dec 06 07:07:46 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:07:46 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:07:46 user nova-compute[75021]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1548788729</nova:name>
Dec 06 07:07:46 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:07:45</nova:creationTime>
Dec 06 07:07:46 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:07:46 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:07:46 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:07:46 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:07:46 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:07:46 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:07:46 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:07:46 user nova-compute[75021]:       <nova:owner>
Dec 06 07:07:46 user nova-compute[75021]:         <nova:user uuid="c0774aa1e3ee4b69b195b575d116ee96">tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member</nova:user>
Dec 06 07:07:46 user nova-compute[75021]:         <nova:project uuid="9895e43bf76d4760a26a5e64ea6d4e14">tempest-ServerBootFromVolumeStableRescueTest-1272250883</nova:project>
Dec 06 07:07:46 user nova-compute[75021]:       </nova:owner>
Dec 06 07:07:46 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:07:46 user nova-compute[75021]:       <nova:ports>
Dec 06 07:07:46 user nova-compute[75021]:         <nova:port uuid="a3831721-6988-44ee-89a6-35d80066e41b">
Dec 06 07:07:46 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 07:07:46 user nova-compute[75021]:         </nova:port>
Dec 06 07:07:46 user nova-compute[75021]:       </nova:ports>
Dec 06 07:07:46 user nova-compute[75021]:     </nova:instance>
Dec 06 07:07:46 user nova-compute[75021]:   </metadata>
Dec 06 07:07:46 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:07:46 user nova-compute[75021]:     <system>
Dec 06 07:07:46 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:07:46 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:07:46 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:07:46 user nova-compute[75021]:       <entry name="serial">828f5456-6310-4664-87b3-ee0ed6787d3f</entry>
Dec 06 07:07:46 user nova-compute[75021]:       <entry name="uuid">828f5456-6310-4664-87b3-ee0ed6787d3f</entry>
Dec 06 07:07:46 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:07:46 user nova-compute[75021]:     </system>
Dec 06 07:07:46 user nova-compute[75021]:   </sysinfo>
Dec 06 07:07:46 user nova-compute[75021]:   <os>
Dec 06 07:07:46 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:07:46 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:07:46 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:07:46 user nova-compute[75021]:   </os>
Dec 06 07:07:46 user nova-compute[75021]:   <features>
Dec 06 07:07:46 user nova-compute[75021]:     <acpi/>
Dec 06 07:07:46 user nova-compute[75021]:     <apic/>
Dec 06 07:07:46 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:07:46 user nova-compute[75021]:   </features>
Dec 06 07:07:46 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:07:46 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:07:46 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:07:46 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:07:46 user nova-compute[75021]:   </clock>
Dec 06 07:07:46 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:07:46 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:07:46 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:07:46 user nova-compute[75021]:   </cpu>
Dec 06 07:07:46 user nova-compute[75021]:   <devices>
Dec 06 07:07:46 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:07:46 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:07:46 user nova-compute[75021]:       <source dev="/dev/sdd"/>
Dec 06 07:07:46 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:07:46 user nova-compute[75021]:       <serial>f5a03d75-07a1-4973-9127-073695e5fa44</serial>
Dec 06 07:07:46 user nova-compute[75021]:     </disk>
Dec 06 07:07:46 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:07:46 user nova-compute[75021]:       <mac address="fa:16:3e:ba:ed:50"/>
Dec 06 07:07:46 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:07:46 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:07:46 user nova-compute[75021]:       <target dev="tapa3831721-69"/>
Dec 06 07:07:46 user nova-compute[75021]:     </interface>
Dec 06 07:07:46 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:07:46 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/console.log" append="off"/>
Dec 06 07:07:46 user nova-compute[75021]:     </serial>
Dec 06 07:07:46 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:07:46 user nova-compute[75021]:     <video>
Dec 06 07:07:46 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:07:46 user nova-compute[75021]:     </video>
Dec 06 07:07:46 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:07:46 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:07:46 user nova-compute[75021]:     </rng>
Dec 06 07:07:46 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:07:46 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:07:46 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:07:46 user nova-compute[75021]:     </memballoon>
Dec 06 07:07:46 user nova-compute[75021]:   </devices>
Dec 06 07:07:46 user nova-compute[75021]: </domain>
Dec 06 07:07:46 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1548788729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1548788729',id=24,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9895e43bf76d4760a26a5e64ea6d4e14',ramdisk_id='',reservation_id='r-papxt6p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:07:28Z,user_data=None,user_id='c0774aa1e3ee4b69b195b575d116ee96',uuid=828f5456-6310-4664-87b3-ee0ed6787d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converting VIF {"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:ed:50,bridge_name='br-int',has_traffic_filtering=True,id=a3831721-6988-44ee-89a6-35d80066e41b,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3831721-69') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG os_vif [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:ed:50,bridge_name='br-int',has_traffic_filtering=True,id=a3831721-6988-44ee-89a6-35d80066e41b,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3831721-69') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'acd2362f-85e7-58ef-923a-1b1ef521b42d', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc7599f-20bf-4e60-9b30-1c874442538b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Releasing lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3831721-69, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3831721-69, col_values=(('qos', UUID('6c8b62fd-88e5-48d2-a0bd-d2d7dd973433')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3831721-69, col_values=(('external_ids', {'iface-id': 'a3831721-6988-44ee-89a6-35d80066e41b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:ed:50', 'vm-uuid': '828f5456-6310-4664-87b3-ee0ed6787d3f'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a497af3c-1ba4-4cf0-85e1-568fe32a030f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kYEiwapg {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:46 user nova-compute[75021]: INFO os_vif [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:ed:50,bridge_name='br-int',has_traffic_filtering=True,id=a3831721-6988-44ee-89a6-35d80066e41b,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3831721-69')
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.195s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kYEiwapg" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27ed6c2-519f-4861-93f8-64a8faa7ac8f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kYEiwapg'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk 1073741824" returned: 0 in 0.066s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94c8873-f9fc-473f-962f-9d0afe5002cd]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] No VIF found with MAC fa:16:3e:ba:ed:50, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[664ff246-2d33-4d07-8053-6c355d38dedb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:46 user nova-compute[75021]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:46 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:46 user nova-compute[75021]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:46 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:07:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.111s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9223a5d9-2f33-47ae-842d-2ac307a29095]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0, portal: 172.16.0.220,3260]
Dec 06 07:07:47 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0, portal: 172.16.0.220,3260] successful.
Dec 06 07:07:47 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e61f84-9a17-4f22-a62b-da41b03cbb22]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.268s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[542e3575-a06c-4e0c-864a-78753c872667]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:47 user nova-compute[75021]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:47 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:47 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:07:47 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:47 user nova-compute[75021]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:47 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:47 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:07:47 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.552s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-4de6cf7f-2f22-4b82-b2fa-9d7f5123d943 req-cc2eb287-a983-4ad7-a49b-1d3672abb1de service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Received event network-vif-deleted-b51652b3-d921-4e2b-9b19-57064192e1fa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:47 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Took 0.99 seconds to deallocate network for instance.
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[238cdc62-3ad6-4227-8b09-a164ace499ba]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYEiwapg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Cannot resize image /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Ensure instance console log exists: /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Successfully created port: 2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-7a6eea7a-f944-4276-96c0-474368eac920 req-98bfd949-7323-4df9-b4ea-8eae34536d85 service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Received event network-vif-plugged-b51652b3-d921-4e2b-9b19-57064192e1fa {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7a6eea7a-f944-4276-96c0-474368eac920 req-98bfd949-7323-4df9-b4ea-8eae34536d85 service nova] Acquiring lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7a6eea7a-f944-4276-96c0-474368eac920 req-98bfd949-7323-4df9-b4ea-8eae34536d85 service nova] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7a6eea7a-f944-4276-96c0-474368eac920 req-98bfd949-7323-4df9-b4ea-8eae34536d85 service nova] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-7a6eea7a-f944-4276-96c0-474368eac920 req-98bfd949-7323-4df9-b4ea-8eae34536d85 service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] No waiting events found dispatching network-vif-plugged-b51652b3-d921-4e2b-9b19-57064192e1fa {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:07:47 user nova-compute[75021]: WARNING nova.compute.manager [req-7a6eea7a-f944-4276-96c0-474368eac920 req-98bfd949-7323-4df9-b4ea-8eae34536d85 service nova] [instance: 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f] Received unexpected event network-vif-plugged-b51652b3-d921-4e2b-9b19-57064192e1fa for instance with vm_state deleted and task_state None.
Dec 06 07:07:47 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:07:47 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.770s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:48 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Deleted allocations for instance 9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.600s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] <== connect_volume: return (2596ms) {'type': 'block', 'scsi_wwn': '26261353565326465', 'path': '/dev/sde'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261353565326465', 'path': '/dev/sde'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.objects.instance [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lazy-loading 'flavor' on Instance uuid 430c2ff8-2b09-43e8-b27e-caf8153ff892 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0cf1c265-3110-48e5-81e5-ee5d026b03f3 tempest-TestVolumeSwap-1030559181 tempest-TestVolumeSwap-1030559181-project-member] Lock "9e0b57f6-c6a1-48b9-9aa3-fdd09ef4a84f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.020s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:07:48 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:07:48 user nova-compute[75021]:   <source dev="/dev/sde"/>
Dec 06 07:07:48 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:07:48 user nova-compute[75021]:   <serial>0b811bd4-8223-46da-8b48-aa0af240b4f0</serial>
Dec 06 07:07:48 user nova-compute[75021]: </disk>
Dec 06 07:07:48 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:48 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Instance destroyed successfully.
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.objects.instance [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lazy-loading 'resources' on Instance uuid 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-53112281',display_name='tempest-TestMinimumBasicScenario-server-53112281',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-53112281',id=20,image_ref='53dd9568-7f3d-4c0f-a801-063320e5c6f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuSxZ13dd2/D7B877ZWXS1jgKRAmPhYOOiZJqhiReoBkb0kLSmdhOf4HykOJNldZ0vI0Uy/O1Rx4zDUeAdlHthJ4IX17YF8zgnD4tXiI5C/mOzfszeWX675LXbee/bjNA==',key_name='tempest-TestMinimumBasicScenario-1870415575',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:05:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78e36b4acada439db308e5e816dbf9a7',ramdisk_id='',reservation_id='r-59xfjdud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53dd9568-7f3d-4c0f-a801-063320e5c6f8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-757290889',owner_user_name='tempest-TestMinimumBasicScenario-757290889-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:07:47Z,user_data=None,user_id='24f231f563c345b48a998200dbf1384a',uuid=42b43ca7-a0fb-4811-b91b-2ecce2b7fb02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converting VIF {"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:ee:82,bridge_name='br-int',has_traffic_filtering=True,id=c77514ad-438b-4d06-8f57-a363cde54e16,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77514ad-43') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_vif [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:ee:82,bridge_name='br-int',has_traffic_filtering=True,id=c77514ad-438b-4d06-8f57-a363cde54e16,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77514ad-43') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc77514ad-43, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccde2534-8306-4452-8aee-1f4ab3fd147a) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:48 user nova-compute[75021]: INFO os_vif [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:ee:82,bridge_name='br-int',has_traffic_filtering=True,id=c77514ad-438b-4d06-8f57-a363cde54e16,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77514ad-43')
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uySvnlTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:07:48 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Successfully updated port: 2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquired lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37a5d95-97f8-47b2-b41e-af70f8288492]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:07:48 user nova-compute[75021]: No targets found.
Dec 06 07:07:48 user nova-compute[75021]: iSNS:
Dec 06 07:07:48 user nova-compute[75021]: No targets found.
Dec 06 07:07:48 user nova-compute[75021]: STATIC:
Dec 06 07:07:48 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b
Dec 06 07:07:48 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:07:48 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:07:48 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635
Dec 06 07:07:48 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:07:48 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:07:48 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:07:48 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:07:48 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:07:48 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0
Dec 06 07:07:48 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:07:48 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:07:48 user nova-compute[75021]: FIRMWARE:
Dec 06 07:07:48 user nova-compute[75021]: No targets found.
Dec 06 07:07:48 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:07:48 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:07:48 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b045929f-79e0-4ffa-b506-cd3a4834ffdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-19969aae-1376-4d5a-ba17-b49c34c58b61 req-1440a139-f371-41be-81ab-9d45bb401978 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-changed-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-19969aae-1376-4d5a-ba17-b49c34c58b61 req-1440a139-f371-41be-81ab-9d45bb401978 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Refreshing instance network info cache due to event network-changed-2d2bc1b9-24cd-4992-93a5-e3638e21a35e. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-19969aae-1376-4d5a-ba17-b49c34c58b61 req-1440a139-f371-41be-81ab-9d45bb401978 service nova] Acquiring lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[711d3e61-1196-4416-ba34-031e307adca9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:48 user nova-compute[75021]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:48 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:48 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:07:48 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:48 user nova-compute[75021]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:48 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:48 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:07:48 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b47f0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[21540d6a-1b64-4f4f-bbe4-badeda500b79]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41219dc-3e0b-4980-88b4-a1814e09ffd5]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[559a3e8f-957d-45fc-9f1b-18a5086881fb]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdee2427-1a78-4ac5-a4a3-12c8141dce12]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f825ef2-9ab8-45a9-97c1-783b693168e4]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[982ee638-2c36-46d8-9d96-ad85868886bf]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260]
Dec 06 07:07:48 user nova-compute[75021]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260] successful.
Dec 06 07:07:48 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] No VIF found with MAC fa:16:3e:61:ae:ea, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb8f20d-c3f2-4e69-a213-65154fff41ac]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] <== disconnect_volume: return (370ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Start _get_guest_xml network_info=[{"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=53dd9568-7f3d-4c0f-a801-063320e5c6f8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': '53dd9568-7f3d-4c0f-a801-063320e5c6f8'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '84f37bf3-2622-444c-ad9c-6d1139863b49', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uySvnlTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '42b43ca7-a0fb-4811-b91b-2ecce2b7fb02', 'attached_at': '', 'detached_at': '', 'volume_id': '16792f29-a35a-46ed-96e5-528d37062d8b', 'serial': '16792f29-a35a-46ed-96e5-528d37062d8b'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:07:48 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:07:48 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=53dd9568-7f3d-4c0f-a801-063320e5c6f8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:07:48 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.objects.instance [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lazy-loading 'vcpu_model' on Instance uuid 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Updating instance_info_cache with network_info: [{"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.objects.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Object Instance<42b43ca7-a0fb-4811-b91b-2ecce2b7fb02> lazy-loaded attributes: resources,vcpu_model {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uySvnlTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:07:49 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:07:49 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:07:49 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Releasing lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Instance network_info: |[{"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-19969aae-1376-4d5a-ba17-b49c34c58b61 req-1440a139-f371-41be-81ab-9d45bb401978 service nova] Acquired lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-19969aae-1376-4d5a-ba17-b49c34c58b61 req-1440a139-f371-41be-81ab-9d45bb401978 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Refreshing network info cache for port 2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Start _get_guest_xml network_info=[{"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:07:49 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:07:49 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3495b2f-a7c5-4273-b847-beda205adca0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:07:49 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-699999378',display_name='tempest-ServerRescueNegativeTestJSON-server-699999378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-699999378',id=25,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrrx+YwFNghcFUjqpJOY9cNZNxR7XuyO+lbBn8nBbazUK41wZJQ+nseUHYDKzbfDjsiE9koMmTXhvVI4jne/Z5jMNRtJnHZ99FwlNfe8/CQ9L6WSSjfybYcI9DYbCC3Tw==',key_name='tempest-keypair-835634634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43d3fb6e885546bd9660c81fac9cfa12',ramdisk_id='',reservation_id='r-2ue4rtaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-674134420',owner_user_name='tempest-ServerRescueNegativeTestJSON-674134420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:07:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6d8114db9fa47c09bc9675da9e19a8c',uuid=8b8eb320-6348-4038-a57e-02bf1e015174,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converting VIF {"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:90:87,bridge_name='br-int',has_traffic_filtering=True,id=2d2bc1b9-24cd-4992-93a5-e3638e21a35e,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bc1b9-24') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b8eb320-6348-4038-a57e-02bf1e015174 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc84cf4-a00d-4530-806c-260d35f3c466]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b] added
Dec 06 07:07:49 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:07:49 user nova-compute[75021]:   <uuid>8b8eb320-6348-4038-a57e-02bf1e015174</uuid>
Dec 06 07:07:49 user nova-compute[75021]:   <name>instance-00000019</name>
Dec 06 07:07:49 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:07:49 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:07:49 user nova-compute[75021]:   <metadata>
Dec 06 07:07:49 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:07:49 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:07:49 user nova-compute[75021]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-699999378</nova:name>
Dec 06 07:07:49 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:07:49</nova:creationTime>
Dec 06 07:07:49 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:07:49 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:07:49 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:07:49 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:07:49 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:07:49 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:07:49 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:07:49 user nova-compute[75021]:       <nova:owner>
Dec 06 07:07:49 user nova-compute[75021]:         <nova:user uuid="e6d8114db9fa47c09bc9675da9e19a8c">tempest-ServerRescueNegativeTestJSON-674134420-project-member</nova:user>
Dec 06 07:07:49 user nova-compute[75021]:         <nova:project uuid="43d3fb6e885546bd9660c81fac9cfa12">tempest-ServerRescueNegativeTestJSON-674134420</nova:project>
Dec 06 07:07:49 user nova-compute[75021]:       </nova:owner>
Dec 06 07:07:49 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:07:49 user nova-compute[75021]:       <nova:ports>
Dec 06 07:07:49 user nova-compute[75021]:         <nova:port uuid="2d2bc1b9-24cd-4992-93a5-e3638e21a35e">
Dec 06 07:07:49 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 07:07:49 user nova-compute[75021]:         </nova:port>
Dec 06 07:07:49 user nova-compute[75021]:       </nova:ports>
Dec 06 07:07:49 user nova-compute[75021]:     </nova:instance>
Dec 06 07:07:49 user nova-compute[75021]:   </metadata>
Dec 06 07:07:49 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:07:49 user nova-compute[75021]:     <system>
Dec 06 07:07:49 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:07:49 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:07:49 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:07:49 user nova-compute[75021]:       <entry name="serial">8b8eb320-6348-4038-a57e-02bf1e015174</entry>
Dec 06 07:07:49 user nova-compute[75021]:       <entry name="uuid">8b8eb320-6348-4038-a57e-02bf1e015174</entry>
Dec 06 07:07:49 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:07:49 user nova-compute[75021]:     </system>
Dec 06 07:07:49 user nova-compute[75021]:   </sysinfo>
Dec 06 07:07:49 user nova-compute[75021]:   <os>
Dec 06 07:07:49 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:07:49 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:07:49 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:07:49 user nova-compute[75021]:   </os>
Dec 06 07:07:49 user nova-compute[75021]:   <features>
Dec 06 07:07:49 user nova-compute[75021]:     <acpi/>
Dec 06 07:07:49 user nova-compute[75021]:     <apic/>
Dec 06 07:07:49 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:07:49 user nova-compute[75021]:   </features>
Dec 06 07:07:49 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:07:49 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:07:49 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:07:49 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:07:49 user nova-compute[75021]:   </clock>
Dec 06 07:07:49 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:07:49 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:07:49 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:07:49 user nova-compute[75021]:   </cpu>
Dec 06 07:07:49 user nova-compute[75021]:   <devices>
Dec 06 07:07:49 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:07:49 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:07:49 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk"/>
Dec 06 07:07:49 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:07:49 user nova-compute[75021]:     </disk>
Dec 06 07:07:49 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:07:49 user nova-compute[75021]:       <mac address="fa:16:3e:86:90:87"/>
Dec 06 07:07:49 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:07:49 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:07:49 user nova-compute[75021]:       <target dev="tap2d2bc1b9-24"/>
Dec 06 07:07:49 user nova-compute[75021]:     </interface>
Dec 06 07:07:49 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:07:49 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/console.log" append="off"/>
Dec 06 07:07:49 user nova-compute[75021]:     </serial>
Dec 06 07:07:49 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:07:49 user nova-compute[75021]:     <video>
Dec 06 07:07:49 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:07:49 user nova-compute[75021]:     </video>
Dec 06 07:07:49 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:07:49 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:07:49 user nova-compute[75021]:     </rng>
Dec 06 07:07:49 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:07:49 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:07:49 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:07:49 user nova-compute[75021]:     </memballoon>
Dec 06 07:07:49 user nova-compute[75021]:   </devices>
Dec 06 07:07:49 user nova-compute[75021]: </domain>
Dec 06 07:07:49 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-699999378',display_name='tempest-ServerRescueNegativeTestJSON-server-699999378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-699999378',id=25,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrrx+YwFNghcFUjqpJOY9cNZNxR7XuyO+lbBn8nBbazUK41wZJQ+nseUHYDKzbfDjsiE9koMmTXhvVI4jne/Z5jMNRtJnHZ99FwlNfe8/CQ9L6WSSjfybYcI9DYbCC3Tw==',key_name='tempest-keypair-835634634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43d3fb6e885546bd9660c81fac9cfa12',ramdisk_id='',reservation_id='r-2ue4rtaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-674134420',owner_user_name='tempest-ServerRescueNegativeTestJSON-674134420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:07:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6d8114db9fa47c09bc9675da9e19a8c',uuid=8b8eb320-6348-4038-a57e-02bf1e015174,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converting VIF {"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:90:87,bridge_name='br-int',has_traffic_filtering=True,id=2d2bc1b9-24cd-4992-93a5-e3638e21a35e,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bc1b9-24') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_vif [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:90:87,bridge_name='br-int',has_traffic_filtering=True,id=2d2bc1b9-24cd-4992-93a5-e3638e21a35e,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bc1b9-24') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da3d123-a29c-403c-9fd9-5f22941abd24]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5ad5a20-76c4-551f-adde-a9ade9dd5823', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-667d2e75-eb1b-4feb-bb99-beb83e3a6b86 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.595s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-ada13a67-e349-4c21-be1e-91c6073d64a8 req-f40190f5-4243-485f-9b99-3e9ba8515d51 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received event network-vif-unplugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ada13a67-e349-4c21-be1e-91c6073d64a8 req-f40190f5-4243-485f-9b99-3e9ba8515d51 service nova] Acquiring lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ada13a67-e349-4c21-be1e-91c6073d64a8 req-f40190f5-4243-485f-9b99-3e9ba8515d51 service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ada13a67-e349-4c21-be1e-91c6073d64a8 req-f40190f5-4243-485f-9b99-3e9ba8515d51 service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-ada13a67-e349-4c21-be1e-91c6073d64a8 req-f40190f5-4243-485f-9b99-3e9ba8515d51 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] No waiting events found dispatching network-vif-unplugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:07:49 user nova-compute[75021]: WARNING nova.compute.manager [req-ada13a67-e349-4c21-be1e-91c6073d64a8 req-f40190f5-4243-485f-9b99-3e9ba8515d51 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received unexpected event network-vif-unplugged-c77514ad-438b-4d06-8f57-a363cde54e16 for instance with vm_state active and task_state reboot_started_hard.
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-ada13a67-e349-4c21-be1e-91c6073d64a8 req-f40190f5-4243-485f-9b99-3e9ba8515d51 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received event network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ada13a67-e349-4c21-be1e-91c6073d64a8 req-f40190f5-4243-485f-9b99-3e9ba8515d51 service nova] Acquiring lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ada13a67-e349-4c21-be1e-91c6073d64a8 req-f40190f5-4243-485f-9b99-3e9ba8515d51 service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ada13a67-e349-4c21-be1e-91c6073d64a8 req-f40190f5-4243-485f-9b99-3e9ba8515d51 service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-ada13a67-e349-4c21-be1e-91c6073d64a8 req-f40190f5-4243-485f-9b99-3e9ba8515d51 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] No waiting events found dispatching network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:07:49 user nova-compute[75021]: WARNING nova.compute.manager [req-ada13a67-e349-4c21-be1e-91c6073d64a8 req-f40190f5-4243-485f-9b99-3e9ba8515d51 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received unexpected event network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 for instance with vm_state active and task_state reboot_started_hard.
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce898a4-788e-4c98-9ec5-bf0e04f52f03]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uySvnlTk {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d2bc1b9-24, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d2bc1b9-24, col_values=(('qos', UUID('906319af-ed63-4e68-b788-4a6da383352b')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d2bc1b9-24, col_values=(('external_ids', {'iface-id': '2d2bc1b9-24cd-4992-93a5-e3638e21a35e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:90:87', 'vm-uuid': '8b8eb320-6348-4038-a57e-02bf1e015174'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uySvnlTk" returned: 0 in 0.039s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[088a793a-8835-4267-81b3-2820992fb92f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uySvnlTk'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:49 user nova-compute[75021]: INFO os_vif [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:90:87,bridge_name='br-int',has_traffic_filtering=True,id=2d2bc1b9-24cd-4992-93a5-e3638e21a35e,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bc1b9-24')
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7257dd9-771f-4439-964d-eda1fc3aca37]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fea572-a77e-413e-bdc3-aa39f40bd5ea]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:49 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:49 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:07:49 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:49 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:49 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:07:49 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No VIF found with MAC fa:16:3e:86:90:87, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fbb3c3-249f-488b-aad4-f7b9bccf7401]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260]
Dec 06 07:07:49 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260] successful.
Dec 06 07:07:49 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daf0803-d881-48f3-a29b-ef01ccd0873f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d748909-ab1a-4105-b4d3-44c1be3bf746]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:49 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:49 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:07:49 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:49 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:49 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:49 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:07:49 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:49 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.455s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[49917ecb-e1ba-47e1-8fb8-d997e28f2772]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-19969aae-1376-4d5a-ba17-b49c34c58b61 req-1440a139-f371-41be-81ab-9d45bb401978 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Updated VIF entry in instance network info cache for port 2d2bc1b9-24cd-4992-93a5-e3638e21a35e. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-19969aae-1376-4d5a-ba17-b49c34c58b61 req-1440a139-f371-41be-81ab-9d45bb401978 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Updating instance_info_cache with network_info: [{"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:07:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-19969aae-1376-4d5a-ba17-b49c34c58b61 req-1440a139-f371-41be-81ab-9d45bb401978 service nova] Releasing lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:07:50 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:07:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uySvnlTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:07:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:07:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] <== connect_volume: return (1493ms) {'type': 'block', 'scsi_wwn': '23336393532306361', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:07:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336393532306361', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:07:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-53112281',display_name='tempest-TestMinimumBasicScenario-server-53112281',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-53112281',id=20,image_ref='53dd9568-7f3d-4c0f-a801-063320e5c6f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuSxZ13dd2/D7B877ZWXS1jgKRAmPhYOOiZJqhiReoBkb0kLSmdhOf4HykOJNldZ0vI0Uy/O1Rx4zDUeAdlHthJ4IX17YF8zgnD4tXiI5C/mOzfszeWX675LXbee/bjNA==',key_name='tempest-TestMinimumBasicScenario-1870415575',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:05:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78e36b4acada439db308e5e816dbf9a7',ramdisk_id='',reservation_id='r-59xfjdud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53dd9568-7f3d-4c0f-a801-063320e5c6f8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-757290889',owner_user_name='tempest-TestMinimumBasicScenario-757290889-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:07:47Z,user_data=None,user_id='24f231f563c345b48a998200dbf1384a',uuid=42b43ca7-a0fb-4811-b91b-2ecce2b7fb02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:07:50 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converting VIF {"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:07:50 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:ee:82,bridge_name='br-int',has_traffic_filtering=True,id=c77514ad-438b-4d06-8f57-a363cde54e16,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77514ad-43') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:07:50 user nova-compute[75021]: DEBUG nova.objects.instance [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lazy-loading 'pci_devices' on Instance uuid 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:50 user nova-compute[75021]: DEBUG nova.objects.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Object Instance<42b43ca7-a0fb-4811-b91b-2ecce2b7fb02> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:07:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:07:50 user nova-compute[75021]:   <uuid>42b43ca7-a0fb-4811-b91b-2ecce2b7fb02</uuid>
Dec 06 07:07:50 user nova-compute[75021]:   <name>instance-00000014</name>
Dec 06 07:07:50 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:07:50 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:07:50 user nova-compute[75021]:   <metadata>
Dec 06 07:07:50 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:07:50 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:07:50 user nova-compute[75021]:       <nova:name>tempest-TestMinimumBasicScenario-server-53112281</nova:name>
Dec 06 07:07:50 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:07:48</nova:creationTime>
Dec 06 07:07:50 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:07:50 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:07:50 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:07:50 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:07:50 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:07:50 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:07:50 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:07:50 user nova-compute[75021]:       <nova:owner>
Dec 06 07:07:50 user nova-compute[75021]:         <nova:user uuid="24f231f563c345b48a998200dbf1384a">tempest-TestMinimumBasicScenario-757290889-project-member</nova:user>
Dec 06 07:07:50 user nova-compute[75021]:         <nova:project uuid="78e36b4acada439db308e5e816dbf9a7">tempest-TestMinimumBasicScenario-757290889</nova:project>
Dec 06 07:07:50 user nova-compute[75021]:       </nova:owner>
Dec 06 07:07:50 user nova-compute[75021]:       <nova:root type="image" uuid="53dd9568-7f3d-4c0f-a801-063320e5c6f8"/>
Dec 06 07:07:50 user nova-compute[75021]:       <nova:ports>
Dec 06 07:07:50 user nova-compute[75021]:         <nova:port uuid="c77514ad-438b-4d06-8f57-a363cde54e16">
Dec 06 07:07:50 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 07:07:50 user nova-compute[75021]:         </nova:port>
Dec 06 07:07:50 user nova-compute[75021]:       </nova:ports>
Dec 06 07:07:50 user nova-compute[75021]:     </nova:instance>
Dec 06 07:07:50 user nova-compute[75021]:   </metadata>
Dec 06 07:07:50 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:07:50 user nova-compute[75021]:     <system>
Dec 06 07:07:50 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:07:50 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:07:50 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:07:50 user nova-compute[75021]:       <entry name="serial">42b43ca7-a0fb-4811-b91b-2ecce2b7fb02</entry>
Dec 06 07:07:50 user nova-compute[75021]:       <entry name="uuid">42b43ca7-a0fb-4811-b91b-2ecce2b7fb02</entry>
Dec 06 07:07:50 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:07:50 user nova-compute[75021]:     </system>
Dec 06 07:07:50 user nova-compute[75021]:   </sysinfo>
Dec 06 07:07:50 user nova-compute[75021]:   <os>
Dec 06 07:07:50 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:07:50 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:07:50 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:07:50 user nova-compute[75021]:   </os>
Dec 06 07:07:50 user nova-compute[75021]:   <features>
Dec 06 07:07:50 user nova-compute[75021]:     <acpi/>
Dec 06 07:07:50 user nova-compute[75021]:     <apic/>
Dec 06 07:07:50 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:07:50 user nova-compute[75021]:   </features>
Dec 06 07:07:50 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:07:50 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:07:50 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:07:50 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:07:50 user nova-compute[75021]:   </clock>
Dec 06 07:07:50 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:07:50 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:07:50 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:07:50 user nova-compute[75021]:   </cpu>
Dec 06 07:07:50 user nova-compute[75021]:   <devices>
Dec 06 07:07:50 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:07:50 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:07:50 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk"/>
Dec 06 07:07:50 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:07:50 user nova-compute[75021]:     </disk>
Dec 06 07:07:50 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:07:50 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:07:50 user nova-compute[75021]:       <source dev="/dev/sdb"/>
Dec 06 07:07:50 user nova-compute[75021]:       <target dev="vdb" bus="virtio"/>
Dec 06 07:07:50 user nova-compute[75021]:       <serial>16792f29-a35a-46ed-96e5-528d37062d8b</serial>
Dec 06 07:07:50 user nova-compute[75021]:     </disk>
Dec 06 07:07:50 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:07:50 user nova-compute[75021]:       <mac address="fa:16:3e:83:ee:82"/>
Dec 06 07:07:50 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:07:50 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:07:50 user nova-compute[75021]:       <target dev="tapc77514ad-43"/>
Dec 06 07:07:50 user nova-compute[75021]:     </interface>
Dec 06 07:07:50 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:07:50 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/console.log" append="off"/>
Dec 06 07:07:50 user nova-compute[75021]:     </serial>
Dec 06 07:07:50 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:07:50 user nova-compute[75021]:     <video>
Dec 06 07:07:50 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:07:50 user nova-compute[75021]:     </video>
Dec 06 07:07:50 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:07:50 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:07:50 user nova-compute[75021]:     </rng>
Dec 06 07:07:50 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:07:50 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:07:50 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:07:50 user nova-compute[75021]:     </memballoon>
Dec 06 07:07:50 user nova-compute[75021]:   </devices>
Dec 06 07:07:50 user nova-compute[75021]: </domain>
Dec 06 07:07:50 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:07:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.objects.instance [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lazy-loading 'trusted_certs' on Instance uuid 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.objects.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Object Instance<42b43ca7-a0fb-4811-b91b-2ecce2b7fb02> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf --force-share --output=json" returned: 0 in 0.229s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-86af0994-d7ed-440e-8cb2-5081323d797d req-e5c9993e-9c43-429b-904e-25688960324e service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-86af0994-d7ed-440e-8cb2-5081323d797d req-e5c9993e-9c43-429b-904e-25688960324e service nova] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-86af0994-d7ed-440e-8cb2-5081323d797d req-e5c9993e-9c43-429b-904e-25688960324e service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-86af0994-d7ed-440e-8cb2-5081323d797d req-e5c9993e-9c43-429b-904e-25688960324e service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-86af0994-d7ed-440e-8cb2-5081323d797d req-e5c9993e-9c43-429b-904e-25688960324e service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] No waiting events found dispatching network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:07:51 user nova-compute[75021]: WARNING nova.compute.manager [req-86af0994-d7ed-440e-8cb2-5081323d797d req-e5c9993e-9c43-429b-904e-25688960324e service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received unexpected event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b for instance with vm_state building and task_state spawning.
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-86af0994-d7ed-440e-8cb2-5081323d797d req-e5c9993e-9c43-429b-904e-25688960324e service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-86af0994-d7ed-440e-8cb2-5081323d797d req-e5c9993e-9c43-429b-904e-25688960324e service nova] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-86af0994-d7ed-440e-8cb2-5081323d797d req-e5c9993e-9c43-429b-904e-25688960324e service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-86af0994-d7ed-440e-8cb2-5081323d797d req-e5c9993e-9c43-429b-904e-25688960324e service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-86af0994-d7ed-440e-8cb2-5081323d797d req-e5c9993e-9c43-429b-904e-25688960324e service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] No waiting events found dispatching network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:07:51 user nova-compute[75021]: WARNING nova.compute.manager [req-86af0994-d7ed-440e-8cb2-5081323d797d req-e5c9993e-9c43-429b-904e-25688960324e service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received unexpected event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b for instance with vm_state building and task_state spawning.
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-1b5343b7-7216-4ca6-964a-04b208609026 req-9faf2000-00ac-43b7-b928-ec7d2c5d3054 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1b5343b7-7216-4ca6-964a-04b208609026 req-9faf2000-00ac-43b7-b928-ec7d2c5d3054 service nova] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1b5343b7-7216-4ca6-964a-04b208609026 req-9faf2000-00ac-43b7-b928-ec7d2c5d3054 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1b5343b7-7216-4ca6-964a-04b208609026 req-9faf2000-00ac-43b7-b928-ec7d2c5d3054 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-1b5343b7-7216-4ca6-964a-04b208609026 req-9faf2000-00ac-43b7-b928-ec7d2c5d3054 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] No waiting events found dispatching network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:07:51 user nova-compute[75021]: WARNING nova.compute.manager [req-1b5343b7-7216-4ca6-964a-04b208609026 req-9faf2000-00ac-43b7-b928-ec7d2c5d3054 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received unexpected event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e for instance with vm_state building and task_state spawning.
Dec 06 07:07:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Cannot resize image /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.objects.instance [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lazy-loading 'migration_context' on Instance uuid 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.objects.base [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Object Instance<42b43ca7-a0fb-4811-b91b-2ecce2b7fb02> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-53112281',display_name='tempest-TestMinimumBasicScenario-server-53112281',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-53112281',id=20,image_ref='53dd9568-7f3d-4c0f-a801-063320e5c6f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuSxZ13dd2/D7B877ZWXS1jgKRAmPhYOOiZJqhiReoBkb0kLSmdhOf4HykOJNldZ0vI0Uy/O1Rx4zDUeAdlHthJ4IX17YF8zgnD4tXiI5C/mOzfszeWX675LXbee/bjNA==',key_name='tempest-TestMinimumBasicScenario-1870415575',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:05:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='78e36b4acada439db308e5e816dbf9a7',ramdisk_id='',reservation_id='r-59xfjdud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53dd9568-7f3d-4c0f-a801-063320e5c6f8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-757290889',owner_user_name='tempest-TestMinimumBasicScenario-757290889-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:07:47Z,user_data=None,user_id='24f231f563c345b48a998200dbf1384a',uuid=42b43ca7-a0fb-4811-b91b-2ecce2b7fb02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converting VIF {"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:ee:82,bridge_name='br-int',has_traffic_filtering=True,id=c77514ad-438b-4d06-8f57-a363cde54e16,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77514ad-43') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG os_vif [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:ee:82,bridge_name='br-int',has_traffic_filtering=True,id=c77514ad-438b-4d06-8f57-a363cde54e16,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77514ad-43') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cc56f85-c239-5c57-8dec-ba67e8c80750', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc77514ad-43, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc77514ad-43, col_values=(('qos', UUID('cf21f06d-7690-42b7-af8a-a7d3033c2d09')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc77514ad-43, col_values=(('external_ids', {'iface-id': 'c77514ad-438b-4d06-8f57-a363cde54e16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:ee:82', 'vm-uuid': '42b43ca7-a0fb-4811-b91b-2ecce2b7fb02'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:07:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:51 user nova-compute[75021]: INFO os_vif [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:ee:82,bridge_name='br-int',has_traffic_filtering=True,id=c77514ad-438b-4d06-8f57-a363cde54e16,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77514ad-43')
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:07:53 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Instance spawned successfully.
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:53 user nova-compute[75021]: INFO nova.compute.manager [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Took 8.24 seconds to spawn the instance on the hypervisor.
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:53 user nova-compute[75021]: INFO nova.compute.manager [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Took 26.01 seconds to build instance.
Dec 06 07:07:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-528dbd45-32e0-417c-8d56-80ec650039e6 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.125s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-f797179d-acb9-4043-a110-a53f3310a07f req-95df81f9-6b58-4cf5-b083-fe959614ceb5 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f797179d-acb9-4043-a110-a53f3310a07f req-95df81f9-6b58-4cf5-b083-fe959614ceb5 service nova] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f797179d-acb9-4043-a110-a53f3310a07f req-95df81f9-6b58-4cf5-b083-fe959614ceb5 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f797179d-acb9-4043-a110-a53f3310a07f req-95df81f9-6b58-4cf5-b083-fe959614ceb5 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-f797179d-acb9-4043-a110-a53f3310a07f req-95df81f9-6b58-4cf5-b083-fe959614ceb5 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] No waiting events found dispatching network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:07:53 user nova-compute[75021]: WARNING nova.compute.manager [req-f797179d-acb9-4043-a110-a53f3310a07f req-95df81f9-6b58-4cf5-b083-fe959614ceb5 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received unexpected event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e for instance with vm_state building and task_state spawning.
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-74820fac-59dc-4f04-a859-4251360e0b18 req-376cbf34-547b-49dc-b721-188389750914 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received event network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-74820fac-59dc-4f04-a859-4251360e0b18 req-376cbf34-547b-49dc-b721-188389750914 service nova] Acquiring lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-74820fac-59dc-4f04-a859-4251360e0b18 req-376cbf34-547b-49dc-b721-188389750914 service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-74820fac-59dc-4f04-a859-4251360e0b18 req-376cbf34-547b-49dc-b721-188389750914 service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-74820fac-59dc-4f04-a859-4251360e0b18 req-376cbf34-547b-49dc-b721-188389750914 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] No waiting events found dispatching network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:07:53 user nova-compute[75021]: WARNING nova.compute.manager [req-74820fac-59dc-4f04-a859-4251360e0b18 req-376cbf34-547b-49dc-b721-188389750914 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received unexpected event network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 for instance with vm_state active and task_state reboot_started_hard.
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:07:53 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Instance spawned successfully.
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:07:54 user nova-compute[75021]: INFO nova.compute.manager [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Took 7.69 seconds to spawn the instance on the hypervisor.
Dec 06 07:07:54 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:07:54 user nova-compute[75021]: INFO nova.compute.manager [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Took 8.80 seconds to build instance.
Dec 06 07:07:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9deb2779-e0d9-4ef3-ba9f-df900054afbf tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "8b8eb320-6348-4038-a57e-02bf1e015174" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.919s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:07:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLZidVHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:07:54 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:07:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:07:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:07:54 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:07:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:07:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:07:54 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:07:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[af76840e-b04b-4ea0-9999-d54e0df96f15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:07:54 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8ef944-d804-41b9-b78a-69dfd8d7f476]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045] added
Dec 06 07:07:55 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7e336c-08da-4b0a-82bf-01c4c2e16475]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce58165-de7a-42e4-a243-99512f856234]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLZidVHk {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLZidVHk" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6922225c-cd93-44b3-abc7-96479f33543e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PLZidVHk'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2370d8fc-3a93-4474-bf1d-8fac1a20c91c]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e64fe31-28c9-4509-8d21-f0e86c6e88e2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:55 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:55 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:07:55 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:55 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:55 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:55 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:07:55 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:55 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a02b0d-2718-4a3d-90bd-c36bb9a722ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045, portal: 172.16.0.220,3260]
Dec 06 07:07:55 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045, portal: 172.16.0.220,3260] successful.
Dec 06 07:07:55 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc74e88-eb48-4a36-a314-1447cb92d694]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a440730-6024-4f29-9d39-55725b897260]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:55 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:55 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:07:55 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:55 user nova-compute[75021]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 (non-flash)
Dec 06 07:07:55 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:55 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:55 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:07:55 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:55 user nova-compute[75021]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 (non-flash)
Dec 06 07:07:55 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4a6631-81ee-4bcf-887a-b99195f2dd20]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-8b00e1ce-41cd-4858-9c51-b49db528eeeb req-a86e9d02-7672-412b-9218-d129c7bd0dde service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received event network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8b00e1ce-41cd-4858-9c51-b49db528eeeb req-a86e9d02-7672-412b-9218-d129c7bd0dde service nova] Acquiring lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8b00e1ce-41cd-4858-9c51-b49db528eeeb req-a86e9d02-7672-412b-9218-d129c7bd0dde service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8b00e1ce-41cd-4858-9c51-b49db528eeeb req-a86e9d02-7672-412b-9218-d129c7bd0dde service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-8b00e1ce-41cd-4858-9c51-b49db528eeeb req-a86e9d02-7672-412b-9218-d129c7bd0dde service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] No waiting events found dispatching network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:07:55 user nova-compute[75021]: WARNING nova.compute.manager [req-8b00e1ce-41cd-4858-9c51-b49db528eeeb req-a86e9d02-7672-412b-9218-d129c7bd0dde service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received unexpected event network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 for instance with vm_state active and task_state reboot_started_hard.
Dec 06 07:07:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:07:56 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Instance rebooted successfully.
Dec 06 07:07:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:07:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-31a9e31b-0a4c-4aa5-a3f0-d1739b71a9d8 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 10.266s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:56 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:07:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLZidVHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:07:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:07:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '26639666231393335', 'path': '/dev/sdf'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:07:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639666231393335', 'path': '/dev/sdf'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:07:56 user nova-compute[75021]: DEBUG nova.objects.instance [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lazy-loading 'flavor' on Instance uuid 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:07:56 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:07:56 user nova-compute[75021]:   <source dev="/dev/sdf"/>
Dec 06 07:07:56 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:07:56 user nova-compute[75021]:   <serial>c415fdf2-6f39-4723-a317-386f933cb045</serial>
Dec 06 07:07:56 user nova-compute[75021]: </disk>
Dec 06 07:07:56 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:07:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:07:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:07:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] No VIF found with MAC fa:16:3e:f3:41:7d, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:07:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c635a4f4-3818-4784-8044-fecbb7a117b1 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.264s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:58 user nova-compute[75021]: INFO nova.compute.manager [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Terminating instance
Dec 06 07:07:58 user nova-compute[75021]: DEBUG nova.compute.manager [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-410d86b7-0a47-4ded-9384-51a12e780eb1 req-48250eb9-97d7-4517-bcd5-689f398c386f service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-vif-unplugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-410d86b7-0a47-4ded-9384-51a12e780eb1 req-48250eb9-97d7-4517-bcd5-689f398c386f service nova] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-410d86b7-0a47-4ded-9384-51a12e780eb1 req-48250eb9-97d7-4517-bcd5-689f398c386f service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-410d86b7-0a47-4ded-9384-51a12e780eb1 req-48250eb9-97d7-4517-bcd5-689f398c386f service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-410d86b7-0a47-4ded-9384-51a12e780eb1 req-48250eb9-97d7-4517-bcd5-689f398c386f service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] No waiting events found dispatching network-vif-unplugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:07:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-410d86b7-0a47-4ded-9384-51a12e780eb1 req-48250eb9-97d7-4517-bcd5-689f398c386f service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-vif-unplugged-f48c57d0-3024-4f70-8989-454717799fe3 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:59 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Instance destroyed successfully.
Dec 06 07:07:59 user nova-compute[75021]: DEBUG nova.objects.instance [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lazy-loading 'resources' on Instance uuid 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-272299805',display_name='tempest-ServerActionsTestOtherB-server-272299805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-272299805',id=4,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDr10Uf7mSfaKxaWiZMlOkgp+3gz+zk9cuGM2WOwPxRQl0KGDW8m0MH0trEdCAhYZHvExMqqK1A+1XoEwjfDbN1X4V66K4XOiRtH4zqe8KgY/USo0EOIRMWD8nLuB034BA==',key_name='tempest-keypair-2107162455',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:05:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0482e21a6db45199f3c82f7f5913ec1',ramdisk_id='',reservation_id='r-lhdcj864',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1150715110',owner_user_name='tempest-ServerActionsTestOtherB-1150715110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9273703a77bf425685228a99248f6d4e',uuid=2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converting VIF {"id": "f48c57d0-3024-4f70-8989-454717799fe3", "address": "fa:16:3e:43:60:12", "network": {"id": "8bc52e1e-fde0-4538-b69f-774c4ac61be8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1644315764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0482e21a6db45199f3c82f7f5913ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48c57d0-30", "ovs_interfaceid": "f48c57d0-3024-4f70-8989-454717799fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_vif [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf48c57d0-30, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c713136-0f90-4251-a6f3-c5e9434b724b) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:07:59 user nova-compute[75021]: INFO os_vif [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:60:12,bridge_name='br-int',has_traffic_filtering=True,id=f48c57d0-3024-4f70-8989-454717799fe3,network=Network(8bc52e1e-fde0-4538-b69f-774c4ac61be8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48c57d0-30')
Dec 06 07:07:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvehRiEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:07:59 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfad424-61a9-4f4c-a35a-f850a76d8b12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:07:59 user nova-compute[75021]: No targets found.
Dec 06 07:07:59 user nova-compute[75021]: iSNS:
Dec 06 07:07:59 user nova-compute[75021]: No targets found.
Dec 06 07:07:59 user nova-compute[75021]: STATIC:
Dec 06 07:07:59 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b
Dec 06 07:07:59 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:07:59 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:07:59 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635
Dec 06 07:07:59 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:07:59 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:07:59 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:07:59 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:07:59 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:07:59 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0
Dec 06 07:07:59 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:07:59 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:07:59 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045
Dec 06 07:07:59 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:07:59 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:07:59 user nova-compute[75021]: FIRMWARE:
Dec 06 07:07:59 user nova-compute[75021]: No targets found.
Dec 06 07:07:59 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:07:59 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:07:59 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[099431a1-085b-4b4e-8276-00a0017a2ca0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1a5f61-fa5c-4907-abd2-2ea272bc4b5a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:59 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:59 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:07:59 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:59 user nova-compute[75021]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 (non-flash)
Dec 06 07:07:59 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 (non-flash)
Dec 06 07:07:59 user nova-compute[75021]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:07:59 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:07:59 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:07:59 user nova-compute[75021]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 (non-flash)
Dec 06 07:07:59 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d8457760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635'): ({'sdc'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Removing single pathed devices sdc {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d119605c-90c7-4979-9078-45ffe4ed3379]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f234ca-1ff0-427c-b78c-105c7fd79fa2]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Flushing IO for device /dev/sdc {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[262d6c0c-1f3d-444c-9ff2-2aea58f0dafe]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7d88b3-e44b-4131-8257-5f0834440115]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf83439-3d82-41f6-8d63-ed6024bd1598]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3924ccbf-6ef6-4167-96cd-7628a69e584a]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260]
Dec 06 07:07:59 user nova-compute[75021]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635, portal: 172.16.0.220,3260] successful.
Dec 06 07:07:59 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:07:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ccdd51d-7737-4a34-b5ab-e986a8a87635 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b35fba-b72a-4f51-8d93-8738c18592d9]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] <== disconnect_volume: return (414ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:08:00 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Deleting instance files /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf_del
Dec 06 07:08:00 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Deletion of /opt/stack/data/nova/instances/2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf_del complete
Dec 06 07:08:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:00 user nova-compute[75021]: INFO nova.compute.manager [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Took 1.58 seconds to destroy the instance on the hypervisor.
Dec 06 07:08:00 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:00 user nova-compute[75021]: INFO nova.compute.manager [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Detaching volume c415fdf2-6f39-4723-a317-386f933cb045
Dec 06 07:08:00 user nova-compute[75021]: INFO nova.virt.block_device [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Attempting to driver detach volume c415fdf2-6f39-4723-a317-386f933cb045 from mountpoint /dev/vdb
Dec 06 07:08:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Attempting to detach device vdb from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:08:00 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:08:00 user nova-compute[75021]:   <source dev="/dev/sdf"/>
Dec 06 07:08:00 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:08:00 user nova-compute[75021]:   <serial>c415fdf2-6f39-4723-a317-386f933cb045</serial>
Dec 06 07:08:00 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:08:00 user nova-compute[75021]: </disk>
Dec 06 07:08:00 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:08:00 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Successfully detached device vdb from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the persistent domain config.
Dec 06 07:08:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:08:00 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:08:00 user nova-compute[75021]:   <source dev="/dev/sdf"/>
Dec 06 07:08:00 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:08:00 user nova-compute[75021]:   <serial>c415fdf2-6f39-4723-a317-386f933cb045</serial>
Dec 06 07:08:00 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:08:00 user nova-compute[75021]: </disk>
Dec 06 07:08:00 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:08:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-fbe28346-cf2b-4057-bb60-af94230aec21 req-d4e19066-614c-4d40-8424-c23473d651e4 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:08:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fbe28346-cf2b-4057-bb60-af94230aec21 req-d4e19066-614c-4d40-8424-c23473d651e4 service nova] Acquiring lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fbe28346-cf2b-4057-bb60-af94230aec21 req-d4e19066-614c-4d40-8424-c23473d651e4 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fbe28346-cf2b-4057-bb60-af94230aec21 req-d4e19066-614c-4d40-8424-c23473d651e4 service nova] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-fbe28346-cf2b-4057-bb60-af94230aec21 req-d4e19066-614c-4d40-8424-c23473d651e4 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] No waiting events found dispatching network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:08:01 user nova-compute[75021]: WARNING nova.compute.manager [req-fbe28346-cf2b-4057-bb60-af94230aec21 req-d4e19066-614c-4d40-8424-c23473d651e4 service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received unexpected event network-vif-plugged-f48c57d0-3024-4f70-8989-454717799fe3 for instance with vm_state active and task_state deleting.
Dec 06 07:08:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:01 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:08:01 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Took 1.02 seconds to deallocate network for instance.
Dec 06 07:08:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-ffd003a0-c316-4ecd-b3f3-10241ade968d req-c4c826a2-6ed1-44ee-a3f3-1bdbd325124b service nova] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Received event network-vif-deleted-f48c57d0-3024-4f70-8989-454717799fe3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:08:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:08:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:03 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Error from libvirt while getting description of instance-00000004: [Error Code 42] Domain not found: no domain with matching uuid '2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf' (instance-00000004): libvirt.libvirtError: Domain not found: no domain with matching uuid '2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf' (instance-00000004)
Dec 06 07:08:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:08:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:05 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:08:05 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7433MB free_disk=25.333534240722656GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5c50a6a8-2500-4408-a932-48f0116713b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 430c2ff8-2b09-43e8-b27e-caf8153ff892 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance e600e40b-0b08-4341-a48e-652da530e59c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 8b8eb320-6348-4038-a57e-02bf1e015174 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:08:05 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:08:06 user nova-compute[75021]: INFO nova.compute.manager [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] [instance: 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf] Took 5.02 seconds to detach 1 volumes for instance.
Dec 06 07:08:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:06 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:08:06 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:08:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:08:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.720s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.085s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:06 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:08:06 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:08:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:06 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Deleted allocations for instance 2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf
Dec 06 07:08:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dd1e95e5-78ab-46db-8d98-57150d4079e4 tempest-ServerActionsTestOtherB-1150715110 tempest-ServerActionsTestOtherB-1150715110-project-member] Lock "2e7d23f6-cc3c-45f2-89bf-df7470a0a1bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.396s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:07 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:08:07 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:08:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:08:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:08:07 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:08:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:08 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Updating instance_info_cache with network_info: [{"id": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "address": "fa:16:3e:af:d4:e8", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48add70-d2", "ovs_interfaceid": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:08:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:08:08 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:08:08 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:08:08 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:08:08 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:08:08 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:08:08 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:08:08 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:08:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:08:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:08:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "430c2ff8-2b09-43e8-b27e-caf8153ff892" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:20 user nova-compute[75021]: INFO nova.compute.manager [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Detaching volume 0b811bd4-8223-46da-8b48-aa0af240b4f0
Dec 06 07:08:20 user nova-compute[75021]: INFO nova.virt.block_device [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Attempting to driver detach volume 0b811bd4-8223-46da-8b48-aa0af240b4f0 from mountpoint /dev/vdb
Dec 06 07:08:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Attempting to detach device vdb from instance 430c2ff8-2b09-43e8-b27e-caf8153ff892 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:08:20 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:08:20 user nova-compute[75021]:   <source dev="/dev/sde"/>
Dec 06 07:08:20 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:08:20 user nova-compute[75021]:   <serial>0b811bd4-8223-46da-8b48-aa0af240b4f0</serial>
Dec 06 07:08:20 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:08:20 user nova-compute[75021]: </disk>
Dec 06 07:08:20 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:08:20 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Successfully detached device vdb from instance 430c2ff8-2b09-43e8-b27e-caf8153ff892 from the persistent domain config.
Dec 06 07:08:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 430c2ff8-2b09-43e8-b27e-caf8153ff892 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:08:20 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:08:20 user nova-compute[75021]:   <source dev="/dev/sde"/>
Dec 06 07:08:20 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:08:20 user nova-compute[75021]:   <serial>0b811bd4-8223-46da-8b48-aa0af240b4f0</serial>
Dec 06 07:08:20 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:08:20 user nova-compute[75021]: </disk>
Dec 06 07:08:20 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "430c2ff8-2b09-43e8-b27e-caf8153ff892" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 430c2ff8-2b09-43e8-b27e-caf8153ff892 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:08:20 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5c50a6a8-2500-4408-a932-48f0116713b8 is timed out.
Dec 06 07:08:20 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Successfully detached device vdb from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the live domain config.
Dec 06 07:08:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLZidVHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:08:20 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:08:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b95efd9-0200-4f31-8bb9-a14ccffe234c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:08:20 user nova-compute[75021]: No targets found.
Dec 06 07:08:20 user nova-compute[75021]: iSNS:
Dec 06 07:08:20 user nova-compute[75021]: No targets found.
Dec 06 07:08:20 user nova-compute[75021]: STATIC:
Dec 06 07:08:20 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b
Dec 06 07:08:20 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:08:20 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:08:20 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:08:20 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:08:20 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:08:20 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0
Dec 06 07:08:20 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:08:20 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:08:20 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045
Dec 06 07:08:20 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:08:20 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:08:20 user nova-compute[75021]: FIRMWARE:
Dec 06 07:08:20 user nova-compute[75021]: No targets found.
Dec 06 07:08:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:08:20 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:08:20 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[57021ca7-9d90-47cb-a61f-5e415d0189c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff28729-5a1e-4d54-beeb-f18078039e44]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:08:20 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:08:20 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:08:20 user nova-compute[75021]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 (non-flash)
Dec 06 07:08:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:08:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:08:20 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:08:20 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:08:20 user nova-compute[75021]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 (non-flash)
Dec 06 07:08:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b476c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045'): ({'sdf'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Removing single pathed devices sdf {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57cd3f1-1521-4c7a-a03f-874cb96db57b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8488a3-6a9c-45dd-a71f-5d0edbd9646a]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Flushing IO for device /dev/sdf {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.011s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2eacd0-599e-4032-88ef-c0bdc6148d9f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1943e3-9aab-4a26-9a5b-b6ae297ecd97]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97d7514-e9dc-4397-8ef5-fb01d5c8b5c8]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd8ee32-07b8-44f4-a8da-bba703192aeb]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045, portal: 172.16.0.220,3260]
Dec 06 07:08:21 user nova-compute[75021]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045, portal: 172.16.0.220,3260] successful.
Dec 06 07:08:21 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c415fdf2-6f39-4723-a317-386f933cb045 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e22180e-c6ce-4725-8d04-aeb2a89b1021]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] <== disconnect_volume: return (320ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:08:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:08:22 user nova-compute[75021]: DEBUG nova.objects.instance [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lazy-loading 'flavor' on Instance uuid 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:08:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de882901-673b-410e-9c6c-264178851991 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.964s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-95c003c9-7e61-44de-9ee3-1c294150c600 req-125a5421-2938-40d2-babc-199240b4cc4b service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received event network-changed-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:08:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-95c003c9-7e61-44de-9ee3-1c294150c600 req-125a5421-2938-40d2-babc-199240b4cc4b service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Refreshing instance network info cache due to event network-changed-d18bb07e-28df-49e3-b5b2-5e7cec5adee4. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:08:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-95c003c9-7e61-44de-9ee3-1c294150c600 req-125a5421-2938-40d2-babc-199240b4cc4b service nova] Acquiring lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:08:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-95c003c9-7e61-44de-9ee3-1c294150c600 req-125a5421-2938-40d2-babc-199240b4cc4b service nova] Acquired lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:08:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-95c003c9-7e61-44de-9ee3-1c294150c600 req-125a5421-2938-40d2-babc-199240b4cc4b service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Refreshing network info cache for port d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:08:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:08:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-95c003c9-7e61-44de-9ee3-1c294150c600 req-125a5421-2938-40d2-babc-199240b4cc4b service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Updated VIF entry in instance network info cache for port d18bb07e-28df-49e3-b5b2-5e7cec5adee4. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:08:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-95c003c9-7e61-44de-9ee3-1c294150c600 req-125a5421-2938-40d2-babc-199240b4cc4b service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Updating instance_info_cache with network_info: [{"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:08:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-95c003c9-7e61-44de-9ee3-1c294150c600 req-125a5421-2938-40d2-babc-199240b4cc4b service nova] Releasing lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:08:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "e600e40b-0b08-4341-a48e-652da530e59c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "e600e40b-0b08-4341-a48e-652da530e59c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:39 user nova-compute[75021]: INFO nova.compute.manager [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Shelving
Dec 06 07:08:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-dcbc0ab7-198b-491f-b900-7e1c3852fd90 req-326573ae-6108-4398-b87f-1acc9af8c649 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received event network-vif-unplugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:08:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dcbc0ab7-198b-491f-b900-7e1c3852fd90 req-326573ae-6108-4398-b87f-1acc9af8c649 service nova] Acquiring lock "e600e40b-0b08-4341-a48e-652da530e59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dcbc0ab7-198b-491f-b900-7e1c3852fd90 req-326573ae-6108-4398-b87f-1acc9af8c649 service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dcbc0ab7-198b-491f-b900-7e1c3852fd90 req-326573ae-6108-4398-b87f-1acc9af8c649 service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-dcbc0ab7-198b-491f-b900-7e1c3852fd90 req-326573ae-6108-4398-b87f-1acc9af8c649 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] No waiting events found dispatching network-vif-unplugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:08:39 user nova-compute[75021]: WARNING nova.compute.manager [req-dcbc0ab7-198b-491f-b900-7e1c3852fd90 req-326573ae-6108-4398-b87f-1acc9af8c649 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received unexpected event network-vif-unplugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 for instance with vm_state active and task_state shelving.
Dec 06 07:08:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Instance destroyed successfully.
Dec 06 07:08:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Beginning cold snapshot process
Dec 06 07:08:40 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk /opt/stack/data/nova/instances/snapshots/tmp339iu81a/d3ccf7a96c264c36a68e77de6c9f7a2b {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:40 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 430c2ff8-2b09-43e8-b27e-caf8153ff892 is timed out.
Dec 06 07:08:40 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Successfully detached device vdb from instance 430c2ff8-2b09-43e8-b27e-caf8153ff892 from the live domain config.
Dec 06 07:08:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYEiwapg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:08:40 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1fbdc3-8ba8-45d1-9c7f-5cb257b4b8dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f05becd-e379-43e2-a9e0-b0f96b0fc0cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dab04d6-f1fa-4196-acea-191240cef187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:08:40 user nova-compute[75021]: No targets found.
Dec 06 07:08:40 user nova-compute[75021]: iSNS:
Dec 06 07:08:40 user nova-compute[75021]: No targets found.
Dec 06 07:08:40 user nova-compute[75021]: STATIC:
Dec 06 07:08:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:1f05becd-e379-43e2-a9e0-b0f96b0fc0cb
Dec 06 07:08:40 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:08:40 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:08:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:8dab04d6-f1fa-4196-acea-191240cef187
Dec 06 07:08:40 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:08:40 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:08:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b
Dec 06 07:08:40 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:08:40 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:08:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:08:40 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:08:40 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:08:40 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0
Dec 06 07:08:40 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:08:40 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:08:40 user nova-compute[75021]: FIRMWARE:
Dec 06 07:08:40 user nova-compute[75021]: No targets found.
Dec 06 07:08:40 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:08:40 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:08:40 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.041s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4af342-f9ab-4e05-96bf-ff376ab85389]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f05becd-e379-43e2-a9e0-b0f96b0fc0cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dab04d6-f1fa-4196-acea-191240cef187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e533f67-da88-4197-9d9d-5a280f58c937]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f05becd-e379-43e2-a9e0-b0f96b0fc0cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dab04d6-f1fa-4196-acea-191240cef187 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:08:40 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:08:40 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:08:40 user nova-compute[75021]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f05becd-e379-43e2-a9e0-b0f96b0fc0cb (non-flash)
Dec 06 07:08:40 user nova-compute[75021]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dab04d6-f1fa-4196-acea-191240cef187 (non-flash)
Dec 06 07:08:40 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:08:40 user nova-compute[75021]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 (non-flash)
Dec 06 07:08:40 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:08:40 user nova-compute[75021]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f05becd-e379-43e2-a9e0-b0f96b0fc0cb (non-flash)
Dec 06 07:08:40 user nova-compute[75021]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dab04d6-f1fa-4196-acea-191240cef187 (non-flash)
Dec 06 07:08:40 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b4767ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0'): ({'sde'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Removing single pathed devices sde {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk /opt/stack/data/nova/instances/snapshots/tmp339iu81a/d3ccf7a96c264c36a68e77de6c9f7a2b" returned: 0 in 0.770s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:40 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Snapshot extracted, beginning image upload
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2642292-8b54-45de-be44-5518923c4069]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[92942547-9ba5-47f8-8a2d-6cd2ddbe9ffa]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Flushing IO for device /dev/sde {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9a95e3-c224-4048-859c-ff30d50a76a8]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[484bfb58-e254-4c60-96c2-65cd027cebe8]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[470d5f1f-4fba-473c-a700-00240dd8c9d5]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:08:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3a92ff-2663-4353-a1f2-eddaac9b3ab5]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0, portal: 172.16.0.220,3260]
Dec 06 07:08:41 user nova-compute[75021]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0, portal: 172.16.0.220,3260] successful.
Dec 06 07:08:41 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:08:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f8934e-6ee6-4471-9450-93112f43cdcc]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:08:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:08:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] <== disconnect_volume: return (397ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:08:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:08:41 user nova-compute[75021]: DEBUG nova.compute.manager [req-f0158aa0-91f6-4ca8-a478-7c3cbc3c8486 req-16689fa4-1993-4b1b-864a-79d4d1aeacc8 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received event network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:08:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f0158aa0-91f6-4ca8-a478-7c3cbc3c8486 req-16689fa4-1993-4b1b-864a-79d4d1aeacc8 service nova] Acquiring lock "e600e40b-0b08-4341-a48e-652da530e59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f0158aa0-91f6-4ca8-a478-7c3cbc3c8486 req-16689fa4-1993-4b1b-864a-79d4d1aeacc8 service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f0158aa0-91f6-4ca8-a478-7c3cbc3c8486 req-16689fa4-1993-4b1b-864a-79d4d1aeacc8 service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:41 user nova-compute[75021]: DEBUG nova.compute.manager [req-f0158aa0-91f6-4ca8-a478-7c3cbc3c8486 req-16689fa4-1993-4b1b-864a-79d4d1aeacc8 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] No waiting events found dispatching network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:08:41 user nova-compute[75021]: WARNING nova.compute.manager [req-f0158aa0-91f6-4ca8-a478-7c3cbc3c8486 req-16689fa4-1993-4b1b-864a-79d4d1aeacc8 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received unexpected event network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 for instance with vm_state active and task_state shelving_image_uploading.
Dec 06 07:08:42 user nova-compute[75021]: DEBUG nova.objects.instance [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lazy-loading 'flavor' on Instance uuid 430c2ff8-2b09-43e8-b27e-caf8153ff892 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5b09960d-afb3-4fab-84da-14d62755f532 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.978s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.862s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "430c2ff8-2b09-43e8-b27e-caf8153ff892-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:42 user nova-compute[75021]: INFO nova.compute.manager [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Terminating instance
Dec 06 07:08:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:42 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Instance destroyed successfully.
Dec 06 07:08:42 user nova-compute[75021]: DEBUG nova.objects.instance [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lazy-loading 'resources' on Instance uuid 430c2ff8-2b09-43e8-b27e-caf8153ff892 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-970341490',display_name='tempest-VolumesSnapshotTestJSON-instance-970341490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-970341490',id=21,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlUiW0nW00McIpdrGSb907MZNigiCPna3dMz7Xkh/TdHpHkO9RENbfwltareVfR4nTihFb5FDYs/lAgVm7XZxh1gS5abT9IPTinCvwTuD+ANGQa814aPxA9HIIwmI1juw==',key_name='tempest-keypair-1366890290',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:05:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d731b9dfe44549609091c48e8d19a1e9',ramdisk_id='',reservation_id='r-pt9cagc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-591172318',owner_user_name='tempest-VolumesSnapshotTestJSON-591172318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:05:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b72f254ecf4447b4fcaada0ce327d6',uuid=430c2ff8-2b09-43e8-b27e-caf8153ff892,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "address": "fa:16:3e:61:ae:ea", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541e273b-cc", "ovs_interfaceid": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Converting VIF {"id": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "address": "fa:16:3e:61:ae:ea", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap541e273b-cc", "ovs_interfaceid": "541e273b-cc24-4f3c-bec6-f8f6f583dd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:ae:ea,bridge_name='br-int',has_traffic_filtering=True,id=541e273b-cc24-4f3c-bec6-f8f6f583dd31,network=Network(a9cc5472-9cbe-42f2-bae2-532a8daa36e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap541e273b-cc') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG os_vif [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:ae:ea,bridge_name='br-int',has_traffic_filtering=True,id=541e273b-cc24-4f3c-bec6-f8f6f583dd31,network=Network(a9cc5472-9cbe-42f2-bae2-532a8daa36e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap541e273b-cc') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap541e273b-cc, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d919cfa-597d-44e0-9a12-10775e061fb9) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:43 user nova-compute[75021]: INFO os_vif [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:ae:ea,bridge_name='br-int',has_traffic_filtering=True,id=541e273b-cc24-4f3c-bec6-f8f6f583dd31,network=Network(a9cc5472-9cbe-42f2-bae2-532a8daa36e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap541e273b-cc')
Dec 06 07:08:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYEiwapg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:08:43 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:08:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf24fcb-74ac-4d36-9123-872e5b12e774]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f05becd-e379-43e2-a9e0-b0f96b0fc0cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dab04d6-f1fa-4196-acea-191240cef187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:08:43 user nova-compute[75021]: No targets found.
Dec 06 07:08:43 user nova-compute[75021]: iSNS:
Dec 06 07:08:43 user nova-compute[75021]: No targets found.
Dec 06 07:08:43 user nova-compute[75021]: STATIC:
Dec 06 07:08:43 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:1f05becd-e379-43e2-a9e0-b0f96b0fc0cb
Dec 06 07:08:43 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:08:43 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:08:43 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:8dab04d6-f1fa-4196-acea-191240cef187
Dec 06 07:08:43 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:08:43 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:08:43 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b
Dec 06 07:08:43 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:08:43 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:08:43 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:08:43 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:08:43 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:08:43 user nova-compute[75021]: FIRMWARE:
Dec 06 07:08:43 user nova-compute[75021]: No targets found.
Dec 06 07:08:43 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:08:43 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:08:43 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b811bd4-8223-46da-8b48-aa0af240b4f0', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db63b99-cfd2-406d-b905-0f9372789103]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f05becd-e379-43e2-a9e0-b0f96b0fc0cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dab04d6-f1fa-4196-acea-191240cef187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d53538-4149-444f-aa60-1fe8ff586e53]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f05becd-e379-43e2-a9e0-b0f96b0fc0cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dab04d6-f1fa-4196-acea-191240cef187 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:08:43 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:08:43 user nova-compute[75021]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f05becd-e379-43e2-a9e0-b0f96b0fc0cb (non-flash)
Dec 06 07:08:43 user nova-compute[75021]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dab04d6-f1fa-4196-acea-191240cef187 (non-flash)
Dec 06 07:08:43 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:08:43 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:08:43 user nova-compute[75021]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f05becd-e379-43e2-a9e0-b0f96b0fc0cb (non-flash)
Dec 06 07:08:43 user nova-compute[75021]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dab04d6-f1fa-4196-acea-191240cef187 (non-flash)
Dec 06 07:08:43 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b46bf520>, {}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Disconnecting from: [] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.090s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] <== disconnect_volume: return (91ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:08:43 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Deleting instance files /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892_del
Dec 06 07:08:43 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Deletion of /opt/stack/data/nova/instances/430c2ff8-2b09-43e8-b27e-caf8153ff892_del complete
Dec 06 07:08:43 user nova-compute[75021]: INFO nova.compute.manager [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Took 1.07 seconds to destroy the instance on the hypervisor.
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-8de0f165-d5ca-40cc-be79-2bbd47618e0b req-aa0bd9c3-1720-4e84-9efa-0732d6f643b0 service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Received event network-vif-unplugged-541e273b-cc24-4f3c-bec6-f8f6f583dd31 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8de0f165-d5ca-40cc-be79-2bbd47618e0b req-aa0bd9c3-1720-4e84-9efa-0732d6f643b0 service nova] Acquiring lock "430c2ff8-2b09-43e8-b27e-caf8153ff892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8de0f165-d5ca-40cc-be79-2bbd47618e0b req-aa0bd9c3-1720-4e84-9efa-0732d6f643b0 service nova] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8de0f165-d5ca-40cc-be79-2bbd47618e0b req-aa0bd9c3-1720-4e84-9efa-0732d6f643b0 service nova] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-8de0f165-d5ca-40cc-be79-2bbd47618e0b req-aa0bd9c3-1720-4e84-9efa-0732d6f643b0 service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] No waiting events found dispatching network-vif-unplugged-541e273b-cc24-4f3c-bec6-f8f6f583dd31 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-8de0f165-d5ca-40cc-be79-2bbd47618e0b req-aa0bd9c3-1720-4e84-9efa-0732d6f643b0 service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Received event network-vif-unplugged-541e273b-cc24-4f3c-bec6-f8f6f583dd31 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-8de0f165-d5ca-40cc-be79-2bbd47618e0b req-aa0bd9c3-1720-4e84-9efa-0732d6f643b0 service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Received event network-vif-plugged-541e273b-cc24-4f3c-bec6-f8f6f583dd31 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8de0f165-d5ca-40cc-be79-2bbd47618e0b req-aa0bd9c3-1720-4e84-9efa-0732d6f643b0 service nova] Acquiring lock "430c2ff8-2b09-43e8-b27e-caf8153ff892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8de0f165-d5ca-40cc-be79-2bbd47618e0b req-aa0bd9c3-1720-4e84-9efa-0732d6f643b0 service nova] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8de0f165-d5ca-40cc-be79-2bbd47618e0b req-aa0bd9c3-1720-4e84-9efa-0732d6f643b0 service nova] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-8de0f165-d5ca-40cc-be79-2bbd47618e0b req-aa0bd9c3-1720-4e84-9efa-0732d6f643b0 service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] No waiting events found dispatching network-vif-plugged-541e273b-cc24-4f3c-bec6-f8f6f583dd31 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:08:43 user nova-compute[75021]: WARNING nova.compute.manager [req-8de0f165-d5ca-40cc-be79-2bbd47618e0b req-aa0bd9c3-1720-4e84-9efa-0732d6f643b0 service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Received unexpected event network-vif-plugged-541e273b-cc24-4f3c-bec6-f8f6f583dd31 for instance with vm_state active and task_state deleting.
Dec 06 07:08:43 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Snapshot image upload complete
Dec 06 07:08:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:08:43 user nova-compute[75021]: INFO nova.compute.manager [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Shelve offloading
Dec 06 07:08:43 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Instance destroyed successfully.
Dec 06 07:08:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquired lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:08:43 user nova-compute[75021]: DEBUG nova.network.neutron [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:08:44 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:08:44 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Took 1.08 seconds to deallocate network for instance.
Dec 06 07:08:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-9178b0eb-4e82-4d79-8bf0-719c28d3179c req-2b08ac65-ef38-41ee-8544-13727b71c780 service nova] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Received event network-vif-deleted-541e273b-cc24-4f3c-bec6-f8f6f583dd31 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:08:44 user nova-compute[75021]: WARNING nova.volume.cinder [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Attachment 92f0b79d-0d9f-46f8-9a5e-b37e8245e499 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 92f0b79d-0d9f-46f8-9a5e-b37e8245e499. (HTTP 404) (Request-ID: req-cb566dc9-2dbb-4f0c-8ef8-0e271e7d1212)
Dec 06 07:08:44 user nova-compute[75021]: INFO nova.compute.manager [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 430c2ff8-2b09-43e8-b27e-caf8153ff892] Took 0.02 seconds to detach 1 volumes for instance.
Dec 06 07:08:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:44 user nova-compute[75021]: DEBUG nova.network.neutron [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Updating instance_info_cache with network_info: [{"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:08:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Releasing lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:08:44 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:08:44 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:08:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:44 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Deleted allocations for instance 430c2ff8-2b09-43e8-b27e-caf8153ff892
Dec 06 07:08:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0bbe5b3a-414d-437e-a76e-f9b1a6a21bd0 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "430c2ff8-2b09-43e8-b27e-caf8153ff892" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.885s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Instance destroyed successfully.
Dec 06 07:08:45 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'resources' on Instance uuid e600e40b-0b08-4341-a48e-652da530e59c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1837730268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1837730268',id=22,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5hWtq5TK0J0vpeo8aXAbvXCQ9ENJgvBGr2J66uQaNfFfPKHwNmVUNM2CHMhzie5xHYDXLzmEqeLL/Q6avdg1NwA1Dnzt6JyxnqTPO0wuy2VUmBr2q/1R0+cnZW8dXADA==',key_name='tempest-keypair-1138365958',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:06:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d75ae216dcb345c79a5c2a4d38e51b38',ramdisk_id='',reservation_id='r-98ifjfwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1923852465',owner_user_name='tempest-AttachVolumeShelveTestJSON-1923852465-project-member',shelved_at='2023-12-06T07:08:43.842452',shelved_host='user',shelved_image_id='d5175154-2289-44af-9505-eb649c5c055c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4daf20c071c4b5cb826452811323abd',uuid=e600e40b-0b08-4341-a48e-652da530e59c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converting VIF {"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:13:29,bridge_name='br-int',has_traffic_filtering=True,id=d18bb07e-28df-49e3-b5b2-5e7cec5adee4,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bb07e-28') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG os_vif [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:13:29,bridge_name='br-int',has_traffic_filtering=True,id=d18bb07e-28df-49e3-b5b2-5e7cec5adee4,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bb07e-28') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd18bb07e-28, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e7158f2-bac3-46f5-bd72-c01a2caf1a43) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:08:45 user nova-compute[75021]: INFO os_vif [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:13:29,bridge_name='br-int',has_traffic_filtering=True,id=d18bb07e-28df-49e3-b5b2-5e7cec5adee4,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bb07e-28')
Dec 06 07:08:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Deleting instance files /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c_del
Dec 06 07:08:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Deletion of /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c_del complete
Dec 06 07:08:45 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Deleted allocations for instance e600e40b-0b08-4341-a48e-652da530e59c
Dec 06 07:08:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'numa_topology' on Instance uuid e600e40b-0b08-4341-a48e-652da530e59c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG nova.objects.base [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Object Instance<e600e40b-0b08-4341-a48e-652da530e59c> lazy-loaded attributes: resources,numa_topology {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-5e274fc8-a041-41ae-ada2-303d843c17ba req-158277e6-4fcc-4a56-912d-91764cd5bcd2 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received event network-changed-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-5e274fc8-a041-41ae-ada2-303d843c17ba req-158277e6-4fcc-4a56-912d-91764cd5bcd2 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Refreshing instance network info cache due to event network-changed-d18bb07e-28df-49e3-b5b2-5e7cec5adee4. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5e274fc8-a041-41ae-ada2-303d843c17ba req-158277e6-4fcc-4a56-912d-91764cd5bcd2 service nova] Acquiring lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5e274fc8-a041-41ae-ada2-303d843c17ba req-158277e6-4fcc-4a56-912d-91764cd5bcd2 service nova] Acquired lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG nova.network.neutron [req-5e274fc8-a041-41ae-ada2-303d843c17ba req-158277e6-4fcc-4a56-912d-91764cd5bcd2 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Refreshing network info cache for port d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:08:45 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:08:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd1b7d42-9907-4896-a5ff-417e318f1f0e tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "e600e40b-0b08-4341-a48e-652da530e59c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.894s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:46 user nova-compute[75021]: DEBUG nova.network.neutron [req-5e274fc8-a041-41ae-ada2-303d843c17ba req-158277e6-4fcc-4a56-912d-91764cd5bcd2 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Updated VIF entry in instance network info cache for port d18bb07e-28df-49e3-b5b2-5e7cec5adee4. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:08:46 user nova-compute[75021]: DEBUG nova.network.neutron [req-5e274fc8-a041-41ae-ada2-303d843c17ba req-158277e6-4fcc-4a56-912d-91764cd5bcd2 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Updating instance_info_cache with network_info: [{"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd18bb07e-28", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:08:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5e274fc8-a041-41ae-ada2-303d843c17ba req-158277e6-4fcc-4a56-912d-91764cd5bcd2 service nova] Releasing lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:08:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:54 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lazy-loading 'flavor' on Instance uuid 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:08:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:55 user nova-compute[75021]: INFO nova.compute.manager [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Attaching volume 606964c2-1400-47ec-be62-0ee77c5a9000 to /dev/vdb
Dec 06 07:08:55 user nova-compute[75021]: DEBUG os_brick.utils [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb36a711-2f7c-4eb8-9689-3cdc675e6c29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7617d3-279e-4843-b9d3-2a6020534d6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[642bc793-2df0-4172-b044-9b2bcb388bd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fbc98c-be56-4aed-bbc3-3daa4a2a4aff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:08:55 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:08:55 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f41c31c-d690-46bc-bd10-97b6e4c0fe28]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG os_brick.utils [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Updating existing volume attachment record: 7137115b-e0d0-4fe3-a670-f7d2a6bbb06c {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:08:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:08:59 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:08:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:08:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:08:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:08:59 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:08:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:08:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:08:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:08:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:09:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:04 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:09:04 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7620MB free_disk=25.32882308959961GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5c50a6a8-2500-4408-a932-48f0116713b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 8b8eb320-6348-4038-a57e-02bf1e015174 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:09:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcVxvqsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:09:06 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:09:06 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:09:06 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e69526-dd66-4b91-9c70-4a505dd5327e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:09:06 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcdc1a8-d96c-45b0-8e07-3e49179db32c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000] added
Dec 06 07:09:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cc002e-62b7-42df-8516-f83fed537f4f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5f8903-b069-4878-941e-834bc267af08]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UcVxvqsR {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UcVxvqsR" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc75a106-abb3-4f70-a3c3-6d6ffcd1349c]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UcVxvqsR'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[435c6bfa-98b9-4abf-8475-a2a837f7e002]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9129ea15-f87b-405b-b0b3-58c112f8cb8d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:06 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:06 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac3a656-25fc-4369-b8ac-2cf8bc7a13f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000, portal: 172.16.0.220,3260]
Dec 06 07:09:06 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000, portal: 172.16.0.220,3260] successful.
Dec 06 07:09:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecf6392-67ad-4c98-8da0-31b81b945f09]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d361b66b-7a99-42f3-bd1a-c60473fe0a62]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:06 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:06 user nova-compute[75021]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)
Dec 06 07:09:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:06 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:06 user nova-compute[75021]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)
Dec 06 07:09:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[834d60bf-b3a6-4b1f-a320-2c42c4584caa]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcVxvqsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-5c50a6a8-2500-4408-a932-48f0116713b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-5c50a6a8-2500-4408-a932-48f0116713b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:06 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23932353533616262', 'path': '/dev/sdc'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932353533616262', 'path': '/dev/sdc'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lazy-loading 'flavor' on Instance uuid 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:09:07 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:09:07 user nova-compute[75021]:   <source dev="/dev/sdc"/>
Dec 06 07:09:07 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:09:07 user nova-compute[75021]:   <serial>606964c2-1400-47ec-be62-0ee77c5a9000</serial>
Dec 06 07:09:07 user nova-compute[75021]: </disk>
Dec 06 07:09:07 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Updating instance_info_cache with network_info: [{"id": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "address": "fa:16:3e:f3:41:7d", "network": {"id": "6838b696-43bf-4794-ae4c-82828037f5cf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1983647302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ce66a727943c7a4e1cf96225c9ff1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e699ac5-b0", "ovs_interfaceid": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-5c50a6a8-2500-4408-a932-48f0116713b8" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:09:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:09:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] No VIF found with MAC fa:16:3e:f3:41:7d, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:09:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fff11abe-5e73-491b-9ed6-24517fe98a13 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.135s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:09 user nova-compute[75021]: DEBUG nova.compute.manager [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:09:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:09:09 user nova-compute[75021]: INFO nova.compute.claims [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Claim successful on node user
Dec 06 07:09:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-98ef9810-5eea-4625-9426-8090153c88e7 req-57ca4863-0d15-4fdb-9e06-e26dd4ddf07e service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received event network-changed-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-98ef9810-5eea-4625-9426-8090153c88e7 req-57ca4863-0d15-4fdb-9e06-e26dd4ddf07e service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Refreshing instance network info cache due to event network-changed-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:09:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-98ef9810-5eea-4625-9426-8090153c88e7 req-57ca4863-0d15-4fdb-9e06-e26dd4ddf07e service nova] Acquiring lock "refresh_cache-bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-98ef9810-5eea-4625-9426-8090153c88e7 req-57ca4863-0d15-4fdb-9e06-e26dd4ddf07e service nova] Acquired lock "refresh_cache-bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:09 user nova-compute[75021]: DEBUG nova.network.neutron [req-98ef9810-5eea-4625-9426-8090153c88e7 req-57ca4863-0d15-4fdb-9e06-e26dd4ddf07e service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Refreshing network info cache for port 6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG nova.network.neutron [req-98ef9810-5eea-4625-9426-8090153c88e7 req-57ca4863-0d15-4fdb-9e06-e26dd4ddf07e service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Updated VIF entry in instance network info cache for port 6a9c80ab-da5d-4fd5-b757-3c09fa3c1563. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG nova.network.neutron [req-98ef9810-5eea-4625-9426-8090153c88e7 req-57ca4863-0d15-4fdb-9e06-e26dd4ddf07e service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Updating instance_info_cache with network_info: [{"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.797s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-98ef9810-5eea-4625-9426-8090153c88e7 req-57ca4863-0d15-4fdb-9e06-e26dd4ddf07e service nova] Releasing lock "refresh_cache-bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lazy-loading 'flavor' on Instance uuid bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG nova.network.neutron [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:09:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:09:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG nova.policy [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5e1155d2c304bdd8404712faf046b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae65045cef754813bd33f68b9868dc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:09:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Creating image(s)
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "/opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "/opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "/opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:10 user nova-compute[75021]: INFO nova.compute.manager [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Attaching volume aaa85e8a-1642-438b-9d04-aa5ca22d3d5b to /dev/vdb
Dec 06 07:09:10 user nova-compute[75021]: DEBUG os_brick.utils [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a3239a-8572-41d3-830f-2dd0439a8acc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78b06cc-147a-40ae-b001-9e2bc93aadf4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.213s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[361908dd-f166-4ae7-88c6-e6f39825a929]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21aa68a-562b-4b68-a36c-0686551458e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:09:11 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1604553-c066-4455-82a4-864960a7d754]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG os_brick.utils [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Updating existing volume attachment record: def15e4b-364d-42bb-8938-f5578f58b6c3 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.187s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk 1073741824" returned: 0 in 0.062s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG nova.network.neutron [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Successfully created port: 177516ce-7e6c-4c3c-b2bf-d1c538d10f7e {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:09:11 user nova-compute[75021]: INFO nova.compute.manager [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Detaching volume 606964c2-1400-47ec-be62-0ee77c5a9000
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.220s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:11 user nova-compute[75021]: INFO nova.virt.block_device [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Attempting to driver detach volume 606964c2-1400-47ec-be62-0ee77c5a9000 from mountpoint /dev/vdb
Dec 06 07:09:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Attempting to detach device vdb from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:09:11 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:09:11 user nova-compute[75021]:   <source dev="/dev/sdc"/>
Dec 06 07:09:11 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:09:11 user nova-compute[75021]:   <serial>606964c2-1400-47ec-be62-0ee77c5a9000</serial>
Dec 06 07:09:11 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:09:11 user nova-compute[75021]: </disk>
Dec 06 07:09:11 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:09:11 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Successfully detached device vdb from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the persistent domain config.
Dec 06 07:09:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:09:11 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:09:11 user nova-compute[75021]:   <source dev="/dev/sdc"/>
Dec 06 07:09:11 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:09:11 user nova-compute[75021]:   <serial>606964c2-1400-47ec-be62-0ee77c5a9000</serial>
Dec 06 07:09:11 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:09:11 user nova-compute[75021]: </disk>
Dec 06 07:09:11 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Cannot resize image /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Ensure instance console log exists: /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Successfully updated port: 177516ce-7e6c-4c3c-b2bf-d1c538d10f7e {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "refresh_cache-65e7540f-3e73-4d4c-8b8f-2a53dac610a0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquired lock "refresh_cache-65e7540f-3e73-4d4c-8b8f-2a53dac610a0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-c979b1fa-de70-4fb4-a44b-68b9cee6cb18 req-18254d64-b81b-4c21-845c-f77bafaae95e service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Received event network-changed-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-c979b1fa-de70-4fb4-a44b-68b9cee6cb18 req-18254d64-b81b-4c21-845c-f77bafaae95e service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Refreshing instance network info cache due to event network-changed-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c979b1fa-de70-4fb4-a44b-68b9cee6cb18 req-18254d64-b81b-4c21-845c-f77bafaae95e service nova] Acquiring lock "refresh_cache-65e7540f-3e73-4d4c-8b8f-2a53dac610a0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Updating instance_info_cache with network_info: [{"id": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "address": "fa:16:3e:6d:44:f6", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177516ce-7e", "ovs_interfaceid": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Releasing lock "refresh_cache-65e7540f-3e73-4d4c-8b8f-2a53dac610a0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Instance network_info: |[{"id": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "address": "fa:16:3e:6d:44:f6", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177516ce-7e", "ovs_interfaceid": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c979b1fa-de70-4fb4-a44b-68b9cee6cb18 req-18254d64-b81b-4c21-845c-f77bafaae95e service nova] Acquired lock "refresh_cache-65e7540f-3e73-4d4c-8b8f-2a53dac610a0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.network.neutron [req-c979b1fa-de70-4fb4-a44b-68b9cee6cb18 req-18254d64-b81b-4c21-845c-f77bafaae95e service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Refreshing network info cache for port 177516ce-7e6c-4c3c-b2bf-d1c538d10f7e {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Start _get_guest_xml network_info=[{"id": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "address": "fa:16:3e:6d:44:f6", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177516ce-7e", "ovs_interfaceid": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:09:12 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:09:12 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1215160675',display_name='tempest-AttachVolumeNegativeTest-server-1215160675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1215160675',id=26,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg03dlEtgAq6SdY8CQM6ZNpBjVxQTSTHpBd22Hsg5qQDoJ3Q8/C6zsQcBFZyzKwEIE6odg1yrNbJwjJ3LuBGrxzQAhiRUnwzKyyD9E34Q8OYleRZdC/h7amA7IzAR5d9g==',key_name='tempest-keypair-1698207691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae65045cef754813bd33f68b9868dc9d',ramdisk_id='',reservation_id='r-3baipyid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-967416759',owner_user_name='tempest-AttachVolumeNegativeTest-967416759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e1155d2c304bdd8404712faf046b05',uuid=65e7540f-3e73-4d4c-8b8f-2a53dac610a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "address": "fa:16:3e:6d:44:f6", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177516ce-7e", "ovs_interfaceid": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converting VIF {"id": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "address": "fa:16:3e:6d:44:f6", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177516ce-7e", "ovs_interfaceid": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:44:f6,bridge_name='br-int',has_traffic_filtering=True,id=177516ce-7e6c-4c3c-b2bf-d1c538d10f7e,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap177516ce-7e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.objects.instance [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'pci_devices' on Instance uuid 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:09:12 user nova-compute[75021]:   <uuid>65e7540f-3e73-4d4c-8b8f-2a53dac610a0</uuid>
Dec 06 07:09:12 user nova-compute[75021]:   <name>instance-0000001a</name>
Dec 06 07:09:12 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:09:12 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:09:12 user nova-compute[75021]:   <metadata>
Dec 06 07:09:12 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:09:12 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:09:12 user nova-compute[75021]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1215160675</nova:name>
Dec 06 07:09:12 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:09:12</nova:creationTime>
Dec 06 07:09:12 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:09:12 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:09:12 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:09:12 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:09:12 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:09:12 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:09:12 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:09:12 user nova-compute[75021]:       <nova:owner>
Dec 06 07:09:12 user nova-compute[75021]:         <nova:user uuid="c5e1155d2c304bdd8404712faf046b05">tempest-AttachVolumeNegativeTest-967416759-project-member</nova:user>
Dec 06 07:09:12 user nova-compute[75021]:         <nova:project uuid="ae65045cef754813bd33f68b9868dc9d">tempest-AttachVolumeNegativeTest-967416759</nova:project>
Dec 06 07:09:12 user nova-compute[75021]:       </nova:owner>
Dec 06 07:09:12 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:09:12 user nova-compute[75021]:       <nova:ports>
Dec 06 07:09:12 user nova-compute[75021]:         <nova:port uuid="177516ce-7e6c-4c3c-b2bf-d1c538d10f7e">
Dec 06 07:09:12 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 07:09:12 user nova-compute[75021]:         </nova:port>
Dec 06 07:09:12 user nova-compute[75021]:       </nova:ports>
Dec 06 07:09:12 user nova-compute[75021]:     </nova:instance>
Dec 06 07:09:12 user nova-compute[75021]:   </metadata>
Dec 06 07:09:12 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:09:12 user nova-compute[75021]:     <system>
Dec 06 07:09:12 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:09:12 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:09:12 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:09:12 user nova-compute[75021]:       <entry name="serial">65e7540f-3e73-4d4c-8b8f-2a53dac610a0</entry>
Dec 06 07:09:12 user nova-compute[75021]:       <entry name="uuid">65e7540f-3e73-4d4c-8b8f-2a53dac610a0</entry>
Dec 06 07:09:12 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:09:12 user nova-compute[75021]:     </system>
Dec 06 07:09:12 user nova-compute[75021]:   </sysinfo>
Dec 06 07:09:12 user nova-compute[75021]:   <os>
Dec 06 07:09:12 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:09:12 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:09:12 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:09:12 user nova-compute[75021]:   </os>
Dec 06 07:09:12 user nova-compute[75021]:   <features>
Dec 06 07:09:12 user nova-compute[75021]:     <acpi/>
Dec 06 07:09:12 user nova-compute[75021]:     <apic/>
Dec 06 07:09:12 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:09:12 user nova-compute[75021]:   </features>
Dec 06 07:09:12 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:09:12 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:09:12 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:09:12 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:09:12 user nova-compute[75021]:   </clock>
Dec 06 07:09:12 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:09:12 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:09:12 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:09:12 user nova-compute[75021]:   </cpu>
Dec 06 07:09:12 user nova-compute[75021]:   <devices>
Dec 06 07:09:12 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:09:12 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:09:12 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk"/>
Dec 06 07:09:12 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:09:12 user nova-compute[75021]:     </disk>
Dec 06 07:09:12 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:09:12 user nova-compute[75021]:       <mac address="fa:16:3e:6d:44:f6"/>
Dec 06 07:09:12 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:09:12 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:09:12 user nova-compute[75021]:       <target dev="tap177516ce-7e"/>
Dec 06 07:09:12 user nova-compute[75021]:     </interface>
Dec 06 07:09:12 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:09:12 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/console.log" append="off"/>
Dec 06 07:09:12 user nova-compute[75021]:     </serial>
Dec 06 07:09:12 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:09:12 user nova-compute[75021]:     <video>
Dec 06 07:09:12 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:09:12 user nova-compute[75021]:     </video>
Dec 06 07:09:12 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:09:12 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:09:12 user nova-compute[75021]:     </rng>
Dec 06 07:09:12 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:09:12 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:09:12 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:09:12 user nova-compute[75021]:     </memballoon>
Dec 06 07:09:12 user nova-compute[75021]:   </devices>
Dec 06 07:09:12 user nova-compute[75021]: </domain>
Dec 06 07:09:12 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1215160675',display_name='tempest-AttachVolumeNegativeTest-server-1215160675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1215160675',id=26,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg03dlEtgAq6SdY8CQM6ZNpBjVxQTSTHpBd22Hsg5qQDoJ3Q8/C6zsQcBFZyzKwEIE6odg1yrNbJwjJ3LuBGrxzQAhiRUnwzKyyD9E34Q8OYleRZdC/h7amA7IzAR5d9g==',key_name='tempest-keypair-1698207691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae65045cef754813bd33f68b9868dc9d',ramdisk_id='',reservation_id='r-3baipyid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-967416759',owner_user_name='tempest-AttachVolumeNegativeTest-967416759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e1155d2c304bdd8404712faf046b05',uuid=65e7540f-3e73-4d4c-8b8f-2a53dac610a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "address": "fa:16:3e:6d:44:f6", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177516ce-7e", "ovs_interfaceid": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converting VIF {"id": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "address": "fa:16:3e:6d:44:f6", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177516ce-7e", "ovs_interfaceid": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:44:f6,bridge_name='br-int',has_traffic_filtering=True,id=177516ce-7e6c-4c3c-b2bf-d1c538d10f7e,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap177516ce-7e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG os_vif [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:44:f6,bridge_name='br-int',has_traffic_filtering=True,id=177516ce-7e6c-4c3c-b2bf-d1c538d10f7e,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap177516ce-7e') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cc38eed-dc9a-5686-a285-6b69bdfce7fb', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap177516ce-7e, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap177516ce-7e, col_values=(('qos', UUID('42def7f8-abc7-4ab9-a554-4b18cd6f62d2')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap177516ce-7e, col_values=(('external_ids', {'iface-id': '177516ce-7e6c-4c3c-b2bf-d1c538d10f7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:44:f6', 'vm-uuid': '65e7540f-3e73-4d4c-8b8f-2a53dac610a0'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:12 user nova-compute[75021]: INFO os_vif [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:44:f6,bridge_name='br-int',has_traffic_filtering=True,id=177516ce-7e6c-4c3c-b2bf-d1c538d10f7e,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap177516ce-7e')
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No VIF found with MAC fa:16:3e:6d:44:f6, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.network.neutron [req-c979b1fa-de70-4fb4-a44b-68b9cee6cb18 req-18254d64-b81b-4c21-845c-f77bafaae95e service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Updated VIF entry in instance network info cache for port 177516ce-7e6c-4c3c-b2bf-d1c538d10f7e. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG nova.network.neutron [req-c979b1fa-de70-4fb4-a44b-68b9cee6cb18 req-18254d64-b81b-4c21-845c-f77bafaae95e service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Updating instance_info_cache with network_info: [{"id": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "address": "fa:16:3e:6d:44:f6", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177516ce-7e", "ovs_interfaceid": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c979b1fa-de70-4fb4-a44b-68b9cee6cb18 req-18254d64-b81b-4c21-845c-f77bafaae95e service nova] Releasing lock "refresh_cache-65e7540f-3e73-4d4c-8b8f-2a53dac610a0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-148d920e-ff70-44bf-b806-63b2b2508882 req-3f21eeff-f8e8-43ac-b375-adec9130fa3d service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Received event network-vif-plugged-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-148d920e-ff70-44bf-b806-63b2b2508882 req-3f21eeff-f8e8-43ac-b375-adec9130fa3d service nova] Acquiring lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-148d920e-ff70-44bf-b806-63b2b2508882 req-3f21eeff-f8e8-43ac-b375-adec9130fa3d service nova] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-148d920e-ff70-44bf-b806-63b2b2508882 req-3f21eeff-f8e8-43ac-b375-adec9130fa3d service nova] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-148d920e-ff70-44bf-b806-63b2b2508882 req-3f21eeff-f8e8-43ac-b375-adec9130fa3d service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] No waiting events found dispatching network-vif-plugged-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:09:14 user nova-compute[75021]: WARNING nova.compute.manager [req-148d920e-ff70-44bf-b806-63b2b2508882 req-3f21eeff-f8e8-43ac-b375-adec9130fa3d service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Received unexpected event network-vif-plugged-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e for instance with vm_state building and task_state spawning.
Dec 06 07:09:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-4e280647-c869-4269-828c-8d9b5735315f req-363c5394-0a1e-48a7-9475-e341d9c00cf3 service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Received event network-vif-plugged-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4e280647-c869-4269-828c-8d9b5735315f req-363c5394-0a1e-48a7-9475-e341d9c00cf3 service nova] Acquiring lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4e280647-c869-4269-828c-8d9b5735315f req-363c5394-0a1e-48a7-9475-e341d9c00cf3 service nova] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4e280647-c869-4269-828c-8d9b5735315f req-363c5394-0a1e-48a7-9475-e341d9c00cf3 service nova] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-4e280647-c869-4269-828c-8d9b5735315f req-363c5394-0a1e-48a7-9475-e341d9c00cf3 service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] No waiting events found dispatching network-vif-plugged-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:09:16 user nova-compute[75021]: WARNING nova.compute.manager [req-4e280647-c869-4269-828c-8d9b5735315f req-363c5394-0a1e-48a7-9475-e341d9c00cf3 service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Received unexpected event network-vif-plugged-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e for instance with vm_state building and task_state spawning.
Dec 06 07:09:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:09:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:09:16 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Instance spawned successfully.
Dec 06 07:09:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:09:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:16 user nova-compute[75021]: INFO nova.compute.manager [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Took 5.84 seconds to spawn the instance on the hypervisor.
Dec 06 07:09:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:09:16 user nova-compute[75021]: INFO nova.compute.manager [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Took 7.10 seconds to build instance.
Dec 06 07:09:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cdc05d49-5b8d-44af-99f9-0419dd28c5ba tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.218s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:18 user nova-compute[75021]: INFO nova.compute.manager [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Rescuing
Dec 06 07:09:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquired lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:09:19 user nova-compute[75021]: DEBUG nova.network.neutron [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Updating instance_info_cache with network_info: [{"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Releasing lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-a107e23b-93a3-451d-825d-ea2a8936b8d8 req-ffa54215-98de-44e9-94bc-36735f9314fa service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received event network-vif-unplugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a107e23b-93a3-451d-825d-ea2a8936b8d8 req-ffa54215-98de-44e9-94bc-36735f9314fa service nova] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a107e23b-93a3-451d-825d-ea2a8936b8d8 req-ffa54215-98de-44e9-94bc-36735f9314fa service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a107e23b-93a3-451d-825d-ea2a8936b8d8 req-ffa54215-98de-44e9-94bc-36735f9314fa service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-a107e23b-93a3-451d-825d-ea2a8936b8d8 req-ffa54215-98de-44e9-94bc-36735f9314fa service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] No waiting events found dispatching network-vif-unplugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:09:20 user nova-compute[75021]: WARNING nova.compute.manager [req-a107e23b-93a3-451d-825d-ea2a8936b8d8 req-ffa54215-98de-44e9-94bc-36735f9314fa service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received unexpected event network-vif-unplugged-a3831721-6988-44ee-89a6-35d80066e41b for instance with vm_state active and task_state rescuing.
Dec 06 07:09:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:20 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Instance destroyed successfully.
Dec 06 07:09:20 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Attempting a stable device rescue
Dec 06 07:09:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75021) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 07:09:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Instance directory exists: not creating {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 07:09:20 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Creating image(s)
Dec 06 07:09:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "/opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "/opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "/opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:20 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'trusted_certs' on Instance uuid 828f5456-6310-4664-87b3-ee0ed6787d3f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:09:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "458e11fc59dadaeed9b7f08ee22ab01d7de9de1f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "458e11fc59dadaeed9b7f08ee22ab01d7de9de1f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458e11fc59dadaeed9b7f08ee22ab01d7de9de1f.part --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458e11fc59dadaeed9b7f08ee22ab01d7de9de1f.part --force-share --output=json" returned: 0 in 0.209s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG nova.virt.images [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] 1d155013-eb31-452d-9f77-e3e46beb4044 was qcow2, converting to raw {{(pid=75021) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/458e11fc59dadaeed9b7f08ee22ab01d7de9de1f.part /opt/stack/data/nova/instances/_base/458e11fc59dadaeed9b7f08ee22ab01d7de9de1f.converted {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-d14eca6d-2cc3-48af-bfad-b4ee698005ff req-7e553ca3-9d1b-407d-8bfb-249f5c341602 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d14eca6d-2cc3-48af-bfad-b4ee698005ff req-7e553ca3-9d1b-407d-8bfb-249f5c341602 service nova] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d14eca6d-2cc3-48af-bfad-b4ee698005ff req-7e553ca3-9d1b-407d-8bfb-249f5c341602 service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d14eca6d-2cc3-48af-bfad-b4ee698005ff req-7e553ca3-9d1b-407d-8bfb-249f5c341602 service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-d14eca6d-2cc3-48af-bfad-b4ee698005ff req-7e553ca3-9d1b-407d-8bfb-249f5c341602 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] No waiting events found dispatching network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:09:22 user nova-compute[75021]: WARNING nova.compute.manager [req-d14eca6d-2cc3-48af-bfad-b4ee698005ff req-7e553ca3-9d1b-407d-8bfb-249f5c341602 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received unexpected event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b for instance with vm_state active and task_state rescuing.
Dec 06 07:09:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/458e11fc59dadaeed9b7f08ee22ab01d7de9de1f.part /opt/stack/data/nova/instances/_base/458e11fc59dadaeed9b7f08ee22ab01d7de9de1f.converted" returned: 0 in 0.289s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458e11fc59dadaeed9b7f08ee22ab01d7de9de1f.converted --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQPmIpsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:09:22 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:09:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:09:22 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:09:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:09:22 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b892f32-e4c4-41a0-915a-53b32162e1e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:09:22 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458e11fc59dadaeed9b7f08ee22ab01d7de9de1f.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "458e11fc59dadaeed9b7f08ee22ab01d7de9de1f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.960s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "458e11fc59dadaeed9b7f08ee22ab01d7de9de1f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "458e11fc59dadaeed9b7f08ee22ab01d7de9de1f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458e11fc59dadaeed9b7f08ee22ab01d7de9de1f --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[479e4b0d-3f74-426d-91c7-ad9e926d676b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b] added
Dec 06 07:09:22 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2edcd55-6bdc-4b34-9a12-f28ea881b463]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c482e0-9ddb-41c1-babf-a5bca1783dcd]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQPmIpsN {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQPmIpsN" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1e4ad2-2f66-4827-a601-be5789f37090]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iQPmIpsN'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e08ec65-d577-4473-93bc-9df719b6f6d2]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9390b63a-c8c3-4b93-8b2a-c23473da3004]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:23 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:23 user nova-compute[75021]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)
Dec 06 07:09:23 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:23 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:23 user nova-compute[75021]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)
Dec 06 07:09:23 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458e11fc59dadaeed9b7f08ee22ab01d7de9de1f --force-share --output=json" returned: 0 in 0.237s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458e11fc59dadaeed9b7f08ee22ab01d7de9de1f,backing_fmt=raw /opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/disk.rescue {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c1b02f-ba4b-420d-b39b-403651ce8f38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260]
Dec 06 07:09:23 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260] successful.
Dec 06 07:09:23 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458e11fc59dadaeed9b7f08ee22ab01d7de9de1f,backing_fmt=raw /opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/disk.rescue" returned: 0 in 0.053s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "458e11fc59dadaeed9b7f08ee22ab01d7de9de1f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'migration_context' on Instance uuid 828f5456-6310-4664-87b3-ee0ed6787d3f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.objects.base [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Object Instance<828f5456-6310-4664-87b3-ee0ed6787d3f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Start _get_guest_xml network_info=[{"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "vif_mac": "fa:16:3e:ba:ed:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1d155013-eb31-452d-9f77-e3e46beb4044', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd70a7a65-5737-420a-97a7-68cb015fcb06', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujAilWOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '828f5456-6310-4664-87b3-ee0ed6787d3f', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5a03d75-07a1-4973-9127-073695e5fa44', 'serial': 'f5a03d75-07a1-4973-9127-073695e5fa44'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'resources' on Instance uuid 828f5456-6310-4664-87b3-ee0ed6787d3f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5010fce-83b2-48eb-b969-7304c39d7b67]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.objects.base [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Object Instance<828f5456-6310-4664-87b3-ee0ed6787d3f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'numa_topology' on Instance uuid 828f5456-6310-4664-87b3-ee0ed6787d3f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.objects.base [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Object Instance<828f5456-6310-4664-87b3-ee0ed6787d3f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cca02d-3ed3-44b3-b945-8d2dc1b5bfeb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:23 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:23 user nova-compute[75021]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)
Dec 06 07:09:23 user nova-compute[75021]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:09:23 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:23 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:23 user nova-compute[75021]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)
Dec 06 07:09:23 user nova-compute[75021]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:09:23 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:23 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:09:23 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'vcpu_model' on Instance uuid 828f5456-6310-4664-87b3-ee0ed6787d3f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[28611ed1-28d8-40d7-beec-823b4d24120a]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQPmIpsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.objects.base [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Object Instance<828f5456-6310-4664-87b3-ee0ed6787d3f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujAilWOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:09:23 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:09:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:09:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '23036393239363363', 'path': '/dev/sde'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036393239363363', 'path': '/dev/sde'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.967s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:09:24 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:09:24 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lazy-loading 'flavor' on Instance uuid bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd3b3d1-0011-4886-b081-1685e176c245]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ujAilWOc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 06 07:09:24 user nova-compute[75021]: node.name = iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:09:24 user nova-compute[75021]: node.tpgt = -1
Dec 06 07:09:24 user nova-compute[75021]: node.startup = automatic
Dec 06 07:09:24 user nova-compute[75021]: node.leading_login = No
Dec 06 07:09:24 user nova-compute[75021]: iface.iscsi_ifacename = default
Dec 06 07:09:24 user nova-compute[75021]: iface.net_ifacename = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.ipaddress = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.prefix_len = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.hwaddress = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.transport_name = tcp
Dec 06 07:09:24 user nova-compute[75021]: iface.initiatorname = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.state = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.vlan_id = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.vlan_priority = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.vlan_state = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.iface_num = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.mtu = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.port = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.bootproto = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.subnet_mask = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.gateway = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.dhcp_alt_client_id_state = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.dhcp_alt_client_id = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.dhcp_dns = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.dhcp_learn_iqn = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.dhcp_req_vendor_id_state = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.dhcp_vendor_id_state = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.dhcp_vendor_id = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.dhcp_slp_da = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.fragmentation = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.gratuitous_arp = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.incoming_forwarding = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.tos_state = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.tos = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.ttl = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.delayed_ack = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.tcp_nagle = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.tcp_wsf_state = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.tcp_wsf = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.tcp_timer_scale = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.tcp_timestamp = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.redirect = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.def_task_mgmt_timeout = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.header_digest = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.data_digest = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.immediate_data = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.initial_r2t = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.data_seq_inorder = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.data_pdu_inorder = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.erl = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.max_receive_data_len = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.first_burst_len = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.max_outstanding_r2t = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.max_burst_len = 0
Dec 06 07:09:24 user nova-compute[75021]: iface.chap_auth = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.bidi_chap = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.strict_login_compliance = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.discovery_auth = <empty>
Dec 06 07:09:24 user nova-compute[75021]: iface.discovery_logout = <empty>
Dec 06 07:09:24 user nova-compute[75021]: node.discovery_address = <empty>
Dec 06 07:09:24 user nova-compute[75021]: node.discovery_port = 0
Dec 06 07:09:24 user nova-compute[75021]: node.discovery_type = static
Dec 06 07:09:24 user nova-compute[75021]: node.session.initial_cmdsn = 0
Dec 06 07:09:24 user nova-compute[75021]: node.session.initial_login_retry_max = 8
Dec 06 07:09:24 user nova-compute[75021]: node.session.xmit_thread_priority = -20
Dec 06 07:09:24 user nova-compute[75021]: node.session.cmds_max = 128
Dec 06 07:09:24 user nova-compute[75021]: node.session.queue_depth = 32
Dec 06 07:09:24 user nova-compute[75021]: node.session.nr_sessions = 1
Dec 06 07:09:24 user nova-compute[75021]: node.session.auth.authmethod = CHAP
Dec 06 07:09:24 user nova-compute[75021]: node.session.auth.username = ujAilWOc
Dec 06 07:09:24 user nova-compute[75021]: node.session.auth.password = ***
Dec 06 07:09:24 user nova-compute[75021]: node.session.auth.username_in = <empty>
Dec 06 07:09:24 user nova-compute[75021]: node.session.auth.password_in = <empty>
Dec 06 07:09:24 user nova-compute[75021]: node.session.auth.chap_algs = MD5
Dec 06 07:09:24 user nova-compute[75021]: node.session.timeo.replacement_timeout = 120
Dec 06 07:09:24 user nova-compute[75021]: node.session.err_timeo.abort_timeout = 15
Dec 06 07:09:24 user nova-compute[75021]: node.session.err_timeo.lu_reset_timeout = 30
Dec 06 07:09:24 user nova-compute[75021]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 06 07:09:24 user nova-compute[75021]: node.session.err_timeo.host_reset_timeout = 60
Dec 06 07:09:24 user nova-compute[75021]: node.session.iscsi.FastAbort = Yes
Dec 06 07:09:24 user nova-compute[75021]: node.session.iscsi.InitialR2T = No
Dec 06 07:09:24 user nova-compute[75021]: node.session.iscsi.ImmediateData = Yes
Dec 06 07:09:24 user nova-compute[75021]: node.session.iscsi.FirstBurstLength = 262144
Dec 06 07:09:24 user nova-compute[75021]: node.session.iscsi.MaxBurstLength = 16776192
Dec 06 07:09:24 user nova-compute[75021]: node.session.iscsi.DefaultTime2Retain = 0
Dec 06 07:09:24 user nova-compute[75021]: node.session.iscsi.DefaultTime2Wait = 2
Dec 06 07:09:24 user nova-compute[75021]: node.session.iscsi.MaxConnections = 1
Dec 06 07:09:24 user nova-compute[75021]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 06 07:09:24 user nova-compute[75021]: node.session.iscsi.ERL = 0
Dec 06 07:09:24 user nova-compute[75021]: node.session.scan = manual
Dec 06 07:09:24 user nova-compute[75021]: node.session.reopen_max = 0
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].address = 172.16.0.220
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].port = 3260
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].startup = manual
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].tcp.window_size = 524288
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].tcp.type_of_service = 0
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].timeo.logout_timeout = 15
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].timeo.login_timeout = 15
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].timeo.auth_timeout = 45
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].timeo.noop_out_interval = 5
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].timeo.noop_out_timeout = 5
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].iscsi.HeaderDigest = None
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].iscsi.DataDigest = None
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].iscsi.IFMarker = No
Dec 06 07:09:24 user nova-compute[75021]: node.conn[0].iscsi.OFMarker = No
Dec 06 07:09:24 user nova-compute[75021]: # END RECORD
Dec 06 07:09:24 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:09:24 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:09:24 user nova-compute[75021]:   <source dev="/dev/sde"/>
Dec 06 07:09:24 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:09:24 user nova-compute[75021]:   <serial>aaa85e8a-1642-438b-9d04-aa5ca22d3d5b</serial>
Dec 06 07:09:24 user nova-compute[75021]: </disk>
Dec 06 07:09:24 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5c2727-6a22-4bed-b958-5622a8b92bf3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a2974d-2041-48f9-abb3-003068105aea]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ujAilWOc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ujAilWOc" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef1bc2b-9152-4078-85b4-160b08ad3edf]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ujAilWOc'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[365c8b8e-3aac-4aaf-a51b-dc1e2b549017]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc937f0-d35d-4784-bf80-d137773d4de4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:24 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:24 user nova-compute[75021]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)
Dec 06 07:09:24 user nova-compute[75021]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:09:24 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:24 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:24 user nova-compute[75021]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)
Dec 06 07:09:24 user nova-compute[75021]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:09:24 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] HCTL ('35', '0', '0', 0) found on session 24 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[221e7a14-d238-4f47-a346-31c8fd4a98cb]: (4, ('0 0 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching for a device in session 24 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujAilWOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.205s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] <== connect_volume: return (1172ms) {'type': 'block', 'scsi_wwn': '23032313031336662', 'path': '/dev/sdd'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032313031336662', 'path': '/dev/sdd'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1548788729',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1548788729',id=24,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:07:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9895e43bf76d4760a26a5e64ea6d4e14',ramdisk_id='',reservation_id='r-papxt6p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:07:53Z,user_data=None,user_id='c0774aa1e3ee4b69b195b575d116ee96',uuid=828f5456-6310-4664-87b3-ee0ed6787d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "vif_mac": "fa:16:3e:ba:ed:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converting VIF {"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "vif_mac": "fa:16:3e:ba:ed:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:ed:50,bridge_name='br-int',has_traffic_filtering=True,id=a3831721-6988-44ee-89a6-35d80066e41b,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3831721-69') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'pci_devices' on Instance uuid 828f5456-6310-4664-87b3-ee0ed6787d3f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.objects.base [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Object Instance<828f5456-6310-4664-87b3-ee0ed6787d3f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:09:24 user nova-compute[75021]:   <uuid>828f5456-6310-4664-87b3-ee0ed6787d3f</uuid>
Dec 06 07:09:24 user nova-compute[75021]:   <name>instance-00000018</name>
Dec 06 07:09:24 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:09:24 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:09:24 user nova-compute[75021]:   <metadata>
Dec 06 07:09:24 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:09:24 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:09:24 user nova-compute[75021]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1548788729</nova:name>
Dec 06 07:09:24 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:09:23</nova:creationTime>
Dec 06 07:09:24 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:09:24 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:09:24 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:09:24 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:09:24 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:09:24 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:09:24 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:09:24 user nova-compute[75021]:       <nova:owner>
Dec 06 07:09:24 user nova-compute[75021]:         <nova:user uuid="c0774aa1e3ee4b69b195b575d116ee96">tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member</nova:user>
Dec 06 07:09:24 user nova-compute[75021]:         <nova:project uuid="9895e43bf76d4760a26a5e64ea6d4e14">tempest-ServerBootFromVolumeStableRescueTest-1272250883</nova:project>
Dec 06 07:09:24 user nova-compute[75021]:       </nova:owner>
Dec 06 07:09:24 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:09:24 user nova-compute[75021]:       <nova:ports>
Dec 06 07:09:24 user nova-compute[75021]:         <nova:port uuid="a3831721-6988-44ee-89a6-35d80066e41b">
Dec 06 07:09:24 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 07:09:24 user nova-compute[75021]:         </nova:port>
Dec 06 07:09:24 user nova-compute[75021]:       </nova:ports>
Dec 06 07:09:24 user nova-compute[75021]:     </nova:instance>
Dec 06 07:09:24 user nova-compute[75021]:   </metadata>
Dec 06 07:09:24 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:09:24 user nova-compute[75021]:     <system>
Dec 06 07:09:24 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:09:24 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:09:24 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:09:24 user nova-compute[75021]:       <entry name="serial">828f5456-6310-4664-87b3-ee0ed6787d3f</entry>
Dec 06 07:09:24 user nova-compute[75021]:       <entry name="uuid">828f5456-6310-4664-87b3-ee0ed6787d3f</entry>
Dec 06 07:09:24 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:09:24 user nova-compute[75021]:     </system>
Dec 06 07:09:24 user nova-compute[75021]:   </sysinfo>
Dec 06 07:09:24 user nova-compute[75021]:   <os>
Dec 06 07:09:24 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:09:24 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:09:24 user nova-compute[75021]:   </os>
Dec 06 07:09:24 user nova-compute[75021]:   <features>
Dec 06 07:09:24 user nova-compute[75021]:     <acpi/>
Dec 06 07:09:24 user nova-compute[75021]:     <apic/>
Dec 06 07:09:24 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:09:24 user nova-compute[75021]:   </features>
Dec 06 07:09:24 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:09:24 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:09:24 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:09:24 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:09:24 user nova-compute[75021]:   </clock>
Dec 06 07:09:24 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:09:24 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:09:24 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:09:24 user nova-compute[75021]:   </cpu>
Dec 06 07:09:24 user nova-compute[75021]:   <devices>
Dec 06 07:09:24 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:09:24 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:09:24 user nova-compute[75021]:       <source dev="/dev/sdd"/>
Dec 06 07:09:24 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:09:24 user nova-compute[75021]:       <serial>f5a03d75-07a1-4973-9127-073695e5fa44</serial>
Dec 06 07:09:24 user nova-compute[75021]:     </disk>
Dec 06 07:09:24 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:09:24 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:09:24 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/disk.rescue"/>
Dec 06 07:09:24 user nova-compute[75021]:       <target dev="vdb" bus="virtio"/>
Dec 06 07:09:24 user nova-compute[75021]:       <boot order="1"/>
Dec 06 07:09:24 user nova-compute[75021]:     </disk>
Dec 06 07:09:24 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:09:24 user nova-compute[75021]:       <mac address="fa:16:3e:ba:ed:50"/>
Dec 06 07:09:24 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:09:24 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:09:24 user nova-compute[75021]:       <target dev="tapa3831721-69"/>
Dec 06 07:09:24 user nova-compute[75021]:     </interface>
Dec 06 07:09:24 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:09:24 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/console.log" append="off"/>
Dec 06 07:09:24 user nova-compute[75021]:     </serial>
Dec 06 07:09:24 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:09:24 user nova-compute[75021]:     <video>
Dec 06 07:09:24 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:09:24 user nova-compute[75021]:     </video>
Dec 06 07:09:24 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:09:24 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:09:24 user nova-compute[75021]:     </rng>
Dec 06 07:09:24 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:09:24 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:09:24 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:09:24 user nova-compute[75021]:     </memballoon>
Dec 06 07:09:24 user nova-compute[75021]:   </devices>
Dec 06 07:09:24 user nova-compute[75021]: </domain>
Dec 06 07:09:24 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:09:24 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Instance destroyed successfully.
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] No VIF found with MAC fa:16:3e:ba:ed:50, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] No VIF found with MAC fa:16:3e:11:9c:c0, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:09:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b86d6a03-bded-48e3-8d38-f10d7db92817 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.159s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-b0c610c3-f750-4e09-beb4-9c6c5ebe5a5e req-03593c54-279f-4874-ba79-4c64cae6683f service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b0c610c3-f750-4e09-beb4-9c6c5ebe5a5e req-03593c54-279f-4874-ba79-4c64cae6683f service nova] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b0c610c3-f750-4e09-beb4-9c6c5ebe5a5e req-03593c54-279f-4874-ba79-4c64cae6683f service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b0c610c3-f750-4e09-beb4-9c6c5ebe5a5e req-03593c54-279f-4874-ba79-4c64cae6683f service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-b0c610c3-f750-4e09-beb4-9c6c5ebe5a5e req-03593c54-279f-4874-ba79-4c64cae6683f service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] No waiting events found dispatching network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:09:26 user nova-compute[75021]: WARNING nova.compute.manager [req-b0c610c3-f750-4e09-beb4-9c6c5ebe5a5e req-03593c54-279f-4874-ba79-4c64cae6683f service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received unexpected event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b for instance with vm_state active and task_state rescuing.
Dec 06 07:09:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:26 user nova-compute[75021]: INFO nova.compute.manager [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Rebuilding instance
Dec 06 07:09:27 user nova-compute[75021]: DEBUG nova.compute.manager [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:09:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-25b73769-2414-4af6-a896-1ce6ce03d9ea req-973ead45-f4cf-4163-af0a-b0ceda745618 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received event network-vif-unplugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-25b73769-2414-4af6-a896-1ce6ce03d9ea req-973ead45-f4cf-4163-af0a-b0ceda745618 service nova] Acquiring lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-25b73769-2414-4af6-a896-1ce6ce03d9ea req-973ead45-f4cf-4163-af0a-b0ceda745618 service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-25b73769-2414-4af6-a896-1ce6ce03d9ea req-973ead45-f4cf-4163-af0a-b0ceda745618 service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-25b73769-2414-4af6-a896-1ce6ce03d9ea req-973ead45-f4cf-4163-af0a-b0ceda745618 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] No waiting events found dispatching network-vif-unplugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:09:27 user nova-compute[75021]: WARNING nova.compute.manager [req-25b73769-2414-4af6-a896-1ce6ce03d9ea req-973ead45-f4cf-4163-af0a-b0ceda745618 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received unexpected event network-vif-unplugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 for instance with vm_state active and task_state rebuilding.
Dec 06 07:09:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:27 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Instance destroyed successfully.
Dec 06 07:09:28 user nova-compute[75021]: INFO nova.compute.manager [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Detaching volume aaa85e8a-1642-438b-9d04-aa5ca22d3d5b
Dec 06 07:09:28 user nova-compute[75021]: INFO nova.virt.block_device [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Attempting to driver detach volume aaa85e8a-1642-438b-9d04-aa5ca22d3d5b from mountpoint /dev/vdb
Dec 06 07:09:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Attempting to detach device vdb from instance bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:09:28 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:09:28 user nova-compute[75021]:   <source dev="/dev/sde"/>
Dec 06 07:09:28 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:09:28 user nova-compute[75021]:   <serial>aaa85e8a-1642-438b-9d04-aa5ca22d3d5b</serial>
Dec 06 07:09:28 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:09:28 user nova-compute[75021]: </disk>
Dec 06 07:09:28 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:09:28 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Successfully detached device vdb from instance bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a from the persistent domain config.
Dec 06 07:09:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQPmIpsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:09:28 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c0e457-3075-49a8-aed9-c7ae8d1e5b7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:09:28 user nova-compute[75021]: No targets found.
Dec 06 07:09:28 user nova-compute[75021]: iSNS:
Dec 06 07:09:28 user nova-compute[75021]: No targets found.
Dec 06 07:09:28 user nova-compute[75021]: STATIC:
Dec 06 07:09:28 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b
Dec 06 07:09:28 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:09:28 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:09:28 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:09:28 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:09:28 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:09:28 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b
Dec 06 07:09:28 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:09:28 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:09:28 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000
Dec 06 07:09:28 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:09:28 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:09:28 user nova-compute[75021]: FIRMWARE:
Dec 06 07:09:28 user nova-compute[75021]: No targets found.
Dec 06 07:09:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:09:28 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:09:28 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[046a7158-5807-4e4c-a4dc-746da58778c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fe7560-3b3e-4e9e-aca9-af81c9c64aed]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:28 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:28 user nova-compute[75021]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)
Dec 06 07:09:28 user nova-compute[75021]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:09:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:28 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:28 user nova-compute[75021]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)
Dec 06 07:09:28 user nova-compute[75021]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:09:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b4765000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b'): ({'sde'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Removing single pathed devices sde {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a72075d-9724-4933-b505-065080500732]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19252dc-dcac-4f5d-970c-8061feb06fed]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Flushing IO for device /dev/sde {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ec186f-4c28-45e8-bf50-0c627061f3a2]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-fc85a7ab-3c53-47ef-87e5-c8d42624ea01 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b24e799-9ce1-4202-a712-6b4fdcb7391c]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d041085-80ae-4be0-a49e-3cdfae8e9757]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f382827e-d772-44b8-82b6-f1a06d7c69dc]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260]
Dec 06 07:09:28 user nova-compute[75021]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260] successful.
Dec 06 07:09:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-9c3d31e4-1baf-4437-a50f-bd76fc2ad545 req-ba3755a9-d15b-4a4a-947d-edebf17c03aa service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9c3d31e4-1baf-4437-a50f-bd76fc2ad545 req-ba3755a9-d15b-4a4a-947d-edebf17c03aa service nova] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9c3d31e4-1baf-4437-a50f-bd76fc2ad545 req-ba3755a9-d15b-4a4a-947d-edebf17c03aa service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9c3d31e4-1baf-4437-a50f-bd76fc2ad545 req-ba3755a9-d15b-4a4a-947d-edebf17c03aa service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-9c3d31e4-1baf-4437-a50f-bd76fc2ad545 req-ba3755a9-d15b-4a4a-947d-edebf17c03aa service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] No waiting events found dispatching network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:09:28 user nova-compute[75021]: WARNING nova.compute.manager [req-9c3d31e4-1baf-4437-a50f-bd76fc2ad545 req-ba3755a9-d15b-4a4a-947d-edebf17c03aa service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received unexpected event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b for instance with vm_state active and task_state rescuing.
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9189a0f4-6d78-4911-97ce-8eb732a590e6]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] <== disconnect_volume: return (341ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:09:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:09:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-c553bca8-8602-44db-9e35-1cc0827721bc req-0e62bad7-7bbb-412c-8022-8049826b9c38 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received event network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c553bca8-8602-44db-9e35-1cc0827721bc req-0e62bad7-7bbb-412c-8022-8049826b9c38 service nova] Acquiring lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c553bca8-8602-44db-9e35-1cc0827721bc req-0e62bad7-7bbb-412c-8022-8049826b9c38 service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c553bca8-8602-44db-9e35-1cc0827721bc req-0e62bad7-7bbb-412c-8022-8049826b9c38 service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-c553bca8-8602-44db-9e35-1cc0827721bc req-0e62bad7-7bbb-412c-8022-8049826b9c38 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] No waiting events found dispatching network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:09:29 user nova-compute[75021]: WARNING nova.compute.manager [req-c553bca8-8602-44db-9e35-1cc0827721bc req-0e62bad7-7bbb-412c-8022-8049826b9c38 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received unexpected event network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 for instance with vm_state active and task_state rebuilding.
Dec 06 07:09:31 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5c50a6a8-2500-4408-a932-48f0116713b8 is timed out.
Dec 06 07:09:31 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Successfully detached device vdb from instance 5c50a6a8-2500-4408-a932-48f0116713b8 from the live domain config.
Dec 06 07:09:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:09:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcVxvqsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:09:31 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:09:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:09:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:09:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ef9db3-8539-4333-86d0-c69fe43de077]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:09:31 user nova-compute[75021]: No targets found.
Dec 06 07:09:31 user nova-compute[75021]: iSNS:
Dec 06 07:09:31 user nova-compute[75021]: No targets found.
Dec 06 07:09:31 user nova-compute[75021]: STATIC:
Dec 06 07:09:31 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b
Dec 06 07:09:31 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:09:31 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:09:31 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:09:31 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:09:31 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:09:31 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000
Dec 06 07:09:31 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:09:31 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:09:31 user nova-compute[75021]: FIRMWARE:
Dec 06 07:09:31 user nova-compute[75021]: No targets found.
Dec 06 07:09:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:09:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:09:31 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:09:31 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:09:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c8d020-4902-46a5-808d-9f801204529b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e40586c-017a-400f-84e3-a0ea009306e7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:32 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:32 user nova-compute[75021]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)
Dec 06 07:09:32 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:32 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:32 user nova-compute[75021]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 (non-flash)
Dec 06 07:09:32 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b47ccd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000'): ({'sdc'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Removing single pathed devices sdc {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d7b111-ac76-480b-a6c3-e932d6f3ee40]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a58ffa-1bbf-4df8-991c-48b9477b2675]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Flushing IO for device /dev/sdc {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27bc6e7-d3cf-47f5-bdf4-50f658e51bd8]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e38d62a-ca32-4e84-9fa5-ae02f3b4447c]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8cc8b2-a22a-4c79-a501-e260e00bc1f4]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2030aad6-7c69-4685-9c50-2bc987043a3b]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000, portal: 172.16.0.220,3260]
Dec 06 07:09:32 user nova-compute[75021]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000, portal: 172.16.0.220,3260] successful.
Dec 06 07:09:32 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606964c2-1400-47ec-be62-0ee77c5a9000 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd45bc9b-b6ca-4577-b45f-1732c66dd819]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] <== disconnect_volume: return (327ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:09:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG nova.objects.instance [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lazy-loading 'flavor' on Instance uuid 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-aba24c6d-3e9d-4e09-af92-b46e6f73c1cb tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.141s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:33 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Instance destroyed successfully.
Dec 06 07:09:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:07:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-539874617',display_name='tempest-ServerActionsTestOtherA-server-870482488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-539874617',id=23,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxMZDJearrqT1wUGZvs3O52CzZfwP1GjFMeARj7hE5D0gbwuEL8g69EQlk0/Gaz87I7q8l13RwvXJO8/uCJGPJUARCdsIZV2q0Xn5wU6S7uMKYYqJ1LfnAJ/jSYJUWTQA==',key_name='tempest-keypair-1224381594',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:07:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f011c1a70ac1465d8eb31e20850fdbad',ramdisk_id='',reservation_id='r-p5qweqeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1761792884',owner_user_name='tempest-ServerActionsTestOtherA-1761792884-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3369c937ad24537a114a71eb4674750',uuid=bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converting VIF {"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:9c:c0,bridge_name='br-int',has_traffic_filtering=True,id=6a9c80ab-da5d-4fd5-b757-3c09fa3c1563,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c80ab-da') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG os_vif [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9c:c0,bridge_name='br-int',has_traffic_filtering=True,id=6a9c80ab-da5d-4fd5-b757-3c09fa3c1563,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c80ab-da') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a9c80ab-da, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b9a0900-0e78-4e55-a7ef-a72a8069d92c) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:33 user nova-compute[75021]: INFO os_vif [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9c:c0,bridge_name='br-int',has_traffic_filtering=True,id=6a9c80ab-da5d-4fd5-b757-3c09fa3c1563,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c80ab-da')
Dec 06 07:09:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQPmIpsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:09:33 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 07:09:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d696fa4f-05af-4a99-8be5-c00d2694607c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:09:33 user nova-compute[75021]: No targets found.
Dec 06 07:09:33 user nova-compute[75021]: iSNS:
Dec 06 07:09:33 user nova-compute[75021]: No targets found.
Dec 06 07:09:33 user nova-compute[75021]: STATIC:
Dec 06 07:09:33 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b
Dec 06 07:09:33 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:09:33 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:09:33 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:09:33 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:09:33 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:09:33 user nova-compute[75021]: FIRMWARE:
Dec 06 07:09:33 user nova-compute[75021]: No targets found.
Dec 06 07:09:33 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:09:33 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:09:33 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d16566f-faad-4120-82d1-83c18e8366c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[114a283a-2c4b-4423-8e24-3eb9296a9c04]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:33 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:33 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:33 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:33 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b47f0280>, {}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Disconnecting from: [] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] <== disconnect_volume: return (79ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:09:33 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Deleting instance files /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a_del
Dec 06 07:09:33 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Deletion of /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a_del complete
Dec 06 07:09:33 user nova-compute[75021]: INFO nova.virt.block_device [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Booting with volume aaa85e8a-1642-438b-9d04-aa5ca22d3d5b at /dev/vdb
Dec 06 07:09:33 user nova-compute[75021]: DEBUG os_brick.utils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bc8ebc-a3c4-42df-aae2-749815552e52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d999add-f4b3-4b05-99e8-fbe8b660987f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92509cd-854c-4f0d-92ae-b2297a90d572]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[027de570-c4e0-4480-bccc-5487b8f5980b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:09:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:09:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:09:34 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:09:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[873d2b84-0511-497b-8832-3ad298dcb2bb]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:09:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:09:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:09:34 user nova-compute[75021]: DEBUG os_brick.utils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:09:34 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Updating existing volume attachment record: 43eb7420-4adb-4458-8ca6-2dd0ad6c1308 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:09:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-17c92b49-c97e-4fa6-866b-06a9517aa100 req-f0c68245-b180-4903-9705-87f5f44aa076 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-changed-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-17c92b49-c97e-4fa6-866b-06a9517aa100 req-f0c68245-b180-4903-9705-87f5f44aa076 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Refreshing instance network info cache due to event network-changed-2d2bc1b9-24cd-4992-93a5-e3638e21a35e. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:09:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-17c92b49-c97e-4fa6-866b-06a9517aa100 req-f0c68245-b180-4903-9705-87f5f44aa076 service nova] Acquiring lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-17c92b49-c97e-4fa6-866b-06a9517aa100 req-f0c68245-b180-4903-9705-87f5f44aa076 service nova] Acquired lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:36 user nova-compute[75021]: DEBUG nova.network.neutron [req-17c92b49-c97e-4fa6-866b-06a9517aa100 req-f0c68245-b180-4903-9705-87f5f44aa076 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Refreshing network info cache for port 2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:09:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "8b8eb320-6348-4038-a57e-02bf1e015174" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:36 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'flavor' on Instance uuid 8b8eb320-6348-4038-a57e-02bf1e015174 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:09:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "8b8eb320-6348-4038-a57e-02bf1e015174" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "8b8eb320-6348-4038-a57e-02bf1e015174" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:36 user nova-compute[75021]: INFO nova.compute.manager [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Attaching volume 1b160044-a407-4c86-8077-0e9284134d30 to /dev/vdb
Dec 06 07:09:36 user nova-compute[75021]: DEBUG nova.network.neutron [req-17c92b49-c97e-4fa6-866b-06a9517aa100 req-f0c68245-b180-4903-9705-87f5f44aa076 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Updated VIF entry in instance network info cache for port 2d2bc1b9-24cd-4992-93a5-e3638e21a35e. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:09:36 user nova-compute[75021]: DEBUG nova.network.neutron [req-17c92b49-c97e-4fa6-866b-06a9517aa100 req-f0c68245-b180-4903-9705-87f5f44aa076 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Updating instance_info_cache with network_info: [{"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-17c92b49-c97e-4fa6-866b-06a9517aa100 req-f0c68245-b180-4903-9705-87f5f44aa076 service nova] Releasing lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG os_brick.utils [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa231f2-10fe-45d5-80c4-22e60d554d8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[948d4f5e-83a5-45ce-82ae-aef79d294d04]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5354ec-1f8c-4c1d-bcf1-668685314a69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[621443dc-520b-47d7-a802-1099a4629485]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:09:37 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[044e4612-7351-42f7-b110-672b94d95478]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG os_brick.utils [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Updating existing volume attachment record: 14dbd12c-a5b8-48ff-85e3-acaf469e214e {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-22a8f786-4d11-4c90-83da-1a08e8d06f06 req-641eaa1b-147d-415d-9c0d-837d6e1d06c7 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received event network-changed-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-22a8f786-4d11-4c90-83da-1a08e8d06f06 req-641eaa1b-147d-415d-9c0d-837d6e1d06c7 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Refreshing instance network info cache due to event network-changed-c77514ad-438b-4d06-8f57-a363cde54e16. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-22a8f786-4d11-4c90-83da-1a08e8d06f06 req-641eaa1b-147d-415d-9c0d-837d6e1d06c7 service nova] Acquiring lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-22a8f786-4d11-4c90-83da-1a08e8d06f06 req-641eaa1b-147d-415d-9c0d-837d6e1d06c7 service nova] Acquired lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:37 user nova-compute[75021]: DEBUG nova.network.neutron [req-22a8f786-4d11-4c90-83da-1a08e8d06f06 req-641eaa1b-147d-415d-9c0d-837d6e1d06c7 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Refreshing network info cache for port c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:09:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:38 user nova-compute[75021]: DEBUG nova.network.neutron [req-22a8f786-4d11-4c90-83da-1a08e8d06f06 req-641eaa1b-147d-415d-9c0d-837d6e1d06c7 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Updated VIF entry in instance network info cache for port c77514ad-438b-4d06-8f57-a363cde54e16. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:09:38 user nova-compute[75021]: DEBUG nova.network.neutron [req-22a8f786-4d11-4c90-83da-1a08e8d06f06 req-641eaa1b-147d-415d-9c0d-837d6e1d06c7 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Updating instance_info_cache with network_info: [{"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-22a8f786-4d11-4c90-83da-1a08e8d06f06 req-641eaa1b-147d-415d-9c0d-837d6e1d06c7 service nova] Releasing lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-2a200a9f-3a7e-41a3-9fb3-ece90cb14e22 req-5a00b068-2264-4731-88bd-47ef388231c5 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received event network-changed-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-2a200a9f-3a7e-41a3-9fb3-ece90cb14e22 req-5a00b068-2264-4731-88bd-47ef388231c5 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Refreshing instance network info cache due to event network-changed-c77514ad-438b-4d06-8f57-a363cde54e16. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:09:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2a200a9f-3a7e-41a3-9fb3-ece90cb14e22 req-5a00b068-2264-4731-88bd-47ef388231c5 service nova] Acquiring lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2a200a9f-3a7e-41a3-9fb3-ece90cb14e22 req-5a00b068-2264-4731-88bd-47ef388231c5 service nova] Acquired lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:39 user nova-compute[75021]: DEBUG nova.network.neutron [req-2a200a9f-3a7e-41a3-9fb3-ece90cb14e22 req-5a00b068-2264-4731-88bd-47ef388231c5 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Refreshing network info cache for port c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:09:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:39 user nova-compute[75021]: INFO nova.compute.manager [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Detaching volume 16792f29-a35a-46ed-96e5-528d37062d8b
Dec 06 07:09:39 user nova-compute[75021]: INFO nova.virt.block_device [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Attempting to driver detach volume 16792f29-a35a-46ed-96e5-528d37062d8b from mountpoint /dev/vdb
Dec 06 07:09:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Attempting to detach device vdb from instance 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:09:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:09:39 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:09:39 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:09:39 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:09:39 user nova-compute[75021]:   <serial>16792f29-a35a-46ed-96e5-528d37062d8b</serial>
Dec 06 07:09:39 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 07:09:39 user nova-compute[75021]: </disk>
Dec 06 07:09:39 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:09:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Successfully detached device vdb from instance 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 from the persistent domain config.
Dec 06 07:09:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:09:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:09:39 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:09:39 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:09:39 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:09:39 user nova-compute[75021]:   <serial>16792f29-a35a-46ed-96e5-528d37062d8b</serial>
Dec 06 07:09:39 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 07:09:39 user nova-compute[75021]: </disk>
Dec 06 07:09:39 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:09:39 user nova-compute[75021]: DEBUG nova.network.neutron [req-2a200a9f-3a7e-41a3-9fb3-ece90cb14e22 req-5a00b068-2264-4731-88bd-47ef388231c5 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Updated VIF entry in instance network info cache for port c77514ad-438b-4d06-8f57-a363cde54e16. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:09:39 user nova-compute[75021]: DEBUG nova.network.neutron [req-2a200a9f-3a7e-41a3-9fb3-ece90cb14e22 req-5a00b068-2264-4731-88bd-47ef388231c5 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Updating instance_info_cache with network_info: [{"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2a200a9f-3a7e-41a3-9fb3-ece90cb14e22 req-5a00b068-2264-4731-88bd-47ef388231c5 service nova] Releasing lock "refresh_cache-42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:09:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:09:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:09:40 user nova-compute[75021]: INFO nova.compute.claims [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Claim successful on node user
Dec 06 07:09:41 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.760s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:09:41 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:09:41 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:09:41 user nova-compute[75021]: INFO nova.virt.block_device [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Booting with volume 5dbe0266-71c4-4370-b543-da543f3cd000 at /dev/vda
Dec 06 07:09:41 user nova-compute[75021]: DEBUG nova.policy [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b894e8943b54078832aab4f727af7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e7a9eedb83455fab3446e497feae40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG os_brick.utils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[338acd65-3629-43ae-8b79-8021af453d02]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1110aef-266e-461a-9d7c-f4343140de70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9f16c7-d686-4754-a9f4-06b11522e091]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4cf505-1de6-4a34-a392-48463ffb9bc8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:09:41 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:09:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e002732b-78de-4bea-8cee-42abc0c5cac3]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG os_brick.utils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:09:41 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updating existing volume attachment record: b3d8e256-2a02-4090-842d-b4f3b0073ff4 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:09:42 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Successfully created port: 07acf2eb-ace0-4ae1-b719-e179921b4283 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:09:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "35da578f-dc7b-4038-869e-3d7528844bf0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "35da578f-dc7b-4038-869e-3d7528844bf0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:09:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:42 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:09:42 user nova-compute[75021]: INFO nova.compute.claims [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Claim successful on node user
Dec 06 07:09:42 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Successfully created port: 3eaf5559-41b4-4e36-85dc-dcfcde324aa8 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.666s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Successfully created port: b61841a9-756e-4ad4-b803-017c7bd985de {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG nova.network.neutron [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:09:43 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:09:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG nova.policy [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76b72f254ecf4447b4fcaada0ce327d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd731b9dfe44549609091c48e8d19a1e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:09:43 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Creating image(s)
Dec 06 07:09:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "/opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "/opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "/opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.192s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.200s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk 1073741824" returned: 0 in 0.049s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Successfully created port: cb1e15ad-aa13-4507-b83c-035a05d32268 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG nova.network.neutron [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Successfully created port: f2029bf5-89e2-4759-90a2-a17f8721653c {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Cannot resize image /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Ensure instance console log exists: /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Successfully created port: 0fe07857-5428-4598-b751-b88ff51d7c18 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG nova.network.neutron [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Successfully updated port: f2029bf5-89e2-4759-90a2-a17f8721653c {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "refresh_cache-35da578f-dc7b-4038-869e-3d7528844bf0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquired lock "refresh_cache-35da578f-dc7b-4038-869e-3d7528844bf0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG nova.network.neutron [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-4d962360-1e6d-475e-adbd-557a019acdc6 req-f8affa6a-8ddb-4b72-bdc7-1db7aed654b4 service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Received event network-changed-f2029bf5-89e2-4759-90a2-a17f8721653c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-4d962360-1e6d-475e-adbd-557a019acdc6 req-f8affa6a-8ddb-4b72-bdc7-1db7aed654b4 service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Refreshing instance network info cache due to event network-changed-f2029bf5-89e2-4759-90a2-a17f8721653c. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:09:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4d962360-1e6d-475e-adbd-557a019acdc6 req-f8affa6a-8ddb-4b72-bdc7-1db7aed654b4 service nova] Acquiring lock "refresh_cache-35da578f-dc7b-4038-869e-3d7528844bf0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Successfully updated port: 07acf2eb-ace0-4ae1-b719-e179921b4283 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-274cf6d8-a23b-4c44-a68a-3d7e41bb4451 req-9517957c-e405-46a2-b6dc-97c637397be4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-changed-07acf2eb-ace0-4ae1-b719-e179921b4283 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-274cf6d8-a23b-4c44-a68a-3d7e41bb4451 req-9517957c-e405-46a2-b6dc-97c637397be4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing instance network info cache due to event network-changed-07acf2eb-ace0-4ae1-b719-e179921b4283. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-274cf6d8-a23b-4c44-a68a-3d7e41bb4451 req-9517957c-e405-46a2-b6dc-97c637397be4 service nova] Acquiring lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-274cf6d8-a23b-4c44-a68a-3d7e41bb4451 req-9517957c-e405-46a2-b6dc-97c637397be4 service nova] Acquired lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.network.neutron [req-274cf6d8-a23b-4c44-a68a-3d7e41bb4451 req-9517957c-e405-46a2-b6dc-97c637397be4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing network info cache for port 07acf2eb-ace0-4ae1-b719-e179921b4283 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Updating instance_info_cache with network_info: [{"id": "f2029bf5-89e2-4759-90a2-a17f8721653c", "address": "fa:16:3e:74:63:fb", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2029bf5-89", "ovs_interfaceid": "f2029bf5-89e2-4759-90a2-a17f8721653c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Releasing lock "refresh_cache-35da578f-dc7b-4038-869e-3d7528844bf0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Instance network_info: |[{"id": "f2029bf5-89e2-4759-90a2-a17f8721653c", "address": "fa:16:3e:74:63:fb", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2029bf5-89", "ovs_interfaceid": "f2029bf5-89e2-4759-90a2-a17f8721653c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4d962360-1e6d-475e-adbd-557a019acdc6 req-f8affa6a-8ddb-4b72-bdc7-1db7aed654b4 service nova] Acquired lock "refresh_cache-35da578f-dc7b-4038-869e-3d7528844bf0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.network.neutron [req-4d962360-1e6d-475e-adbd-557a019acdc6 req-f8affa6a-8ddb-4b72-bdc7-1db7aed654b4 service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Refreshing network info cache for port f2029bf5-89e2-4759-90a2-a17f8721653c {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Start _get_guest_xml network_info=[{"id": "f2029bf5-89e2-4759-90a2-a17f8721653c", "address": "fa:16:3e:74:63:fb", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2029bf5-89", "ovs_interfaceid": "f2029bf5-89e2-4759-90a2-a17f8721653c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:09:45 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:09:45 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:09:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Creating image(s)
Dec 06 07:09:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "/opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "/opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.network.neutron [req-274cf6d8-a23b-4c44-a68a-3d7e41bb4451 req-9517957c-e405-46a2-b6dc-97c637397be4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:09:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-594079257',display_name='tempest-VolumesSnapshotTestJSON-instance-594079257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-594079257',id=28,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8hbyTR4tkK7wWHpweEPc08jsEncPc9TJh9OoWvv8ggc3jVq8g6TIEI+Z9TA40DLVfcwfcw60FATuR9MBnUNcmmmJmWcy77LX/LYnY0xrPsARE57xk22UzytdnDJeVKdg==',key_name='tempest-keypair-136075890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d731b9dfe44549609091c48e8d19a1e9',ramdisk_id='',reservation_id='r-esca31v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-591172318',owner_user_name='tempest-VolumesSnapshotTestJSON-591172318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b72f254ecf4447b4fcaada0ce327d6',uuid=35da578f-dc7b-4038-869e-3d7528844bf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2029bf5-89e2-4759-90a2-a17f8721653c", "address": "fa:16:3e:74:63:fb", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2029bf5-89", "ovs_interfaceid": "f2029bf5-89e2-4759-90a2-a17f8721653c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Converting VIF {"id": "f2029bf5-89e2-4759-90a2-a17f8721653c", "address": "fa:16:3e:74:63:fb", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2029bf5-89", "ovs_interfaceid": "f2029bf5-89e2-4759-90a2-a17f8721653c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:63:fb,bridge_name='br-int',has_traffic_filtering=True,id=f2029bf5-89e2-4759-90a2-a17f8721653c,network=Network(a9cc5472-9cbe-42f2-bae2-532a8daa36e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2029bf5-89') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.objects.instance [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lazy-loading 'pci_devices' on Instance uuid 35da578f-dc7b-4038-869e-3d7528844bf0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:09:45 user nova-compute[75021]:   <uuid>35da578f-dc7b-4038-869e-3d7528844bf0</uuid>
Dec 06 07:09:45 user nova-compute[75021]:   <name>instance-0000001c</name>
Dec 06 07:09:45 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:09:45 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:09:45 user nova-compute[75021]:   <metadata>
Dec 06 07:09:45 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:09:45 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:09:45 user nova-compute[75021]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-594079257</nova:name>
Dec 06 07:09:45 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:09:45</nova:creationTime>
Dec 06 07:09:45 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:09:45 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:09:45 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:09:45 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:09:45 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:09:45 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:09:45 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:09:45 user nova-compute[75021]:       <nova:owner>
Dec 06 07:09:45 user nova-compute[75021]:         <nova:user uuid="76b72f254ecf4447b4fcaada0ce327d6">tempest-VolumesSnapshotTestJSON-591172318-project-member</nova:user>
Dec 06 07:09:45 user nova-compute[75021]:         <nova:project uuid="d731b9dfe44549609091c48e8d19a1e9">tempest-VolumesSnapshotTestJSON-591172318</nova:project>
Dec 06 07:09:45 user nova-compute[75021]:       </nova:owner>
Dec 06 07:09:45 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:09:45 user nova-compute[75021]:       <nova:ports>
Dec 06 07:09:45 user nova-compute[75021]:         <nova:port uuid="f2029bf5-89e2-4759-90a2-a17f8721653c">
Dec 06 07:09:45 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 07:09:45 user nova-compute[75021]:         </nova:port>
Dec 06 07:09:45 user nova-compute[75021]:       </nova:ports>
Dec 06 07:09:45 user nova-compute[75021]:     </nova:instance>
Dec 06 07:09:45 user nova-compute[75021]:   </metadata>
Dec 06 07:09:45 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:09:45 user nova-compute[75021]:     <system>
Dec 06 07:09:45 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:09:45 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:09:45 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:09:45 user nova-compute[75021]:       <entry name="serial">35da578f-dc7b-4038-869e-3d7528844bf0</entry>
Dec 06 07:09:45 user nova-compute[75021]:       <entry name="uuid">35da578f-dc7b-4038-869e-3d7528844bf0</entry>
Dec 06 07:09:45 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:09:45 user nova-compute[75021]:     </system>
Dec 06 07:09:45 user nova-compute[75021]:   </sysinfo>
Dec 06 07:09:45 user nova-compute[75021]:   <os>
Dec 06 07:09:45 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:09:45 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:09:45 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:09:45 user nova-compute[75021]:   </os>
Dec 06 07:09:45 user nova-compute[75021]:   <features>
Dec 06 07:09:45 user nova-compute[75021]:     <acpi/>
Dec 06 07:09:45 user nova-compute[75021]:     <apic/>
Dec 06 07:09:45 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:09:45 user nova-compute[75021]:   </features>
Dec 06 07:09:45 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:09:45 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:09:45 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:09:45 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:09:45 user nova-compute[75021]:   </clock>
Dec 06 07:09:45 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:09:45 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:09:45 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:09:45 user nova-compute[75021]:   </cpu>
Dec 06 07:09:45 user nova-compute[75021]:   <devices>
Dec 06 07:09:45 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:09:45 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:09:45 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk"/>
Dec 06 07:09:45 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:09:45 user nova-compute[75021]:     </disk>
Dec 06 07:09:45 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:09:45 user nova-compute[75021]:       <mac address="fa:16:3e:74:63:fb"/>
Dec 06 07:09:45 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:09:45 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:09:45 user nova-compute[75021]:       <target dev="tapf2029bf5-89"/>
Dec 06 07:09:45 user nova-compute[75021]:     </interface>
Dec 06 07:09:45 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:09:45 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/console.log" append="off"/>
Dec 06 07:09:45 user nova-compute[75021]:     </serial>
Dec 06 07:09:45 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:09:45 user nova-compute[75021]:     <video>
Dec 06 07:09:45 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:09:45 user nova-compute[75021]:     </video>
Dec 06 07:09:45 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:09:45 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:09:45 user nova-compute[75021]:     </rng>
Dec 06 07:09:45 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:09:45 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:09:45 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:09:45 user nova-compute[75021]:     </memballoon>
Dec 06 07:09:45 user nova-compute[75021]:   </devices>
Dec 06 07:09:45 user nova-compute[75021]: </domain>
Dec 06 07:09:45 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:09:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-594079257',display_name='tempest-VolumesSnapshotTestJSON-instance-594079257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-594079257',id=28,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8hbyTR4tkK7wWHpweEPc08jsEncPc9TJh9OoWvv8ggc3jVq8g6TIEI+Z9TA40DLVfcwfcw60FATuR9MBnUNcmmmJmWcy77LX/LYnY0xrPsARE57xk22UzytdnDJeVKdg==',key_name='tempest-keypair-136075890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d731b9dfe44549609091c48e8d19a1e9',ramdisk_id='',reservation_id='r-esca31v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-591172318',owner_user_name='tempest-VolumesSnapshotTestJSON-591172318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b72f254ecf4447b4fcaada0ce327d6',uuid=35da578f-dc7b-4038-869e-3d7528844bf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2029bf5-89e2-4759-90a2-a17f8721653c", "address": "fa:16:3e:74:63:fb", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2029bf5-89", "ovs_interfaceid": "f2029bf5-89e2-4759-90a2-a17f8721653c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Converting VIF {"id": "f2029bf5-89e2-4759-90a2-a17f8721653c", "address": "fa:16:3e:74:63:fb", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2029bf5-89", "ovs_interfaceid": "f2029bf5-89e2-4759-90a2-a17f8721653c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:63:fb,bridge_name='br-int',has_traffic_filtering=True,id=f2029bf5-89e2-4759-90a2-a17f8721653c,network=Network(a9cc5472-9cbe-42f2-bae2-532a8daa36e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2029bf5-89') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG os_vif [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:63:fb,bridge_name='br-int',has_traffic_filtering=True,id=f2029bf5-89e2-4759-90a2-a17f8721653c,network=Network(a9cc5472-9cbe-42f2-bae2-532a8daa36e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2029bf5-89') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7bfe02b9-b2ac-5fb7-81b6-b1092bf72a34', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2029bf5-89, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2029bf5-89, col_values=(('qos', UUID('a7d3a268-a7e2-4f88-9eb2-edfc414259a9')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2029bf5-89, col_values=(('external_ids', {'iface-id': 'f2029bf5-89e2-4759-90a2-a17f8721653c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:63:fb', 'vm-uuid': '35da578f-dc7b-4038-869e-3d7528844bf0'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.479s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Successfully updated port: 3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:09:45 user nova-compute[75021]: INFO os_vif [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:63:fb,bridge_name='br-int',has_traffic_filtering=True,id=f2029bf5-89e2-4759-90a2-a17f8721653c,network=Network(a9cc5472-9cbe-42f2-bae2-532a8daa36e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2029bf5-89')
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:09:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] No VIF found with MAC fa:16:3e:74:63:fb, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.network.neutron [req-274cf6d8-a23b-4c44-a68a-3d7e41bb4451 req-9517957c-e405-46a2-b6dc-97c637397be4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-274cf6d8-a23b-4c44-a68a-3d7e41bb4451 req-9517957c-e405-46a2-b6dc-97c637397be4 service nova] Releasing lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.network.neutron [req-4d962360-1e6d-475e-adbd-557a019acdc6 req-f8affa6a-8ddb-4b72-bdc7-1db7aed654b4 service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Updated VIF entry in instance network info cache for port f2029bf5-89e2-4759-90a2-a17f8721653c. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.network.neutron [req-4d962360-1e6d-475e-adbd-557a019acdc6 req-f8affa6a-8ddb-4b72-bdc7-1db7aed654b4 service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Updating instance_info_cache with network_info: [{"id": "f2029bf5-89e2-4759-90a2-a17f8721653c", "address": "fa:16:3e:74:63:fb", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2029bf5-89", "ovs_interfaceid": "f2029bf5-89e2-4759-90a2-a17f8721653c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk 1073741824" returned: 0 in 0.058s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4d962360-1e6d-475e-adbd-557a019acdc6 req-f8affa6a-8ddb-4b72-bdc7-1db7aed654b4 service nova] Releasing lock "refresh_cache-35da578f-dc7b-4038-869e-3d7528844bf0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Successfully updated port: 5462413e-c273-42de-8ba8-1fde5c39c0a4 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Cannot resize image /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Ensure instance console log exists: /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Start _get_guest_xml network_info=[{"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '43eb7420-4adb-4458-8ca6-2dd0ad6c1308', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQPmIpsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a', 'attached_at': '', 'detached_at': '', 'volume_id': 'aaa85e8a-1642-438b-9d04-aa5ca22d3d5b', 'serial': 'aaa85e8a-1642-438b-9d04-aa5ca22d3d5b'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:09:46 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 06 07:09:46 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.objects.instance [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lazy-loading 'vcpu_model' on Instance uuid bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQPmIpsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:09:46 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:09:46 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:09:46 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[88785cf5-bd8d-4b01-9b5d-dc821362b400]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:09:46 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b851468-c1f6-4c58-a501-18b842c80fcc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b] added
Dec 06 07:09:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad71658e-0d9e-42f8-99d9-e51a5df775b6]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed5180e-f48a-4a6d-9221-2bf883a67b53]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQPmIpsN {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQPmIpsN" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b137c5-42da-4df7-9864-b406875569d0]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iQPmIpsN'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c207001-2a3a-450a-ba9c-531ecd093d66]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf2e8a2-b8b0-40c7-ac23-0e614e8999ea]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:46 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:46 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21387d3-5e3d-44cf-bb78-4df9e1fbf085]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260]
Dec 06 07:09:46 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260] successful.
Dec 06 07:09:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cfcd51-ea7d-43f9-a423-b96403bcb4a9]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[52febf74-f760-4847-9506-4f41868ce43b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:46 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:46 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:09:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:46 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:46 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:09:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[624d05f9-4311-4db5-ac0f-e74b17c5fd22]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:09:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQPmIpsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Successfully updated port: 3eaf5559-41b4-4e36-85dc-dcfcde324aa8 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-changed-3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing instance network info cache due to event network-changed-3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] Acquiring lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] Acquired lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.network.neutron [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing network info cache for port 3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.network.neutron [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-6c5341fe-dce7-4a36-b4e8-4fefb89ab2b3 req-9492a33a-bd21-41ba-953b-87e1139a37c3 service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Received event network-vif-plugged-f2029bf5-89e2-4759-90a2-a17f8721653c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6c5341fe-dce7-4a36-b4e8-4fefb89ab2b3 req-9492a33a-bd21-41ba-953b-87e1139a37c3 service nova] Acquiring lock "35da578f-dc7b-4038-869e-3d7528844bf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6c5341fe-dce7-4a36-b4e8-4fefb89ab2b3 req-9492a33a-bd21-41ba-953b-87e1139a37c3 service nova] Lock "35da578f-dc7b-4038-869e-3d7528844bf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6c5341fe-dce7-4a36-b4e8-4fefb89ab2b3 req-9492a33a-bd21-41ba-953b-87e1139a37c3 service nova] Lock "35da578f-dc7b-4038-869e-3d7528844bf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-6c5341fe-dce7-4a36-b4e8-4fefb89ab2b3 req-9492a33a-bd21-41ba-953b-87e1139a37c3 service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] No waiting events found dispatching network-vif-plugged-f2029bf5-89e2-4759-90a2-a17f8721653c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:09:47 user nova-compute[75021]: WARNING nova.compute.manager [req-6c5341fe-dce7-4a36-b4e8-4fefb89ab2b3 req-9492a33a-bd21-41ba-953b-87e1139a37c3 service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Received unexpected event network-vif-plugged-f2029bf5-89e2-4759-90a2-a17f8721653c for instance with vm_state building and task_state spawning.
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.network.neutron [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] Releasing lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-changed-5462413e-c273-42de-8ba8-1fde5c39c0a4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing instance network info cache due to event network-changed-5462413e-c273-42de-8ba8-1fde5c39c0a4. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] Acquiring lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] Acquired lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.network.neutron [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing network info cache for port 5462413e-c273-42de-8ba8-1fde5c39c0a4 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Successfully updated port: b61841a9-756e-4ad4-b803-017c7bd985de {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.network.neutron [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23036393239363363', 'path': '/dev/sdc'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036393239363363', 'path': '/dev/sdc'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T07:07:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-539874617',display_name='tempest-ServerActionsTestOtherA-server-870482488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-539874617',id=23,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxMZDJearrqT1wUGZvs3O52CzZfwP1GjFMeARj7hE5D0gbwuEL8g69EQlk0/Gaz87I7q8l13RwvXJO8/uCJGPJUARCdsIZV2q0Xn5wU6S7uMKYYqJ1LfnAJ/jSYJUWTQA==',key_name='tempest-keypair-1224381594',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:07:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f011c1a70ac1465d8eb31e20850fdbad',ramdisk_id='',reservation_id='r-p5qweqeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1761792884',owner_user_name='tempest-ServerActionsTestOtherA-1761792884-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3369c937ad24537a114a71eb4674750',uuid=bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converting VIF {"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:9c:c0,bridge_name='br-int',has_traffic_filtering=True,id=6a9c80ab-da5d-4fd5-b757-3c09fa3c1563,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c80ab-da') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:09:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:09:47 user nova-compute[75021]:   <uuid>bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a</uuid>
Dec 06 07:09:47 user nova-compute[75021]:   <name>instance-00000017</name>
Dec 06 07:09:47 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:09:47 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:09:47 user nova-compute[75021]:   <metadata>
Dec 06 07:09:47 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:09:47 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:09:47 user nova-compute[75021]:       <nova:name>tempest-ServerActionsTestOtherA-server-870482488</nova:name>
Dec 06 07:09:47 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:09:46</nova:creationTime>
Dec 06 07:09:47 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:09:47 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:09:47 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:09:47 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:09:47 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:09:47 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:09:47 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:09:47 user nova-compute[75021]:       <nova:owner>
Dec 06 07:09:47 user nova-compute[75021]:         <nova:user uuid="e3369c937ad24537a114a71eb4674750">tempest-ServerActionsTestOtherA-1761792884-project-member</nova:user>
Dec 06 07:09:47 user nova-compute[75021]:         <nova:project uuid="f011c1a70ac1465d8eb31e20850fdbad">tempest-ServerActionsTestOtherA-1761792884</nova:project>
Dec 06 07:09:47 user nova-compute[75021]:       </nova:owner>
Dec 06 07:09:47 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:09:47 user nova-compute[75021]:       <nova:ports>
Dec 06 07:09:47 user nova-compute[75021]:         <nova:port uuid="6a9c80ab-da5d-4fd5-b757-3c09fa3c1563">
Dec 06 07:09:47 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 07:09:47 user nova-compute[75021]:         </nova:port>
Dec 06 07:09:47 user nova-compute[75021]:       </nova:ports>
Dec 06 07:09:47 user nova-compute[75021]:     </nova:instance>
Dec 06 07:09:47 user nova-compute[75021]:   </metadata>
Dec 06 07:09:47 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:09:47 user nova-compute[75021]:     <system>
Dec 06 07:09:47 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:09:47 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:09:47 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:09:47 user nova-compute[75021]:       <entry name="serial">bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a</entry>
Dec 06 07:09:47 user nova-compute[75021]:       <entry name="uuid">bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a</entry>
Dec 06 07:09:47 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:09:47 user nova-compute[75021]:     </system>
Dec 06 07:09:47 user nova-compute[75021]:   </sysinfo>
Dec 06 07:09:47 user nova-compute[75021]:   <os>
Dec 06 07:09:47 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:09:47 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:09:47 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:09:47 user nova-compute[75021]:   </os>
Dec 06 07:09:47 user nova-compute[75021]:   <features>
Dec 06 07:09:47 user nova-compute[75021]:     <acpi/>
Dec 06 07:09:47 user nova-compute[75021]:     <apic/>
Dec 06 07:09:47 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:09:47 user nova-compute[75021]:   </features>
Dec 06 07:09:47 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:09:47 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:09:47 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:09:47 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:09:47 user nova-compute[75021]:   </clock>
Dec 06 07:09:47 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:09:47 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:09:47 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:09:47 user nova-compute[75021]:   </cpu>
Dec 06 07:09:47 user nova-compute[75021]:   <devices>
Dec 06 07:09:47 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:09:47 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:09:47 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk"/>
Dec 06 07:09:47 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:09:47 user nova-compute[75021]:     </disk>
Dec 06 07:09:47 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:09:47 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:09:47 user nova-compute[75021]:       <source dev="/dev/sdc"/>
Dec 06 07:09:47 user nova-compute[75021]:       <target dev="vdb" bus="virtio"/>
Dec 06 07:09:47 user nova-compute[75021]:       <serial>aaa85e8a-1642-438b-9d04-aa5ca22d3d5b</serial>
Dec 06 07:09:47 user nova-compute[75021]:     </disk>
Dec 06 07:09:47 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:09:47 user nova-compute[75021]:       <mac address="fa:16:3e:11:9c:c0"/>
Dec 06 07:09:47 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:09:47 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:09:47 user nova-compute[75021]:       <target dev="tap6a9c80ab-da"/>
Dec 06 07:09:47 user nova-compute[75021]:     </interface>
Dec 06 07:09:47 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:09:47 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/console.log" append="off"/>
Dec 06 07:09:47 user nova-compute[75021]:     </serial>
Dec 06 07:09:47 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:09:47 user nova-compute[75021]:     <video>
Dec 06 07:09:47 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:09:47 user nova-compute[75021]:     </video>
Dec 06 07:09:47 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:09:47 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:09:47 user nova-compute[75021]:     </rng>
Dec 06 07:09:47 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:09:47 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:09:47 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:09:47 user nova-compute[75021]:     </memballoon>
Dec 06 07:09:47 user nova-compute[75021]:   </devices>
Dec 06 07:09:47 user nova-compute[75021]: </domain>
Dec 06 07:09:47 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T07:07:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-539874617',display_name='tempest-ServerActionsTestOtherA-server-870482488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-539874617',id=23,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxMZDJearrqT1wUGZvs3O52CzZfwP1GjFMeARj7hE5D0gbwuEL8g69EQlk0/Gaz87I7q8l13RwvXJO8/uCJGPJUARCdsIZV2q0Xn5wU6S7uMKYYqJ1LfnAJ/jSYJUWTQA==',key_name='tempest-keypair-1224381594',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:07:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f011c1a70ac1465d8eb31e20850fdbad',ramdisk_id='',reservation_id='r-p5qweqeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1761792884',owner_user_name='tempest-ServerActionsTestOtherA-1761792884-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3369c937ad24537a114a71eb4674750',uuid=bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converting VIF {"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:9c:c0,bridge_name='br-int',has_traffic_filtering=True,id=6a9c80ab-da5d-4fd5-b757-3c09fa3c1563,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c80ab-da') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG os_vif [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9c:c0,bridge_name='br-int',has_traffic_filtering=True,id=6a9c80ab-da5d-4fd5-b757-3c09fa3c1563,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c80ab-da') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae4e008e-aa5c-593b-8206-d0f561fd5c7f', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a9c80ab-da, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a9c80ab-da, col_values=(('qos', UUID('3cb7e2c4-d83b-4aa0-a356-f63335294a29')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a9c80ab-da, col_values=(('external_ids', {'iface-id': '6a9c80ab-da5d-4fd5-b757-3c09fa3c1563', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:9c:c0', 'vm-uuid': 'bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:48 user nova-compute[75021]: INFO os_vif [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9c:c0,bridge_name='br-int',has_traffic_filtering=True,id=6a9c80ab-da5d-4fd5-b757-3c09fa3c1563,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c80ab-da')
Dec 06 07:09:48 user nova-compute[75021]: DEBUG nova.network.neutron [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] Releasing lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-changed-3eaf5559-41b4-4e36-85dc-dcfcde324aa8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing instance network info cache due to event network-changed-3eaf5559-41b4-4e36-85dc-dcfcde324aa8. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] Acquiring lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] Acquired lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG nova.network.neutron [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing network info cache for port 3eaf5559-41b4-4e36-85dc-dcfcde324aa8 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] No VIF found with MAC fa:16:3e:11:9c:c0, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG nova.network.neutron [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG nova.network.neutron [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6e21edff-be3d-49e0-84a4-2faaa8ebefce req-d34c3090-a257-49e5-a77e-168673581bf5 service nova] Releasing lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:48 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Successfully updated port: cb1e15ad-aa13-4507-b83c-035a05d32268 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-changed-b61841a9-756e-4ad4-b803-017c7bd985de {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing instance network info cache due to event network-changed-b61841a9-756e-4ad4-b803-017c7bd985de. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] Acquiring lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] Acquired lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing network info cache for port b61841a9-756e-4ad4-b803-017c7bd985de {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Successfully updated port: 0fe07857-5428-4598-b751-b88ff51d7c18 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:09:49 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Instance spawned successfully.
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-f02114ad-5b83-424a-8f8a-f5bf306d77b7 req-507423b9-1152-4ad5-b579-f304ab3eeb92 service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Received event network-vif-plugged-f2029bf5-89e2-4759-90a2-a17f8721653c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f02114ad-5b83-424a-8f8a-f5bf306d77b7 req-507423b9-1152-4ad5-b579-f304ab3eeb92 service nova] Acquiring lock "35da578f-dc7b-4038-869e-3d7528844bf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f02114ad-5b83-424a-8f8a-f5bf306d77b7 req-507423b9-1152-4ad5-b579-f304ab3eeb92 service nova] Lock "35da578f-dc7b-4038-869e-3d7528844bf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f02114ad-5b83-424a-8f8a-f5bf306d77b7 req-507423b9-1152-4ad5-b579-f304ab3eeb92 service nova] Lock "35da578f-dc7b-4038-869e-3d7528844bf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-f02114ad-5b83-424a-8f8a-f5bf306d77b7 req-507423b9-1152-4ad5-b579-f304ab3eeb92 service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] No waiting events found dispatching network-vif-plugged-f2029bf5-89e2-4759-90a2-a17f8721653c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:09:49 user nova-compute[75021]: WARNING nova.compute.manager [req-f02114ad-5b83-424a-8f8a-f5bf306d77b7 req-507423b9-1152-4ad5-b579-f304ab3eeb92 service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Received unexpected event network-vif-plugged-f2029bf5-89e2-4759-90a2-a17f8721653c for instance with vm_state building and task_state spawning.
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-4d12f9f3-cce6-419d-8bda-a79142110ce6 req-9b4ac819-c573-4f7e-9862-0498a3b2cdbd service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received event network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4d12f9f3-cce6-419d-8bda-a79142110ce6 req-9b4ac819-c573-4f7e-9862-0498a3b2cdbd service nova] Acquiring lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4d12f9f3-cce6-419d-8bda-a79142110ce6 req-9b4ac819-c573-4f7e-9862-0498a3b2cdbd service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4d12f9f3-cce6-419d-8bda-a79142110ce6 req-9b4ac819-c573-4f7e-9862-0498a3b2cdbd service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-4d12f9f3-cce6-419d-8bda-a79142110ce6 req-9b4ac819-c573-4f7e-9862-0498a3b2cdbd service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] No waiting events found dispatching network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:09:49 user nova-compute[75021]: WARNING nova.compute.manager [req-4d12f9f3-cce6-419d-8bda-a79142110ce6 req-9b4ac819-c573-4f7e-9862-0498a3b2cdbd service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received unexpected event network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 for instance with vm_state active and task_state rebuild_spawning.
Dec 06 07:09:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:49 user nova-compute[75021]: INFO nova.compute.manager [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Took 6.12 seconds to spawn the instance on the hypervisor.
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] Releasing lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-changed-cb1e15ad-aa13-4507-b83c-035a05d32268 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing instance network info cache due to event network-changed-cb1e15ad-aa13-4507-b83c-035a05d32268. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] Acquiring lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] Acquired lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing network info cache for port cb1e15ad-aa13-4507-b83c-035a05d32268 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:09:49 user nova-compute[75021]: INFO nova.compute.manager [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Took 7.17 seconds to build instance.
Dec 06 07:09:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:09:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-160923d7-a517-49f7-8087-a0d74c8237e9 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "35da578f-dc7b-4038-869e-3d7528844bf0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.270s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:50 user nova-compute[75021]: DEBUG nova.network.neutron [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8ac5effe-bf74-4a3c-8880-61ae58e3b5a2 req-aaf577d8-16d4-44dc-866b-63cc550e93ab service nova] Releasing lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquired lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:50 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:09:50 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-cbb8b8db-5cea-4163-8165-3b7a612e30bb req-e676f492-014b-4eaa-a80a-edec1216632a service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-changed-0fe07857-5428-4598-b751-b88ff51d7c18 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-cbb8b8db-5cea-4163-8165-3b7a612e30bb req-e676f492-014b-4eaa-a80a-edec1216632a service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing instance network info cache due to event network-changed-0fe07857-5428-4598-b751-b88ff51d7c18. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cbb8b8db-5cea-4163-8165-3b7a612e30bb req-e676f492-014b-4eaa-a80a-edec1216632a service nova] Acquiring lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-8ab7db72-3bd8-473f-b23b-77310e1af1ac req-730bc36e-b98c-4a2a-b600-3896d778d423 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received event network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8ab7db72-3bd8-473f-b23b-77310e1af1ac req-730bc36e-b98c-4a2a-b600-3896d778d423 service nova] Acquiring lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8ab7db72-3bd8-473f-b23b-77310e1af1ac req-730bc36e-b98c-4a2a-b600-3896d778d423 service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8ab7db72-3bd8-473f-b23b-77310e1af1ac req-730bc36e-b98c-4a2a-b600-3896d778d423 service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-8ab7db72-3bd8-473f-b23b-77310e1af1ac req-730bc36e-b98c-4a2a-b600-3896d778d423 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] No waiting events found dispatching network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:09:51 user nova-compute[75021]: WARNING nova.compute.manager [req-8ab7db72-3bd8-473f-b23b-77310e1af1ac req-730bc36e-b98c-4a2a-b600-3896d778d423 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received unexpected event network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 for instance with vm_state active and task_state rebuild_spawning.
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.compute.manager [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:09:51 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Instance spawned successfully.
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.network.neutron [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updating instance_info_cache with network_info: [{"id": "07acf2eb-ace0-4ae1-b719-e179921b4283", "address": "fa:16:3e:19:ae:56", "network": {"id": "22ab25bd-67a1-4324-a7b4-8930fe53ac86", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-305871487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07acf2eb-ac", "ovs_interfaceid": "07acf2eb-ace0-4ae1-b719-e179921b4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "address": "fa:16:3e:f5:54:25", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2b8ff7-15", "ovs_interfaceid": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "address": "fa:16:3e:64:b5:e3", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5462413e-c2", "ovs_interfaceid": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "address": "fa:16:3e:8e:dc:5b", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eaf5559-41", "ovs_interfaceid": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b61841a9-756e-4ad4-b803-017c7bd985de", "address": "fa:16:3e:28:9f:3d", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61841a9-75", "ovs_interfaceid": "b61841a9-756e-4ad4-b803-017c7bd985de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb1e15ad-aa13-4507-b83c-035a05d32268", "address": "fa:16:3e:c6:50:d5", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1e15ad-aa", "ovs_interfaceid": "cb1e15ad-aa13-4507-b83c-035a05d32268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fe07857-5428-4598-b751-b88ff51d7c18", "address": "fa:16:3e:2f:4c:a3", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe07857-54", "ovs_interfaceid": "0fe07857-5428-4598-b751-b88ff51d7c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Releasing lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Instance network_info: |[{"id": "07acf2eb-ace0-4ae1-b719-e179921b4283", "address": "fa:16:3e:19:ae:56", "network": {"id": "22ab25bd-67a1-4324-a7b4-8930fe53ac86", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-305871487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07acf2eb-ac", "ovs_interfaceid": "07acf2eb-ace0-4ae1-b719-e179921b4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "address": "fa:16:3e:f5:54:25", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2b8ff7-15", "ovs_interfaceid": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "address": "fa:16:3e:64:b5:e3", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5462413e-c2", "ovs_interfaceid": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "address": "fa:16:3e:8e:dc:5b", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eaf5559-41", "ovs_interfaceid": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b61841a9-756e-4ad4-b803-017c7bd985de", "address": "fa:16:3e:28:9f:3d", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61841a9-75", "ovs_interfaceid": "b61841a9-756e-4ad4-b803-017c7bd985de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb1e15ad-aa13-4507-b83c-035a05d32268", "address": "fa:16:3e:c6:50:d5", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1e15ad-aa", "ovs_interfaceid": "cb1e15ad-aa13-4507-b83c-035a05d32268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fe07857-5428-4598-b751-b88ff51d7c18", "address": "fa:16:3e:2f:4c:a3", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe07857-54", "ovs_interfaceid": "0fe07857-5428-4598-b751-b88ff51d7c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cbb8b8db-5cea-4163-8165-3b7a612e30bb req-e676f492-014b-4eaa-a80a-edec1216632a service nova] Acquired lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.network.neutron [req-cbb8b8db-5cea-4163-8165-3b7a612e30bb req-e676f492-014b-4eaa-a80a-edec1216632a service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing network info cache for port 0fe07857-5428-4598-b751-b88ff51d7c18 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:09:51 user nova-compute[75021]: DEBUG nova.compute.manager [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:09:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:09:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:09:52 user nova-compute[75021]: DEBUG nova.objects.instance [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75021) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 06 07:09:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-44923950-ee9f-4d37-957c-fb8326e9ebd7 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:09:52 user nova-compute[75021]: DEBUG nova.network.neutron [req-cbb8b8db-5cea-4163-8165-3b7a612e30bb req-e676f492-014b-4eaa-a80a-edec1216632a service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updated VIF entry in instance network info cache for port 0fe07857-5428-4598-b751-b88ff51d7c18. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:09:52 user nova-compute[75021]: DEBUG nova.network.neutron [req-cbb8b8db-5cea-4163-8165-3b7a612e30bb req-e676f492-014b-4eaa-a80a-edec1216632a service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updating instance_info_cache with network_info: [{"id": "07acf2eb-ace0-4ae1-b719-e179921b4283", "address": "fa:16:3e:19:ae:56", "network": {"id": "22ab25bd-67a1-4324-a7b4-8930fe53ac86", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-305871487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07acf2eb-ac", "ovs_interfaceid": "07acf2eb-ace0-4ae1-b719-e179921b4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "address": "fa:16:3e:f5:54:25", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2b8ff7-15", "ovs_interfaceid": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "address": "fa:16:3e:64:b5:e3", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5462413e-c2", "ovs_interfaceid": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "address": "fa:16:3e:8e:dc:5b", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eaf5559-41", "ovs_interfaceid": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b61841a9-756e-4ad4-b803-017c7bd985de", "address": "fa:16:3e:28:9f:3d", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61841a9-75", "ovs_interfaceid": "b61841a9-756e-4ad4-b803-017c7bd985de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb1e15ad-aa13-4507-b83c-035a05d32268", "address": "fa:16:3e:c6:50:d5", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1e15ad-aa", "ovs_interfaceid": "cb1e15ad-aa13-4507-b83c-035a05d32268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fe07857-5428-4598-b751-b88ff51d7c18", "address": "fa:16:3e:2f:4c:a3", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe07857-54", "ovs_interfaceid": "0fe07857-5428-4598-b751-b88ff51d7c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:09:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cbb8b8db-5cea-4163-8165-3b7a612e30bb req-e676f492-014b-4eaa-a80a-edec1216632a service nova] Releasing lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:09:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKpgnXhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:09:58 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:09:58 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:09:58 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c478ee9-d81e-4d6b-bf78-333720f3b1a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:09:58 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda634bb-d3d3-4a66-bf86-1e1fad5bf7c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30] added
Dec 06 07:09:58 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e742e6d0-1da7-495b-b1f0-62a8e86faa52]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a925975-8c77-457d-b249-26fdda4b52a2]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bKpgnXhM {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bKpgnXhM" returned: 0 in 0.031s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[736d8c86-0575-4518-a3aa-d0616d034a97]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bKpgnXhM'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ce8674-4c5e-46eb-8bb2-74b689897b2d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:58 user nova-compute[75021]: INFO nova.virt.block_device [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Booting with volume 001fedc6-da7e-4ac9-8d7b-c55c95377a4d at /dev/vdb
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b22e5fa-d515-44e7-b465-d01a311899bf]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:58 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:58 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:09:58 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:58 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:58 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:09:58 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.utils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd79782-f44c-4a27-a79b-2e5cfc0b383e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c49fa27-568e-45a9-b9cd-37adac075c32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d905bc-c278-44c6-ba3b-8f6681f87550]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30, portal: 172.16.0.220,3260]
Dec 06 07:09:58 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30, portal: 172.16.0.220,3260] successful.
Dec 06 07:09:58 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f6268e-c7b9-4a77-a532-5665476a4e50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf15441-1943-4d2a-ad0d-49d318c6d356]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e108a0fd-6869-46cd-9306-fb2e316357b2]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:09:58 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fc2dd8-23ec-486b-94d4-1e561dc839e1]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.utils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updating existing volume attachment record: 833e8bb1-4005-4edf-8f30-7c95acf1a589 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[265400d8-6e3c-44fe-8e46-5ed6e37b36d3]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:58 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:58 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:09:58 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:09:58 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:09:58 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:09:58 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:09:58 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:09:58 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6bdc56-6a42-4a50-9a2e-2a34412fd8ed]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:09:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKpgnXhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:09:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:09:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '23162613633383035', 'path': '/dev/sde'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:09:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162613633383035', 'path': '/dev/sde'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:09:59 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'flavor' on Instance uuid 8b8eb320-6348-4038-a57e-02bf1e015174 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:09:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:09:59 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:09:59 user nova-compute[75021]:   <source dev="/dev/sde"/>
Dec 06 07:09:59 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:09:59 user nova-compute[75021]:   <serial>1b160044-a407-4c86-8077-0e9284134d30</serial>
Dec 06 07:09:59 user nova-compute[75021]: </disk>
Dec 06 07:09:59 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:10:00 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 is timed out.
Dec 06 07:10:00 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Successfully detached device vdb from instance 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 from the live domain config.
Dec 06 07:10:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uySvnlTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:10:00 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[96088052-c4bf-4276-a515-d3c1e6a82e83]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:10:00 user nova-compute[75021]: No targets found.
Dec 06 07:10:00 user nova-compute[75021]: iSNS:
Dec 06 07:10:00 user nova-compute[75021]: No targets found.
Dec 06 07:10:00 user nova-compute[75021]: STATIC:
Dec 06 07:10:00 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b
Dec 06 07:10:00 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:10:00 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:10:00 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:10:00 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:10:00 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:10:00 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30
Dec 06 07:10:00 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:10:00 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:10:00 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b
Dec 06 07:10:00 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:10:00 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:10:00 user nova-compute[75021]: FIRMWARE:
Dec 06 07:10:00 user nova-compute[75021]: No targets found.
Dec 06 07:10:00 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:10:00 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:10:00 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91f6c08-b4bc-48dc-80a9-bc6b3788fde7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40a2f58-0ad6-44fb-a031-6c87a9be5ce2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:10:00 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:10:00 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:10:00 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:10:00 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:10:00 user nova-compute[75021]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b (non-flash)
Dec 06 07:10:00 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:10:00 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:10:00 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b45e01f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No VIF found with MAC fa:16:3e:86:90:87, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb816332-a68b-4108-b481-c17131335f7d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[717cce2b-8db1-43f4-8401-7e3a0cf9829d]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa1c125-52af-479a-a246-04c4e27da011]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15bc456-6c73-4e94-b975-e725e97cff54]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[97291bff-9c96-4618-971a-697463615412]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9a0e7b55-0eed-47f9-8749-bc636e547f6a tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "8b8eb320-6348-4038-a57e-02bf1e015174" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.478s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce01e0d-c248-453e-8034-009fb8097b92]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260]
Dec 06 07:10:00 user nova-compute[75021]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b, portal: 172.16.0.220,3260] successful.
Dec 06 07:10:00 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16792f29-a35a-46ed-96e5-528d37062d8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4afe33-c98a-4f4a-aff8-6205c2fa528e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] <== disconnect_volume: return (356ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:00 user nova-compute[75021]: INFO nova.compute.manager [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Rescuing
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquired lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:10:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Updating instance_info_cache with network_info: [{"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Releasing lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-68ad81d2-904d-44ca-b0f2-c0ca3eb03944 req-084ed301-46c7-4289-bc90-3098db4f765c service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-vif-unplugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-68ad81d2-904d-44ca-b0f2-c0ca3eb03944 req-084ed301-46c7-4289-bc90-3098db4f765c service nova] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-68ad81d2-904d-44ca-b0f2-c0ca3eb03944 req-084ed301-46c7-4289-bc90-3098db4f765c service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-68ad81d2-904d-44ca-b0f2-c0ca3eb03944 req-084ed301-46c7-4289-bc90-3098db4f765c service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-68ad81d2-904d-44ca-b0f2-c0ca3eb03944 req-084ed301-46c7-4289-bc90-3098db4f765c service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] No waiting events found dispatching network-vif-unplugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:01 user nova-compute[75021]: WARNING nova.compute.manager [req-68ad81d2-904d-44ca-b0f2-c0ca3eb03944 req-084ed301-46c7-4289-bc90-3098db4f765c service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received unexpected event network-vif-unplugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e for instance with vm_state active and task_state rescuing.
Dec 06 07:10:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:02 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Instance destroyed successfully.
Dec 06 07:10:02 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Attempting rescue
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75021) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Instance directory exists: not creating {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 07:10:02 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Creating image(s)
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "/opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "/opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8b8eb320-6348-4038-a57e-02bf1e015174 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.176s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.rescue {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.rescue" returned: 0 in 0.046s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'migration_context' on Instance uuid 8b8eb320-6348-4038-a57e-02bf1e015174 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.objects.base [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Object Instance<8b8eb320-6348-4038-a57e-02bf1e015174> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Start _get_guest_xml network_info=[{"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "vif_mac": "fa:16:3e:86:90:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'resources' on Instance uuid 8b8eb320-6348-4038-a57e-02bf1e015174 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.objects.base [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Object Instance<8b8eb320-6348-4038-a57e-02bf1e015174> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'numa_topology' on Instance uuid 8b8eb320-6348-4038-a57e-02bf1e015174 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.objects.base [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Object Instance<8b8eb320-6348-4038-a57e-02bf1e015174> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:10:02 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:10:02 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8b8eb320-6348-4038-a57e-02bf1e015174 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.objects.base [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Object Instance<8b8eb320-6348-4038-a57e-02bf1e015174> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-699999378',display_name='tempest-ServerRescueNegativeTestJSON-server-699999378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-699999378',id=25,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrrx+YwFNghcFUjqpJOY9cNZNxR7XuyO+lbBn8nBbazUK41wZJQ+nseUHYDKzbfDjsiE9koMmTXhvVI4jne/Z5jMNRtJnHZ99FwlNfe8/CQ9L6WSSjfybYcI9DYbCC3Tw==',key_name='tempest-keypair-835634634',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:07:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43d3fb6e885546bd9660c81fac9cfa12',ramdisk_id='',reservation_id='r-2ue4rtaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-674134420',owner_user_name='tempest-ServerRescueNegativeTestJSON-674134420-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:07:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6d8114db9fa47c09bc9675da9e19a8c',uuid=8b8eb320-6348-4038-a57e-02bf1e015174,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "vif_mac": "fa:16:3e:86:90:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converting VIF {"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "vif_mac": "fa:16:3e:86:90:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:90:87,bridge_name='br-int',has_traffic_filtering=True,id=2d2bc1b9-24cd-4992-93a5-e3638e21a35e,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bc1b9-24') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b8eb320-6348-4038-a57e-02bf1e015174 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.objects.base [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Object Instance<8b8eb320-6348-4038-a57e-02bf1e015174> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:10:02 user nova-compute[75021]:   <uuid>8b8eb320-6348-4038-a57e-02bf1e015174</uuid>
Dec 06 07:10:02 user nova-compute[75021]:   <name>instance-00000019</name>
Dec 06 07:10:02 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:10:02 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:10:02 user nova-compute[75021]:   <metadata>
Dec 06 07:10:02 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:10:02 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:10:02 user nova-compute[75021]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-699999378</nova:name>
Dec 06 07:10:02 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:10:02</nova:creationTime>
Dec 06 07:10:02 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:10:02 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:10:02 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:10:02 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:10:02 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:10:02 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:10:02 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:10:02 user nova-compute[75021]:       <nova:owner>
Dec 06 07:10:02 user nova-compute[75021]:         <nova:user uuid="e6d8114db9fa47c09bc9675da9e19a8c">tempest-ServerRescueNegativeTestJSON-674134420-project-member</nova:user>
Dec 06 07:10:02 user nova-compute[75021]:         <nova:project uuid="43d3fb6e885546bd9660c81fac9cfa12">tempest-ServerRescueNegativeTestJSON-674134420</nova:project>
Dec 06 07:10:02 user nova-compute[75021]:       </nova:owner>
Dec 06 07:10:02 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:10:02 user nova-compute[75021]:       <nova:ports>
Dec 06 07:10:02 user nova-compute[75021]:         <nova:port uuid="2d2bc1b9-24cd-4992-93a5-e3638e21a35e">
Dec 06 07:10:02 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 06 07:10:02 user nova-compute[75021]:         </nova:port>
Dec 06 07:10:02 user nova-compute[75021]:       </nova:ports>
Dec 06 07:10:02 user nova-compute[75021]:     </nova:instance>
Dec 06 07:10:02 user nova-compute[75021]:   </metadata>
Dec 06 07:10:02 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:10:02 user nova-compute[75021]:     <system>
Dec 06 07:10:02 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:10:02 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:10:02 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:10:02 user nova-compute[75021]:       <entry name="serial">8b8eb320-6348-4038-a57e-02bf1e015174</entry>
Dec 06 07:10:02 user nova-compute[75021]:       <entry name="uuid">8b8eb320-6348-4038-a57e-02bf1e015174</entry>
Dec 06 07:10:02 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:10:02 user nova-compute[75021]:     </system>
Dec 06 07:10:02 user nova-compute[75021]:   </sysinfo>
Dec 06 07:10:02 user nova-compute[75021]:   <os>
Dec 06 07:10:02 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:10:02 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:10:02 user nova-compute[75021]:   </os>
Dec 06 07:10:02 user nova-compute[75021]:   <features>
Dec 06 07:10:02 user nova-compute[75021]:     <acpi/>
Dec 06 07:10:02 user nova-compute[75021]:     <apic/>
Dec 06 07:10:02 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:10:02 user nova-compute[75021]:   </features>
Dec 06 07:10:02 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:10:02 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:10:02 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:10:02 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:10:02 user nova-compute[75021]:   </clock>
Dec 06 07:10:02 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:10:02 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:10:02 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:10:02 user nova-compute[75021]:   </cpu>
Dec 06 07:10:02 user nova-compute[75021]:   <devices>
Dec 06 07:10:02 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:10:02 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:10:02 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.rescue"/>
Dec 06 07:10:02 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:10:02 user nova-compute[75021]:     </disk>
Dec 06 07:10:02 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:10:02 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:10:02 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk"/>
Dec 06 07:10:02 user nova-compute[75021]:       <target dev="vdb" bus="virtio"/>
Dec 06 07:10:02 user nova-compute[75021]:     </disk>
Dec 06 07:10:02 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:10:02 user nova-compute[75021]:       <mac address="fa:16:3e:86:90:87"/>
Dec 06 07:10:02 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:10:02 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:10:02 user nova-compute[75021]:       <target dev="tap2d2bc1b9-24"/>
Dec 06 07:10:02 user nova-compute[75021]:     </interface>
Dec 06 07:10:02 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:10:02 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/console.log" append="off"/>
Dec 06 07:10:02 user nova-compute[75021]:     </serial>
Dec 06 07:10:02 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:10:02 user nova-compute[75021]:     <video>
Dec 06 07:10:02 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:10:02 user nova-compute[75021]:     </video>
Dec 06 07:10:02 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:10:02 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:10:02 user nova-compute[75021]:     </rng>
Dec 06 07:10:02 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:10:02 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:10:02 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:10:02 user nova-compute[75021]:     </memballoon>
Dec 06 07:10:02 user nova-compute[75021]:   </devices>
Dec 06 07:10:02 user nova-compute[75021]: </domain>
Dec 06 07:10:02 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:10:02 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Instance destroyed successfully.
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] No VIF found with MAC fa:16:3e:86:90:87, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:10:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG nova.objects.instance [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lazy-loading 'flavor' on Instance uuid 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-59e65dec-e4b4-4199-9adc-9986ced7a68c tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.534s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-fc764be0-155c-4979-819d-1a4bed380094 req-06de567a-e3b1-42e5-a679-070bd7f43908 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fc764be0-155c-4979-819d-1a4bed380094 req-06de567a-e3b1-42e5-a679-070bd7f43908 service nova] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fc764be0-155c-4979-819d-1a4bed380094 req-06de567a-e3b1-42e5-a679-070bd7f43908 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fc764be0-155c-4979-819d-1a4bed380094 req-06de567a-e3b1-42e5-a679-070bd7f43908 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-fc764be0-155c-4979-819d-1a4bed380094 req-06de567a-e3b1-42e5-a679-070bd7f43908 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] No waiting events found dispatching network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:03 user nova-compute[75021]: WARNING nova.compute.manager [req-fc764be0-155c-4979-819d-1a4bed380094 req-06de567a-e3b1-42e5-a679-070bd7f43908 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received unexpected event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e for instance with vm_state active and task_state rescuing.
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:10:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-48ef2bcd-3fcd-4622-adda-3bf313e344e8 req-e81e91f4-b945-4dca-a4a6-1f623ffa202b service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-48ef2bcd-3fcd-4622-adda-3bf313e344e8 req-e81e91f4-b945-4dca-a4a6-1f623ffa202b service nova] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-48ef2bcd-3fcd-4622-adda-3bf313e344e8 req-e81e91f4-b945-4dca-a4a6-1f623ffa202b service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-48ef2bcd-3fcd-4622-adda-3bf313e344e8 req-e81e91f4-b945-4dca-a4a6-1f623ffa202b service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-48ef2bcd-3fcd-4622-adda-3bf313e344e8 req-e81e91f4-b945-4dca-a4a6-1f623ffa202b service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] No waiting events found dispatching network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:06 user nova-compute[75021]: WARNING nova.compute.manager [req-48ef2bcd-3fcd-4622-adda-3bf313e344e8 req-e81e91f4-b945-4dca-a4a6-1f623ffa202b service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received unexpected event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e for instance with vm_state active and task_state rescuing.
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-48ef2bcd-3fcd-4622-adda-3bf313e344e8 req-e81e91f4-b945-4dca-a4a6-1f623ffa202b service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-48ef2bcd-3fcd-4622-adda-3bf313e344e8 req-e81e91f4-b945-4dca-a4a6-1f623ffa202b service nova] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-48ef2bcd-3fcd-4622-adda-3bf313e344e8 req-e81e91f4-b945-4dca-a4a6-1f623ffa202b service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-48ef2bcd-3fcd-4622-adda-3bf313e344e8 req-e81e91f4-b945-4dca-a4a6-1f623ffa202b service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-48ef2bcd-3fcd-4622-adda-3bf313e344e8 req-e81e91f4-b945-4dca-a4a6-1f623ffa202b service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] No waiting events found dispatching network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:06 user nova-compute[75021]: WARNING nova.compute.manager [req-48ef2bcd-3fcd-4622-adda-3bf313e344e8 req-e81e91f4-b945-4dca-a4a6-1f623ffa202b service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received unexpected event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e for instance with vm_state active and task_state rescuing.
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d5c1d5b1-fbd9-4bf0-a534-38ce8d9445f5 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:10:06 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:10:06 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7373MB free_disk=25.207996368408203GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5c50a6a8-2500-4408-a932-48f0116713b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 8b8eb320-6348-4038-a57e-02bf1e015174 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a6c8e069-46ae-4069-b81e-364bad589ebf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 35da578f-dc7b-4038-869e-3d7528844bf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:10:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:10:07 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:10:07 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:10:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:10:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.764s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:10:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:10:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:10:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:10:10 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:10:11 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Updating instance_info_cache with network_info: [{"id": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "address": "fa:16:3e:b7:f2:e4", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f43de0b-bf", "ovs_interfaceid": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:10:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:10:11 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:10:11 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:10:11 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:10:11 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:10:11 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:10:11 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:10:11 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:10:11 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:10:11 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 07:10:11 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] There are 0 instances to clean {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 07:10:11 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:10:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:10:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:14 user nova-compute[75021]: INFO nova.virt.block_device [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Booting with volume febfff55-7926-4e60-a4a1-c947e77f62c7 at /dev/vdc
Dec 06 07:10:14 user nova-compute[75021]: DEBUG os_brick.utils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2607539-2107-435c-b710-a4bc22f792d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca99a72-5ca6-43e5-9ace-fd9d030ae151]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[662a4fcb-69a7-4dcb-b54d-53370bd5fa77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bba3cc0-e134-4c50-815d-e1126b5e2517]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:10:14 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:10:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffad2791-9d53-4490-ade0-55bf7e729b47]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG os_brick.utils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:10:14 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updating existing volume attachment record: 91c5bec0-929f-4171-8b13-8d084f4cf36a {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:10:16 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:10:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75021) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 07:10:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:10:28 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Creating image(s)
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Ensure instance console log exists: /opt/stack/data/nova/instances/a6c8e069-46ae-4069-b81e-364bad589ebf/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Start _get_guest_xml network_info=[{"id": "07acf2eb-ace0-4ae1-b719-e179921b4283", "address": "fa:16:3e:19:ae:56", "network": {"id": "22ab25bd-67a1-4324-a7b4-8930fe53ac86", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-305871487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07acf2eb-ac", "ovs_interfaceid": "07acf2eb-ace0-4ae1-b719-e179921b4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "address": "fa:16:3e:f5:54:25", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2b8ff7-15", "ovs_interfaceid": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "address": "fa:16:3e:64:b5:e3", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5462413e-c2", "ovs_interfaceid": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "address": "fa:16:3e:8e:dc:5b", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eaf5559-41", "ovs_interfaceid": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b61841a9-756e-4ad4-b803-017c7bd985de", "address": "fa:16:3e:28:9f:3d", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61841a9-75", "ovs_interfaceid": "b61841a9-756e-4ad4-b803-017c7bd985de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb1e15ad-aa13-4507-b83c-035a05d32268", "address": "fa:16:3e:c6:50:d5", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1e15ad-aa", "ovs_interfaceid": "cb1e15ad-aa13-4507-b83c-035a05d32268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fe07857-5428-4598-b751-b88ff51d7c18", "address": "fa:16:3e:2f:4c:a3", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe07857-54", "ovs_interfaceid": "0fe07857-5428-4598-b751-b88ff51d7c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b3d8e256-2a02-4090-842d-b4f3b0073ff4', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qbVwGWhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6c8e069-46ae-4069-b81e-364bad589ebf', 'attached_at': '', 'detached_at': '', 'volume_id': '5dbe0266-71c4-4370-b543-da543f3cd000', 'serial': '5dbe0266-71c4-4370-b543-da543f3cd000'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '833e8bb1-4005-4edf-8f30-7c95acf1a589', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwHvKSmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6c8e069-46ae-4069-b81e-364bad589ebf', 'attached_at': '', 'detached_at': '', 'volume_id': '001fedc6-da7e-4ac9-8d7b-c55c95377a4d', 'serial': '001fedc6-da7e-4ac9-8d7b-c55c95377a4d'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': 1, 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '91c5bec0-929f-4171-8b13-8d084f4cf36a', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEcfqJBo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6c8e069-46ae-4069-b81e-364bad589ebf', 'attached_at': '', 'detached_at': '', 'volume_id': 'febfff55-7926-4e60-a4a1-c947e77f62c7', 'serial': 'febfff55-7926-4e60-a4a1-c947e77f62c7'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': 2, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:10:28 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:10:28 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qbVwGWhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:10:28 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:10:28 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:10:28 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e21e38-9eaf-4964-a969-8d499bac1203]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:10:28 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaf94de-a879-4ce3-8de4-45da7464e8ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000] added
Dec 06 07:10:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca84abc1-8301-4388-ab62-92e421299f55]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[37026426-28fa-4dec-bb59-e52b75d5579a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qbVwGWhU {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qbVwGWhU" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdca821-513f-4a8e-85d7-ed9ddfb44bb7]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qbVwGWhU'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbd22da-73e2-498d-a6f1-be458ea7be2f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62e1ccf-08b1-49a1-8665-d5b1d5bef41d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:10:28 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:10:28 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:10:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:10:28 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:10:28 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:10:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8a1cff-2aee-4810-979a-df72b57bd6b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000, portal: 172.16.0.220,3260]
Dec 06 07:10:28 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000, portal: 172.16.0.220,3260] successful.
Dec 06 07:10:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[15760794-8657-4de2-9fdd-842c290e8e3b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b07eac1-5d7c-4bf5-a4e5-f684d91db88b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:10:28 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:10:28 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:10:28 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:10:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:10:28 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:10:28 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:10:28 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:10:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e23b45c-cc33-4bc0-96e2-2dc26b962df4]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qbVwGWhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23861303263623537', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861303263623537', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwHvKSmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:10:29 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:10:29 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:10:29 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9d196b-661f-47f4-a6ee-25187f633d29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:10:29 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac88d688-fcd9-479e-bf03-f564b1b24716]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d] added
Dec 06 07:10:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d5bb4d-5035-4580-acf0-487a12411fb4]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1f7fba-6af5-4c57-9eff-b87f8e4fb2f6]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zwHvKSmX {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zwHvKSmX" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fbeba0-4d12-471c-a061-dde1053390a1]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zwHvKSmX'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a42ab15-c988-4b7e-aed5-a7636f297f46]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea94e4f6-2120-41ad-9ca0-47e6365b7ae8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:10:29 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:10:29 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:10:29 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:10:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:10:29 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:10:29 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:10:29 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:10:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[470516da-27a5-414e-b023-e3c451204ee5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d, portal: 172.16.0.220,3260]
Dec 06 07:10:29 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d, portal: 172.16.0.220,3260] successful.
Dec 06 07:10:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb7e121-27d0-485d-a5f9-6a8d8e0be344]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cd5089-523f-4701-8489-afe047a68892]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:10:29 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:10:29 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:10:29 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:10:29 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:10:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:10:29 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:10:29 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:10:29 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:10:29 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:10:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bafad1-2cce-4038-a0a8-63f1c5fc715a]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:10:30 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:10:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwHvKSmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:10:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:10:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26363303032363133', 'path': '/dev/sdf'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:10:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363303032363133', 'path': '/dev/sdf'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEcfqJBo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:10:31 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:10:31 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:10:31 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6deccf-ed88-4d6b-b7e7-f51c48c757a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:10:31 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9961ac7e-b606-456c-85dc-e5de4f79aa33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7] added
Dec 06 07:10:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.050s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[54aa9568-80cb-4882-bec0-597130204791]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3fce25-3df7-4177-a03d-352eb2696062]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uEcfqJBo {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uEcfqJBo" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4157a6-7fa5-4d31-bfad-c53002c57493]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uEcfqJBo'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[af223b4f-beaf-45a1-a95f-5c260293d1be]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ad0acd-a48f-411d-b82c-71bafc24b2f4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:10:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:10:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9f5369-edf4-43f4-ae39-4c7403ec802e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7, portal: 172.16.0.220,3260]
Dec 06 07:10:31 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7, portal: 172.16.0.220,3260] successful.
Dec 06 07:10:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dd9bcc-18bb-49f4-861a-2f6d97819f5d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce865fa4-f647-4bd8-a986-3e7cee508d0c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:10:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:10:31 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:10:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8705b4-0ee2-4048-a3da-decc0cf1ce49]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:10:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEcfqJBo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "e600e40b-0b08-4341-a48e-652da530e59c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "e600e40b-0b08-4341-a48e-652da530e59c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:32 user nova-compute[75021]: INFO nova.compute.manager [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Unshelving
Dec 06 07:10:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26437326632306539', 'path': '/dev/sdg'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437326632306539', 'path': '/dev/sdg'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07acf2eb-ace0-4ae1-b719-e179921b4283", "address": "fa:16:3e:19:ae:56", "network": {"id": "22ab25bd-67a1-4324-a7b4-8930fe53ac86", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-305871487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07acf2eb-ac", "ovs_interfaceid": "07acf2eb-ace0-4ae1-b719-e179921b4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "07acf2eb-ace0-4ae1-b719-e179921b4283", "address": "fa:16:3e:19:ae:56", "network": {"id": "22ab25bd-67a1-4324-a7b4-8930fe53ac86", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-305871487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07acf2eb-ac", "ovs_interfaceid": "07acf2eb-ace0-4ae1-b719-e179921b4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:ae:56,bridge_name='br-int',has_traffic_filtering=True,id=07acf2eb-ace0-4ae1-b719-e179921b4283,network=Network(22ab25bd-67a1-4324-a7b4-8930fe53ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07acf2eb-ac') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "address": "fa:16:3e:f5:54:25", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2b8ff7-15", "ovs_interfaceid": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "address": "fa:16:3e:f5:54:25", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2b8ff7-15", "ovs_interfaceid": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:54:25,bridge_name='br-int',has_traffic_filtering=True,id=3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f2b8ff7-15') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "address": "fa:16:3e:64:b5:e3", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5462413e-c2", "ovs_interfaceid": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "address": "fa:16:3e:64:b5:e3", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5462413e-c2", "ovs_interfaceid": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:b5:e3,bridge_name='br-int',has_traffic_filtering=True,id=5462413e-c273-42de-8ba8-1fde5c39c0a4,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5462413e-c2') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "address": "fa:16:3e:8e:dc:5b", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eaf5559-41", "ovs_interfaceid": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "address": "fa:16:3e:8e:dc:5b", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eaf5559-41", "ovs_interfaceid": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:dc:5b,bridge_name='br-int',has_traffic_filtering=True,id=3eaf5559-41b4-4e36-85dc-dcfcde324aa8,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eaf5559-41') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b61841a9-756e-4ad4-b803-017c7bd985de", "address": "fa:16:3e:28:9f:3d", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61841a9-75", "ovs_interfaceid": "b61841a9-756e-4ad4-b803-017c7bd985de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "b61841a9-756e-4ad4-b803-017c7bd985de", "address": "fa:16:3e:28:9f:3d", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61841a9-75", "ovs_interfaceid": "b61841a9-756e-4ad4-b803-017c7bd985de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:9f:3d,bridge_name='br-int',has_traffic_filtering=True,id=b61841a9-756e-4ad4-b803-017c7bd985de,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb61841a9-75') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb1e15ad-aa13-4507-b83c-035a05d32268", "address": "fa:16:3e:c6:50:d5", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1e15ad-aa", "ovs_interfaceid": "cb1e15ad-aa13-4507-b83c-035a05d32268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "cb1e15ad-aa13-4507-b83c-035a05d32268", "address": "fa:16:3e:c6:50:d5", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1e15ad-aa", "ovs_interfaceid": "cb1e15ad-aa13-4507-b83c-035a05d32268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:50:d5,bridge_name='br-int',has_traffic_filtering=True,id=cb1e15ad-aa13-4507-b83c-035a05d32268,network=Network(ac205859-e685-4363-98db-558784812e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1e15ad-aa') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fe07857-5428-4598-b751-b88ff51d7c18", "address": "fa:16:3e:2f:4c:a3", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe07857-54", "ovs_interfaceid": "0fe07857-5428-4598-b751-b88ff51d7c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "0fe07857-5428-4598-b751-b88ff51d7c18", "address": "fa:16:3e:2f:4c:a3", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe07857-54", "ovs_interfaceid": "0fe07857-5428-4598-b751-b88ff51d7c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=0fe07857-5428-4598-b751-b88ff51d7c18,network=Network(ac205859-e685-4363-98db-558784812e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe07857-54') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.objects.instance [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lazy-loading 'pci_devices' on Instance uuid a6c8e069-46ae-4069-b81e-364bad589ebf {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:10:32 user nova-compute[75021]:   <uuid>a6c8e069-46ae-4069-b81e-364bad589ebf</uuid>
Dec 06 07:10:32 user nova-compute[75021]:   <name>instance-0000001b</name>
Dec 06 07:10:32 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:10:32 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:10:32 user nova-compute[75021]:   <metadata>
Dec 06 07:10:32 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:10:32 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:10:32 user nova-compute[75021]:       <nova:name>tempest-device-tagging-server-213657073</nova:name>
Dec 06 07:10:32 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:10:28</nova:creationTime>
Dec 06 07:10:32 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:10:32 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:10:32 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:10:32 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:10:32 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:10:32 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:10:32 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:10:32 user nova-compute[75021]:       <nova:owner>
Dec 06 07:10:32 user nova-compute[75021]:         <nova:user uuid="0b894e8943b54078832aab4f727af7cb">tempest-TaggedBootDevicesTest_v242-1777802644-project-member</nova:user>
Dec 06 07:10:32 user nova-compute[75021]:         <nova:project uuid="88e7a9eedb83455fab3446e497feae40">tempest-TaggedBootDevicesTest_v242-1777802644</nova:project>
Dec 06 07:10:32 user nova-compute[75021]:       </nova:owner>
Dec 06 07:10:32 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:10:32 user nova-compute[75021]:       <nova:ports>
Dec 06 07:10:32 user nova-compute[75021]:         <nova:port uuid="07acf2eb-ace0-4ae1-b719-e179921b4283">
Dec 06 07:10:32 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 06 07:10:32 user nova-compute[75021]:         </nova:port>
Dec 06 07:10:32 user nova-compute[75021]:         <nova:port uuid="3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190">
Dec 06 07:10:32 user nova-compute[75021]:           <nova:ip type="fixed" address="10.1.1.104" ipVersion="4"/>
Dec 06 07:10:32 user nova-compute[75021]:         </nova:port>
Dec 06 07:10:32 user nova-compute[75021]:         <nova:port uuid="5462413e-c273-42de-8ba8-1fde5c39c0a4">
Dec 06 07:10:32 user nova-compute[75021]:           <nova:ip type="fixed" address="10.1.1.234" ipVersion="4"/>
Dec 06 07:10:32 user nova-compute[75021]:         </nova:port>
Dec 06 07:10:32 user nova-compute[75021]:         <nova:port uuid="3eaf5559-41b4-4e36-85dc-dcfcde324aa8">
Dec 06 07:10:32 user nova-compute[75021]:           <nova:ip type="fixed" address="10.1.1.122" ipVersion="4"/>
Dec 06 07:10:32 user nova-compute[75021]:         </nova:port>
Dec 06 07:10:32 user nova-compute[75021]:         <nova:port uuid="b61841a9-756e-4ad4-b803-017c7bd985de">
Dec 06 07:10:32 user nova-compute[75021]:           <nova:ip type="fixed" address="10.1.1.37" ipVersion="4"/>
Dec 06 07:10:32 user nova-compute[75021]:         </nova:port>
Dec 06 07:10:32 user nova-compute[75021]:         <nova:port uuid="cb1e15ad-aa13-4507-b83c-035a05d32268">
Dec 06 07:10:32 user nova-compute[75021]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 06 07:10:32 user nova-compute[75021]:         </nova:port>
Dec 06 07:10:32 user nova-compute[75021]:         <nova:port uuid="0fe07857-5428-4598-b751-b88ff51d7c18">
Dec 06 07:10:32 user nova-compute[75021]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 06 07:10:32 user nova-compute[75021]:         </nova:port>
Dec 06 07:10:32 user nova-compute[75021]:       </nova:ports>
Dec 06 07:10:32 user nova-compute[75021]:     </nova:instance>
Dec 06 07:10:32 user nova-compute[75021]:   </metadata>
Dec 06 07:10:32 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:10:32 user nova-compute[75021]:     <system>
Dec 06 07:10:32 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:10:32 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:10:32 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:10:32 user nova-compute[75021]:       <entry name="serial">a6c8e069-46ae-4069-b81e-364bad589ebf</entry>
Dec 06 07:10:32 user nova-compute[75021]:       <entry name="uuid">a6c8e069-46ae-4069-b81e-364bad589ebf</entry>
Dec 06 07:10:32 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:10:32 user nova-compute[75021]:     </system>
Dec 06 07:10:32 user nova-compute[75021]:   </sysinfo>
Dec 06 07:10:32 user nova-compute[75021]:   <os>
Dec 06 07:10:32 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:10:32 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:10:32 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:10:32 user nova-compute[75021]:   </os>
Dec 06 07:10:32 user nova-compute[75021]:   <features>
Dec 06 07:10:32 user nova-compute[75021]:     <acpi/>
Dec 06 07:10:32 user nova-compute[75021]:     <apic/>
Dec 06 07:10:32 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:10:32 user nova-compute[75021]:   </features>
Dec 06 07:10:32 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:10:32 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:10:32 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:10:32 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:10:32 user nova-compute[75021]:   </clock>
Dec 06 07:10:32 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:10:32 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:10:32 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:10:32 user nova-compute[75021]:   </cpu>
Dec 06 07:10:32 user nova-compute[75021]:   <devices>
Dec 06 07:10:32 user nova-compute[75021]:     <disk type="file" device="cdrom">
Dec 06 07:10:32 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none"/>
Dec 06 07:10:32 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/a6c8e069-46ae-4069-b81e-364bad589ebf/disk.config"/>
Dec 06 07:10:32 user nova-compute[75021]:       <target dev="hda" bus="ide"/>
Dec 06 07:10:32 user nova-compute[75021]:     </disk>
Dec 06 07:10:32 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:10:32 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:10:32 user nova-compute[75021]:       <source dev="/dev/sdb"/>
Dec 06 07:10:32 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:10:32 user nova-compute[75021]:       <serial>5dbe0266-71c4-4370-b543-da543f3cd000</serial>
Dec 06 07:10:32 user nova-compute[75021]:     </disk>
Dec 06 07:10:32 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:10:32 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:10:32 user nova-compute[75021]:       <source dev="/dev/sdf"/>
Dec 06 07:10:32 user nova-compute[75021]:       <target dev="vdb" bus="virtio"/>
Dec 06 07:10:32 user nova-compute[75021]:       <serial>001fedc6-da7e-4ac9-8d7b-c55c95377a4d</serial>
Dec 06 07:10:32 user nova-compute[75021]:     </disk>
Dec 06 07:10:32 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:10:32 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:10:32 user nova-compute[75021]:       <source dev="/dev/sdg"/>
Dec 06 07:10:32 user nova-compute[75021]:       <target dev="vdc" bus="virtio"/>
Dec 06 07:10:32 user nova-compute[75021]:       <serial>febfff55-7926-4e60-a4a1-c947e77f62c7</serial>
Dec 06 07:10:32 user nova-compute[75021]:     </disk>
Dec 06 07:10:32 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:10:32 user nova-compute[75021]:       <mac address="fa:16:3e:19:ae:56"/>
Dec 06 07:10:32 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:10:32 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:10:32 user nova-compute[75021]:       <target dev="tap07acf2eb-ac"/>
Dec 06 07:10:32 user nova-compute[75021]:     </interface>
Dec 06 07:10:32 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:10:32 user nova-compute[75021]:       <mac address="fa:16:3e:f5:54:25"/>
Dec 06 07:10:32 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:10:32 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:10:32 user nova-compute[75021]:       <target dev="tap3f2b8ff7-15"/>
Dec 06 07:10:32 user nova-compute[75021]:     </interface>
Dec 06 07:10:32 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:10:32 user nova-compute[75021]:       <mac address="fa:16:3e:64:b5:e3"/>
Dec 06 07:10:32 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:10:32 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:10:32 user nova-compute[75021]:       <target dev="tap5462413e-c2"/>
Dec 06 07:10:32 user nova-compute[75021]:     </interface>
Dec 06 07:10:32 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:10:32 user nova-compute[75021]:       <mac address="fa:16:3e:8e:dc:5b"/>
Dec 06 07:10:32 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:10:32 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:10:32 user nova-compute[75021]:       <target dev="tap3eaf5559-41"/>
Dec 06 07:10:32 user nova-compute[75021]:     </interface>
Dec 06 07:10:32 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:10:32 user nova-compute[75021]:       <mac address="fa:16:3e:28:9f:3d"/>
Dec 06 07:10:32 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:10:32 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:10:32 user nova-compute[75021]:       <target dev="tapb61841a9-75"/>
Dec 06 07:10:32 user nova-compute[75021]:     </interface>
Dec 06 07:10:32 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:10:32 user nova-compute[75021]:       <mac address="fa:16:3e:c6:50:d5"/>
Dec 06 07:10:32 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:10:32 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:10:32 user nova-compute[75021]:       <target dev="tapcb1e15ad-aa"/>
Dec 06 07:10:32 user nova-compute[75021]:     </interface>
Dec 06 07:10:32 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:10:32 user nova-compute[75021]:       <mac address="fa:16:3e:2f:4c:a3"/>
Dec 06 07:10:32 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:10:32 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:10:32 user nova-compute[75021]:       <target dev="tap0fe07857-54"/>
Dec 06 07:10:32 user nova-compute[75021]:     </interface>
Dec 06 07:10:32 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:10:32 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/a6c8e069-46ae-4069-b81e-364bad589ebf/console.log" append="off"/>
Dec 06 07:10:32 user nova-compute[75021]:     </serial>
Dec 06 07:10:32 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:10:32 user nova-compute[75021]:     <video>
Dec 06 07:10:32 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:10:32 user nova-compute[75021]:     </video>
Dec 06 07:10:32 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:10:32 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:10:32 user nova-compute[75021]:     </rng>
Dec 06 07:10:32 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:10:32 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:10:32 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:10:32 user nova-compute[75021]:     </memballoon>
Dec 06 07:10:32 user nova-compute[75021]:   </devices>
Dec 06 07:10:32 user nova-compute[75021]: </domain>
Dec 06 07:10:32 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07acf2eb-ace0-4ae1-b719-e179921b4283", "address": "fa:16:3e:19:ae:56", "network": {"id": "22ab25bd-67a1-4324-a7b4-8930fe53ac86", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-305871487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07acf2eb-ac", "ovs_interfaceid": "07acf2eb-ace0-4ae1-b719-e179921b4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "07acf2eb-ace0-4ae1-b719-e179921b4283", "address": "fa:16:3e:19:ae:56", "network": {"id": "22ab25bd-67a1-4324-a7b4-8930fe53ac86", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-305871487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07acf2eb-ac", "ovs_interfaceid": "07acf2eb-ace0-4ae1-b719-e179921b4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:ae:56,bridge_name='br-int',has_traffic_filtering=True,id=07acf2eb-ace0-4ae1-b719-e179921b4283,network=Network(22ab25bd-67a1-4324-a7b4-8930fe53ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07acf2eb-ac') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG os_vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:ae:56,bridge_name='br-int',has_traffic_filtering=True,id=07acf2eb-ace0-4ae1-b719-e179921b4283,network=Network(22ab25bd-67a1-4324-a7b4-8930fe53ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07acf2eb-ac') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8882dc8-1439-594d-bbcd-4056eb68653c', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07acf2eb-ac, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07acf2eb-ac, col_values=(('qos', UUID('f3d1fd95-5bfe-473d-b58c-a1e69b5f658a')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07acf2eb-ac, col_values=(('external_ids', {'iface-id': '07acf2eb-ace0-4ae1-b719-e179921b4283', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:ae:56', 'vm-uuid': 'a6c8e069-46ae-4069-b81e-364bad589ebf'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: INFO os_vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:ae:56,bridge_name='br-int',has_traffic_filtering=True,id=07acf2eb-ace0-4ae1-b719-e179921b4283,network=Network(22ab25bd-67a1-4324-a7b4-8930fe53ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07acf2eb-ac')
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "address": "fa:16:3e:f5:54:25", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2b8ff7-15", "ovs_interfaceid": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "address": "fa:16:3e:f5:54:25", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2b8ff7-15", "ovs_interfaceid": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:54:25,bridge_name='br-int',has_traffic_filtering=True,id=3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f2b8ff7-15') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG os_vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:54:25,bridge_name='br-int',has_traffic_filtering=True,id=3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f2b8ff7-15') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3631d42-b70a-504e-83c1-f3a2336b9a08', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f2b8ff7-15, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f2b8ff7-15, col_values=(('qos', UUID('3ab40b3a-35e1-4df5-a2e1-427fdb247bff')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f2b8ff7-15, col_values=(('external_ids', {'iface-id': '3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:54:25', 'vm-uuid': 'a6c8e069-46ae-4069-b81e-364bad589ebf'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'pci_requests' on Instance uuid e600e40b-0b08-4341-a48e-652da530e59c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'numa_topology' on Instance uuid e600e40b-0b08-4341-a48e-652da530e59c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: INFO os_vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:54:25,bridge_name='br-int',has_traffic_filtering=True,id=3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f2b8ff7-15')
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "address": "fa:16:3e:64:b5:e3", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5462413e-c2", "ovs_interfaceid": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "address": "fa:16:3e:64:b5:e3", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5462413e-c2", "ovs_interfaceid": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:b5:e3,bridge_name='br-int',has_traffic_filtering=True,id=5462413e-c273-42de-8ba8-1fde5c39c0a4,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5462413e-c2') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG os_vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:b5:e3,bridge_name='br-int',has_traffic_filtering=True,id=5462413e-c273-42de-8ba8-1fde5c39c0a4,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5462413e-c2') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ecf9327-001d-5ca8-9e08-7109d6fa03b9', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:10:32 user nova-compute[75021]: INFO nova.compute.claims [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Claim successful on node user
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5462413e-c2, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5462413e-c2, col_values=(('qos', UUID('0e889783-5500-46a1-94d2-698d741a5759')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5462413e-c2, col_values=(('external_ids', {'iface-id': '5462413e-c273-42de-8ba8-1fde5c39c0a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:b5:e3', 'vm-uuid': 'a6c8e069-46ae-4069-b81e-364bad589ebf'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: INFO os_vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:b5:e3,bridge_name='br-int',has_traffic_filtering=True,id=5462413e-c273-42de-8ba8-1fde5c39c0a4,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5462413e-c2')
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "address": "fa:16:3e:8e:dc:5b", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eaf5559-41", "ovs_interfaceid": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "address": "fa:16:3e:8e:dc:5b", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eaf5559-41", "ovs_interfaceid": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:dc:5b,bridge_name='br-int',has_traffic_filtering=True,id=3eaf5559-41b4-4e36-85dc-dcfcde324aa8,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eaf5559-41') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG os_vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:dc:5b,bridge_name='br-int',has_traffic_filtering=True,id=3eaf5559-41b4-4e36-85dc-dcfcde324aa8,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eaf5559-41') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8608eec-eb1b-5f32-b186-7a1109085581', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Refreshing inventories for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3eaf5559-41, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3eaf5559-41, col_values=(('qos', UUID('00ec3d0b-3f20-46b7-8226-897eaa616268')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3eaf5559-41, col_values=(('external_ids', {'iface-id': '3eaf5559-41b4-4e36-85dc-dcfcde324aa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:dc:5b', 'vm-uuid': 'a6c8e069-46ae-4069-b81e-364bad589ebf'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Updating ProviderTree inventory for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Updating inventory in ProviderTree for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: INFO os_vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:dc:5b,bridge_name='br-int',has_traffic_filtering=True,id=3eaf5559-41b4-4e36-85dc-dcfcde324aa8,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eaf5559-41')
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b61841a9-756e-4ad4-b803-017c7bd985de", "address": "fa:16:3e:28:9f:3d", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61841a9-75", "ovs_interfaceid": "b61841a9-756e-4ad4-b803-017c7bd985de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "b61841a9-756e-4ad4-b803-017c7bd985de", "address": "fa:16:3e:28:9f:3d", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61841a9-75", "ovs_interfaceid": "b61841a9-756e-4ad4-b803-017c7bd985de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:9f:3d,bridge_name='br-int',has_traffic_filtering=True,id=b61841a9-756e-4ad4-b803-017c7bd985de,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb61841a9-75') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG os_vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9f:3d,bridge_name='br-int',has_traffic_filtering=True,id=b61841a9-756e-4ad4-b803-017c7bd985de,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb61841a9-75') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd692ac6-3ca0-511d-975f-be5a813497ae', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Refreshing aggregate associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, aggregates: None {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb61841a9-75, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb61841a9-75, col_values=(('qos', UUID('48eecf76-5dd4-43a4-8a81-83be3c9f0c30')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb61841a9-75, col_values=(('external_ids', {'iface-id': 'b61841a9-756e-4ad4-b803-017c7bd985de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:9f:3d', 'vm-uuid': 'a6c8e069-46ae-4069-b81e-364bad589ebf'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Refreshing trait associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, traits: HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: INFO os_vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9f:3d,bridge_name='br-int',has_traffic_filtering=True,id=b61841a9-756e-4ad4-b803-017c7bd985de,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb61841a9-75')
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb1e15ad-aa13-4507-b83c-035a05d32268", "address": "fa:16:3e:c6:50:d5", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1e15ad-aa", "ovs_interfaceid": "cb1e15ad-aa13-4507-b83c-035a05d32268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "cb1e15ad-aa13-4507-b83c-035a05d32268", "address": "fa:16:3e:c6:50:d5", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1e15ad-aa", "ovs_interfaceid": "cb1e15ad-aa13-4507-b83c-035a05d32268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:50:d5,bridge_name='br-int',has_traffic_filtering=True,id=cb1e15ad-aa13-4507-b83c-035a05d32268,network=Network(ac205859-e685-4363-98db-558784812e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1e15ad-aa') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG os_vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:50:d5,bridge_name='br-int',has_traffic_filtering=True,id=cb1e15ad-aa13-4507-b83c-035a05d32268,network=Network(ac205859-e685-4363-98db-558784812e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1e15ad-aa') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5444422-a884-58dc-b7bc-b95baef5aa61', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb1e15ad-aa, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb1e15ad-aa, col_values=(('qos', UUID('a2c80037-2f53-4285-82bc-33a9cdb11238')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb1e15ad-aa, col_values=(('external_ids', {'iface-id': 'cb1e15ad-aa13-4507-b83c-035a05d32268', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:50:d5', 'vm-uuid': 'a6c8e069-46ae-4069-b81e-364bad589ebf'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:33 user nova-compute[75021]: INFO os_vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:50:d5,bridge_name='br-int',has_traffic_filtering=True,id=cb1e15ad-aa13-4507-b83c-035a05d32268,network=Network(ac205859-e685-4363-98db-558784812e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1e15ad-aa')
Dec 06 07:10:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fe07857-5428-4598-b751-b88ff51d7c18", "address": "fa:16:3e:2f:4c:a3", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe07857-54", "ovs_interfaceid": "0fe07857-5428-4598-b751-b88ff51d7c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "0fe07857-5428-4598-b751-b88ff51d7c18", "address": "fa:16:3e:2f:4c:a3", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe07857-54", "ovs_interfaceid": "0fe07857-5428-4598-b751-b88ff51d7c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=0fe07857-5428-4598-b751-b88ff51d7c18,network=Network(ac205859-e685-4363-98db-558784812e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe07857-54') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG os_vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=0fe07857-5428-4598-b751-b88ff51d7c18,network=Network(ac205859-e685-4363-98db-558784812e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe07857-54') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88c7cba4-9181-56bb-8c62-5ea1821f36ca', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fe07857-54, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fe07857-54, col_values=(('qos', UUID('61fc119c-f2e1-4bdb-9bfb-b45ce25d6f50')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fe07857-54, col_values=(('external_ids', {'iface-id': '0fe07857-5428-4598-b751-b88ff51d7c18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:4c:a3', 'vm-uuid': 'a6c8e069-46ae-4069-b81e-364bad589ebf'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:33 user nova-compute[75021]: INFO os_vif [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=0fe07857-5428-4598-b751-b88ff51d7c18,network=Network(ac205859-e685-4363-98db-558784812e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe07857-54')
Dec 06 07:10:33 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] No BDM found with device name hda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] No VIF found with MAC fa:16:3e:19:ae:56, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] No VIF found with MAC fa:16:3e:28:9f:3d, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:10:33 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Using config drive
Dec 06 07:10:33 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.793s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:33 user nova-compute[75021]: INFO nova.network.neutron [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Updating port d18bb07e-28df-49e3-b5b2-5e7cec5adee4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:33 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Creating config drive at /opt/stack/data/nova/instances/a6c8e069-46ae-4069-b81e-364bad589ebf/disk.config
Dec 06 07:10:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a6c8e069-46ae-4069-b81e-364bad589ebf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6maueby4 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a6c8e069-46ae-4069-b81e-364bad589ebf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6maueby4" returned: 0 in 0.098s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquired lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-062b6909-4e1b-45d5-b92f-0189adabdc90 req-19fff42a-0e30-432d-bba8-7b733350fcb6 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received event network-changed-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-062b6909-4e1b-45d5-b92f-0189adabdc90 req-19fff42a-0e30-432d-bba8-7b733350fcb6 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Refreshing instance network info cache due to event network-changed-d18bb07e-28df-49e3-b5b2-5e7cec5adee4. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-062b6909-4e1b-45d5-b92f-0189adabdc90 req-19fff42a-0e30-432d-bba8-7b733350fcb6 service nova] Acquiring lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Updating instance_info_cache with network_info: [{"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Releasing lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:10:34 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Creating image(s)
Dec 06 07:10:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "/opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "/opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "/opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'trusted_certs' on Instance uuid e600e40b-0b08-4341-a48e-652da530e59c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-062b6909-4e1b-45d5-b92f-0189adabdc90 req-19fff42a-0e30-432d-bba8-7b733350fcb6 service nova] Acquired lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-062b6909-4e1b-45d5-b92f-0189adabdc90 req-19fff42a-0e30-432d-bba8-7b733350fcb6 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Refreshing network info cache for port d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG nova.objects.base [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Object Instance<e600e40b-0b08-4341-a48e-652da530e59c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "060c3645ceb56f97ba508563abf4ce3f86defc7c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "060c3645ceb56f97ba508563abf4ce3f86defc7c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c.part --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-8dde00e0-a297-4c55-b5e4-dd54c2622788 req-b26386f6-c159-4904-b214-fe5efef6bedb service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-07acf2eb-ace0-4ae1-b719-e179921b4283 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8dde00e0-a297-4c55-b5e4-dd54c2622788 req-b26386f6-c159-4904-b214-fe5efef6bedb service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8dde00e0-a297-4c55-b5e4-dd54c2622788 req-b26386f6-c159-4904-b214-fe5efef6bedb service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8dde00e0-a297-4c55-b5e4-dd54c2622788 req-b26386f6-c159-4904-b214-fe5efef6bedb service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-8dde00e0-a297-4c55-b5e4-dd54c2622788 req-b26386f6-c159-4904-b214-fe5efef6bedb service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-07acf2eb-ace0-4ae1-b719-e179921b4283 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:36 user nova-compute[75021]: WARNING nova.compute.manager [req-8dde00e0-a297-4c55-b5e4-dd54c2622788 req-b26386f6-c159-4904-b214-fe5efef6bedb service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-07acf2eb-ace0-4ae1-b719-e179921b4283 for instance with vm_state building and task_state spawning.
Dec 06 07:10:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c.part --force-share --output=json" returned: 0 in 0.211s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG nova.virt.images [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] d5175154-2289-44af-9505-eb649c5c055c was qcow2, converting to raw {{(pid=75021) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c.part /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c.converted {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c.part /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c.converted" returned: 0 in 0.317s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c.converted --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG nova.network.neutron [req-062b6909-4e1b-45d5-b92f-0189adabdc90 req-19fff42a-0e30-432d-bba8-7b733350fcb6 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Updated VIF entry in instance network info cache for port d18bb07e-28df-49e3-b5b2-5e7cec5adee4. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG nova.network.neutron [req-062b6909-4e1b-45d5-b92f-0189adabdc90 req-19fff42a-0e30-432d-bba8-7b733350fcb6 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Updating instance_info_cache with network_info: [{"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-062b6909-4e1b-45d5-b92f-0189adabdc90 req-19fff42a-0e30-432d-bba8-7b733350fcb6 service nova] Releasing lock "refresh_cache-e600e40b-0b08-4341-a48e-652da530e59c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-e12e62ff-c032-4f95-bf47-42662ab9ef88 req-00108ae9-5127-465c-8c09-28d74089ed9a service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-5462413e-c273-42de-8ba8-1fde5c39c0a4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e12e62ff-c032-4f95-bf47-42662ab9ef88 req-00108ae9-5127-465c-8c09-28d74089ed9a service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e12e62ff-c032-4f95-bf47-42662ab9ef88 req-00108ae9-5127-465c-8c09-28d74089ed9a service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.019s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e12e62ff-c032-4f95-bf47-42662ab9ef88 req-00108ae9-5127-465c-8c09-28d74089ed9a service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-e12e62ff-c032-4f95-bf47-42662ab9ef88 req-00108ae9-5127-465c-8c09-28d74089ed9a service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-5462413e-c273-42de-8ba8-1fde5c39c0a4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:36 user nova-compute[75021]: WARNING nova.compute.manager [req-e12e62ff-c032-4f95-bf47-42662ab9ef88 req-00108ae9-5127-465c-8c09-28d74089ed9a service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-5462413e-c273-42de-8ba8-1fde5c39c0a4 for instance with vm_state building and task_state spawning.
Dec 06 07:10:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c.converted --force-share --output=json" returned: 0 in 0.287s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "060c3645ceb56f97ba508563abf4ce3f86defc7c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.223s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c --force-share --output=json" returned: 0 in 0.222s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "060c3645ceb56f97ba508563abf4ce3f86defc7c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "060c3645ceb56f97ba508563abf4ce3f86defc7c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c --force-share --output=json" returned: 0 in 0.248s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c,backing_fmt=raw /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c,backing_fmt=raw /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk 1073741824" returned: 0 in 0.115s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "060c3645ceb56f97ba508563abf4ce3f86defc7c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.367s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c --force-share --output=json" returned: 0 in 0.283s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'migration_context' on Instance uuid e600e40b-0b08-4341-a48e-652da530e59c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG nova.objects.base [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Object Instance<e600e40b-0b08-4341-a48e-652da530e59c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:10:37 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Rebasing disk image.
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-1c38dff9-8d5e-42f9-a3c3-4187886c1f22 req-741f5ac8-fcab-444e-b0b3-0ffc010364b8 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-cb1e15ad-aa13-4507-b83c-035a05d32268 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1c38dff9-8d5e-42f9-a3c3-4187886c1f22 req-741f5ac8-fcab-444e-b0b3-0ffc010364b8 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1c38dff9-8d5e-42f9-a3c3-4187886c1f22 req-741f5ac8-fcab-444e-b0b3-0ffc010364b8 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1c38dff9-8d5e-42f9-a3c3-4187886c1f22 req-741f5ac8-fcab-444e-b0b3-0ffc010364b8 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-1c38dff9-8d5e-42f9-a3c3-4187886c1f22 req-741f5ac8-fcab-444e-b0b3-0ffc010364b8 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-cb1e15ad-aa13-4507-b83c-035a05d32268 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:37 user nova-compute[75021]: WARNING nova.compute.manager [req-1c38dff9-8d5e-42f9-a3c3-4187886c1f22 req-741f5ac8-fcab-444e-b0b3-0ffc010364b8 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-cb1e15ad-aa13-4507-b83c-035a05d32268 for instance with vm_state building and task_state spawning.
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:37 user nova-compute[75021]: INFO nova.compute.manager [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Terminating instance
Dec 06 07:10:37 user nova-compute[75021]: DEBUG nova.compute.manager [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:10:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.278s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe -F raw /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-07acf2eb-ace0-4ae1-b719-e179921b4283 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-07acf2eb-ace0-4ae1-b719-e179921b4283 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:38 user nova-compute[75021]: WARNING nova.compute.manager [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-07acf2eb-ace0-4ae1-b719-e179921b4283 for instance with vm_state building and task_state spawning.
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:38 user nova-compute[75021]: WARNING nova.compute.manager [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190 for instance with vm_state building and task_state spawning.
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:38 user nova-compute[75021]: WARNING nova.compute.manager [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190 for instance with vm_state building and task_state spawning.
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-b61841a9-756e-4ad4-b803-017c7bd985de {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-b61841a9-756e-4ad4-b803-017c7bd985de {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:38 user nova-compute[75021]: WARNING nova.compute.manager [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-b61841a9-756e-4ad4-b803-017c7bd985de for instance with vm_state building and task_state spawning.
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-b61841a9-756e-4ad4-b803-017c7bd985de {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-b61841a9-756e-4ad4-b803-017c7bd985de {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:38 user nova-compute[75021]: WARNING nova.compute.manager [req-6fc1b7cc-ab9f-45a8-89f4-8552191eebe7 req-4e327e90-8398-435c-b3b7-5e1232990f65 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-b61841a9-756e-4ad4-b803-017c7bd985de for instance with vm_state building and task_state spawning.
Dec 06 07:10:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-5462413e-c273-42de-8ba8-1fde5c39c0a4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-5462413e-c273-42de-8ba8-1fde5c39c0a4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:38 user nova-compute[75021]: WARNING nova.compute.manager [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-5462413e-c273-42de-8ba8-1fde5c39c0a4 for instance with vm_state building and task_state spawning.
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-3eaf5559-41b4-4e36-85dc-dcfcde324aa8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-3eaf5559-41b4-4e36-85dc-dcfcde324aa8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:38 user nova-compute[75021]: WARNING nova.compute.manager [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-3eaf5559-41b4-4e36-85dc-dcfcde324aa8 for instance with vm_state building and task_state spawning.
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-3eaf5559-41b4-4e36-85dc-dcfcde324aa8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-3eaf5559-41b4-4e36-85dc-dcfcde324aa8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:38 user nova-compute[75021]: WARNING nova.compute.manager [req-13f69f85-282c-4071-8ae7-46a662ee9feb req-8e32fb85-bf1d-40a2-9356-9f504ac478be service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-3eaf5559-41b4-4e36-85dc-dcfcde324aa8 for instance with vm_state building and task_state spawning.
Dec 06 07:10:38 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Instance destroyed successfully.
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.objects.instance [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lazy-loading 'resources' on Instance uuid 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-53112281',display_name='tempest-TestMinimumBasicScenario-server-53112281',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-53112281',id=20,image_ref='53dd9568-7f3d-4c0f-a801-063320e5c6f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuSxZ13dd2/D7B877ZWXS1jgKRAmPhYOOiZJqhiReoBkb0kLSmdhOf4HykOJNldZ0vI0Uy/O1Rx4zDUeAdlHthJ4IX17YF8zgnD4tXiI5C/mOzfszeWX675LXbee/bjNA==',key_name='tempest-TestMinimumBasicScenario-1870415575',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:05:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78e36b4acada439db308e5e816dbf9a7',ramdisk_id='',reservation_id='r-59xfjdud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53dd9568-7f3d-4c0f-a801-063320e5c6f8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-757290889',owner_user_name='tempest-TestMinimumBasicScenario-757290889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:07:56Z,user_data=None,user_id='24f231f563c345b48a998200dbf1384a',uuid=42b43ca7-a0fb-4811-b91b-2ecce2b7fb02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converting VIF {"id": "c77514ad-438b-4d06-8f57-a363cde54e16", "address": "fa:16:3e:83:ee:82", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77514ad-43", "ovs_interfaceid": "c77514ad-438b-4d06-8f57-a363cde54e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:ee:82,bridge_name='br-int',has_traffic_filtering=True,id=c77514ad-438b-4d06-8f57-a363cde54e16,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77514ad-43') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG os_vif [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:ee:82,bridge_name='br-int',has_traffic_filtering=True,id=c77514ad-438b-4d06-8f57-a363cde54e16,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77514ad-43') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc77514ad-43, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf21f06d-7690-42b7-af8a-a7d3033c2d09) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:39 user nova-compute[75021]: INFO os_vif [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:ee:82,bridge_name='br-int',has_traffic_filtering=True,id=c77514ad-438b-4d06-8f57-a363cde54e16,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77514ad-43')
Dec 06 07:10:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Deleting instance files /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02_del
Dec 06 07:10:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Deletion of /opt/stack/data/nova/instances/42b43ca7-a0fb-4811-b91b-2ecce2b7fb02_del complete
Dec 06 07:10:39 user nova-compute[75021]: INFO nova.compute.manager [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Took 1.17 seconds to destroy the instance on the hypervisor.
Dec 06 07:10:39 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:10:39 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:10:39 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:10:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-cb1e15ad-aa13-4507-b83c-035a05d32268 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-cb1e15ad-aa13-4507-b83c-035a05d32268 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:40 user nova-compute[75021]: WARNING nova.compute.manager [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-cb1e15ad-aa13-4507-b83c-035a05d32268 for instance with vm_state building and task_state spawning.
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-0fe07857-5428-4598-b751-b88ff51d7c18 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-0fe07857-5428-4598-b751-b88ff51d7c18 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:40 user nova-compute[75021]: WARNING nova.compute.manager [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-0fe07857-5428-4598-b751-b88ff51d7c18 for instance with vm_state building and task_state spawning.
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-0fe07857-5428-4598-b751-b88ff51d7c18 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-0fe07857-5428-4598-b751-b88ff51d7c18 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:40 user nova-compute[75021]: WARNING nova.compute.manager [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-0fe07857-5428-4598-b751-b88ff51d7c18 for instance with vm_state building and task_state spawning.
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received event network-vif-unplugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] Acquiring lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] No waiting events found dispatching network-vif-unplugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received event network-vif-unplugged-c77514ad-438b-4d06-8f57-a363cde54e16 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received event network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] Acquiring lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] No waiting events found dispatching network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:40 user nova-compute[75021]: WARNING nova.compute.manager [req-f2b702b0-c3b1-439b-b246-d219bfbb0b7e req-a7457da6-ee38-495e-9ec4-c86629026ed3 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received unexpected event network-vif-plugged-c77514ad-438b-4d06-8f57-a363cde54e16 for instance with vm_state active and task_state deleting.
Dec 06 07:10:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:40 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Took 0.93 seconds to deallocate network for instance.
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.573s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:40 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Deleted allocations for instance 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:10:40 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Instance spawned successfully.
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe -F raw /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk" returned: 0 in 2.757s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Ensure instance console log exists: /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Start _get_guest_xml network_info=[{"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5e034fa241f0abc3b435380b880ebee3',container_format='bare',created_at=2023-12-06T07:08:39Z,direct_url=<?>,disk_format='qcow2',id=d5175154-2289-44af-9505-eb649c5c055c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1837730268-shelved',owner='d75ae216dcb345c79a5c2a4d38e51b38',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-06T07:08:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:10:40 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:10:40 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5e034fa241f0abc3b435380b880ebee3',container_format='bare',created_at=2023-12-06T07:08:39Z,direct_url=<?>,disk_format='qcow2',id=d5175154-2289-44af-9505-eb649c5c055c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1837730268-shelved',owner='d75ae216dcb345c79a5c2a4d38e51b38',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-06T07:08:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'vcpu_model' on Instance uuid e600e40b-0b08-4341-a48e-652da530e59c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-02091728-6fe8-4e55-9cdc-8318c74ae413 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "42b43ca7-a0fb-4811-b91b-2ecce2b7fb02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.956s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.objects.base [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Object Instance<e600e40b-0b08-4341-a48e-652da530e59c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T07:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1837730268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1837730268',id=22,image_ref='d5175154-2289-44af-9505-eb649c5c055c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1138365958',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:06:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d75ae216dcb345c79a5c2a4d38e51b38',ramdisk_id='',reservation_id='r-98ifjfwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1923852465',owner_user_name='tempest-AttachVolumeShelveTestJSON-1923852465-project-member',shelved_at='2023-12-06T07:08:43.842452',shelved_host='user',shelved_image_id='d5175154-2289-44af-9505-eb649c5c055c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:10:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4daf20c071c4b5cb826452811323abd',uuid=e600e40b-0b08-4341-a48e-652da530e59c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converting VIF {"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:13:29,bridge_name='br-int',has_traffic_filtering=True,id=d18bb07e-28df-49e3-b5b2-5e7cec5adee4,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bb07e-28') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'pci_devices' on Instance uuid e600e40b-0b08-4341-a48e-652da530e59c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:40 user nova-compute[75021]: INFO nova.compute.manager [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Took 12.80 seconds to spawn the instance on the hypervisor.
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.objects.base [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Object Instance<e600e40b-0b08-4341-a48e-652da530e59c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:10:40 user nova-compute[75021]:   <uuid>e600e40b-0b08-4341-a48e-652da530e59c</uuid>
Dec 06 07:10:40 user nova-compute[75021]:   <name>instance-00000016</name>
Dec 06 07:10:40 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:10:40 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:10:40 user nova-compute[75021]:   <metadata>
Dec 06 07:10:40 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:10:40 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:10:40 user nova-compute[75021]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1837730268</nova:name>
Dec 06 07:10:40 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:10:40</nova:creationTime>
Dec 06 07:10:40 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:10:40 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:10:40 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:10:40 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:10:40 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:10:40 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:10:40 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:10:40 user nova-compute[75021]:       <nova:owner>
Dec 06 07:10:40 user nova-compute[75021]:         <nova:user uuid="b4daf20c071c4b5cb826452811323abd">tempest-AttachVolumeShelveTestJSON-1923852465-project-member</nova:user>
Dec 06 07:10:40 user nova-compute[75021]:         <nova:project uuid="d75ae216dcb345c79a5c2a4d38e51b38">tempest-AttachVolumeShelveTestJSON-1923852465</nova:project>
Dec 06 07:10:40 user nova-compute[75021]:       </nova:owner>
Dec 06 07:10:40 user nova-compute[75021]:       <nova:root type="image" uuid="d5175154-2289-44af-9505-eb649c5c055c"/>
Dec 06 07:10:40 user nova-compute[75021]:       <nova:ports>
Dec 06 07:10:40 user nova-compute[75021]:         <nova:port uuid="d18bb07e-28df-49e3-b5b2-5e7cec5adee4">
Dec 06 07:10:40 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 07:10:40 user nova-compute[75021]:         </nova:port>
Dec 06 07:10:40 user nova-compute[75021]:       </nova:ports>
Dec 06 07:10:40 user nova-compute[75021]:     </nova:instance>
Dec 06 07:10:40 user nova-compute[75021]:   </metadata>
Dec 06 07:10:40 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:10:40 user nova-compute[75021]:     <system>
Dec 06 07:10:40 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:10:40 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:10:40 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:10:40 user nova-compute[75021]:       <entry name="serial">e600e40b-0b08-4341-a48e-652da530e59c</entry>
Dec 06 07:10:40 user nova-compute[75021]:       <entry name="uuid">e600e40b-0b08-4341-a48e-652da530e59c</entry>
Dec 06 07:10:40 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:10:40 user nova-compute[75021]:     </system>
Dec 06 07:10:40 user nova-compute[75021]:   </sysinfo>
Dec 06 07:10:40 user nova-compute[75021]:   <os>
Dec 06 07:10:40 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:10:40 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:10:40 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:10:40 user nova-compute[75021]:   </os>
Dec 06 07:10:40 user nova-compute[75021]:   <features>
Dec 06 07:10:40 user nova-compute[75021]:     <acpi/>
Dec 06 07:10:40 user nova-compute[75021]:     <apic/>
Dec 06 07:10:40 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:10:40 user nova-compute[75021]:   </features>
Dec 06 07:10:40 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:10:40 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:10:40 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:10:40 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:10:40 user nova-compute[75021]:   </clock>
Dec 06 07:10:40 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:10:40 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:10:40 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:10:40 user nova-compute[75021]:   </cpu>
Dec 06 07:10:40 user nova-compute[75021]:   <devices>
Dec 06 07:10:40 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:10:40 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:10:40 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk"/>
Dec 06 07:10:40 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:10:40 user nova-compute[75021]:     </disk>
Dec 06 07:10:40 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:10:40 user nova-compute[75021]:       <mac address="fa:16:3e:a4:13:29"/>
Dec 06 07:10:40 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:10:40 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:10:40 user nova-compute[75021]:       <target dev="tapd18bb07e-28"/>
Dec 06 07:10:40 user nova-compute[75021]:     </interface>
Dec 06 07:10:40 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:10:40 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/console.log" append="off"/>
Dec 06 07:10:40 user nova-compute[75021]:     </serial>
Dec 06 07:10:40 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:10:40 user nova-compute[75021]:     <video>
Dec 06 07:10:40 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:10:40 user nova-compute[75021]:     </video>
Dec 06 07:10:40 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:10:40 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:10:40 user nova-compute[75021]:     </rng>
Dec 06 07:10:40 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:10:40 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:10:40 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:10:40 user nova-compute[75021]:     </memballoon>
Dec 06 07:10:40 user nova-compute[75021]:   </devices>
Dec 06 07:10:40 user nova-compute[75021]: </domain>
Dec 06 07:10:40 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T07:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1837730268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1837730268',id=22,image_ref='d5175154-2289-44af-9505-eb649c5c055c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1138365958',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:06:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d75ae216dcb345c79a5c2a4d38e51b38',ramdisk_id='',reservation_id='r-98ifjfwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1923852465',owner_user_name='tempest-AttachVolumeShelveTestJSON-1923852465-project-member',shelved_at='2023-12-06T07:08:43.842452',shelved_host='user',shelved_image_id='d5175154-2289-44af-9505-eb649c5c055c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:10:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4daf20c071c4b5cb826452811323abd',uuid=e600e40b-0b08-4341-a48e-652da530e59c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converting VIF {"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:13:29,bridge_name='br-int',has_traffic_filtering=True,id=d18bb07e-28df-49e3-b5b2-5e7cec5adee4,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bb07e-28') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG os_vif [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:13:29,bridge_name='br-int',has_traffic_filtering=True,id=d18bb07e-28df-49e3-b5b2-5e7cec5adee4,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bb07e-28') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08374cc1-5c9c-5ac7-9213-092c0b62eb1d', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd18bb07e-28, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd18bb07e-28, col_values=(('qos', UUID('cb2bc307-214b-4e7d-89d5-0494143df5e0')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd18bb07e-28, col_values=(('external_ids', {'iface-id': 'd18bb07e-28df-49e3-b5b2-5e7cec5adee4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:13:29', 'vm-uuid': 'e600e40b-0b08-4341-a48e-652da530e59c'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:41 user nova-compute[75021]: INFO os_vif [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:13:29,bridge_name='br-int',has_traffic_filtering=True,id=d18bb07e-28df-49e3-b5b2-5e7cec5adee4,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bb07e-28')
Dec 06 07:10:41 user nova-compute[75021]: INFO nova.compute.manager [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Took 60.45 seconds to build instance.
Dec 06 07:10:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:10:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] No VIF found with MAC fa:16:3e:a4:13:29, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:10:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ef4ac0ef-6c37-4e61-a375-f2b0c2acb9d7 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 60.585s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:42 user nova-compute[75021]: DEBUG nova.compute.manager [req-f874d464-cfce-4e8c-a409-64317d8e8d5b req-c3b04ccf-c67f-4d61-9949-370a63843cc1 service nova] [instance: 42b43ca7-a0fb-4811-b91b-2ecce2b7fb02] Received event network-vif-deleted-c77514ad-438b-4d06-8f57-a363cde54e16 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-6482057d-3a90-47b0-8eaf-4fd82a6cad9f req-c82f70de-8723-4103-9b79-c1a53bd9ece9 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received event network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6482057d-3a90-47b0-8eaf-4fd82a6cad9f req-c82f70de-8723-4103-9b79-c1a53bd9ece9 service nova] Acquiring lock "e600e40b-0b08-4341-a48e-652da530e59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6482057d-3a90-47b0-8eaf-4fd82a6cad9f req-c82f70de-8723-4103-9b79-c1a53bd9ece9 service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6482057d-3a90-47b0-8eaf-4fd82a6cad9f req-c82f70de-8723-4103-9b79-c1a53bd9ece9 service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-6482057d-3a90-47b0-8eaf-4fd82a6cad9f req-c82f70de-8723-4103-9b79-c1a53bd9ece9 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] No waiting events found dispatching network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:44 user nova-compute[75021]: WARNING nova.compute.manager [req-6482057d-3a90-47b0-8eaf-4fd82a6cad9f req-c82f70de-8723-4103-9b79-c1a53bd9ece9 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received unexpected event network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 06 07:10:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-6482057d-3a90-47b0-8eaf-4fd82a6cad9f req-c82f70de-8723-4103-9b79-c1a53bd9ece9 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received event network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6482057d-3a90-47b0-8eaf-4fd82a6cad9f req-c82f70de-8723-4103-9b79-c1a53bd9ece9 service nova] Acquiring lock "e600e40b-0b08-4341-a48e-652da530e59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6482057d-3a90-47b0-8eaf-4fd82a6cad9f req-c82f70de-8723-4103-9b79-c1a53bd9ece9 service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6482057d-3a90-47b0-8eaf-4fd82a6cad9f req-c82f70de-8723-4103-9b79-c1a53bd9ece9 service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-6482057d-3a90-47b0-8eaf-4fd82a6cad9f req-c82f70de-8723-4103-9b79-c1a53bd9ece9 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] No waiting events found dispatching network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:44 user nova-compute[75021]: WARNING nova.compute.manager [req-6482057d-3a90-47b0-8eaf-4fd82a6cad9f req-c82f70de-8723-4103-9b79-c1a53bd9ece9 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received unexpected event network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 06 07:10:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:10:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:10:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Instance spawned successfully.
Dec 06 07:10:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:10:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e129a57c-6672-4dfb-b3b5-3af3bdd15313 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "e600e40b-0b08-4341-a48e-652da530e59c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.035s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:57 user nova-compute[75021]: INFO nova.compute.manager [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Terminating instance
Dec 06 07:10:57 user nova-compute[75021]: DEBUG nova.compute.manager [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-dd488f3e-69a6-4e54-9409-6fcf90cdae0e req-fc4fa660-f352-4c37-abdf-55cc715a66b1 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Received event network-vif-unplugged-7e699ac5-b079-428e-9728-ce1b30ed4feb {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dd488f3e-69a6-4e54-9409-6fcf90cdae0e req-fc4fa660-f352-4c37-abdf-55cc715a66b1 service nova] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dd488f3e-69a6-4e54-9409-6fcf90cdae0e req-fc4fa660-f352-4c37-abdf-55cc715a66b1 service nova] Lock "5c50a6a8-2500-4408-a932-48f0116713b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dd488f3e-69a6-4e54-9409-6fcf90cdae0e req-fc4fa660-f352-4c37-abdf-55cc715a66b1 service nova] Lock "5c50a6a8-2500-4408-a932-48f0116713b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-dd488f3e-69a6-4e54-9409-6fcf90cdae0e req-fc4fa660-f352-4c37-abdf-55cc715a66b1 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] No waiting events found dispatching network-vif-unplugged-7e699ac5-b079-428e-9728-ce1b30ed4feb {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-dd488f3e-69a6-4e54-9409-6fcf90cdae0e req-fc4fa660-f352-4c37-abdf-55cc715a66b1 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Received event network-vif-unplugged-7e699ac5-b079-428e-9728-ce1b30ed4feb for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:10:58 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Instance destroyed successfully.
Dec 06 07:10:58 user nova-compute[75021]: DEBUG nova.objects.instance [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lazy-loading 'resources' on Instance uuid 5c50a6a8-2500-4408-a932-48f0116713b8 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-425835316',display_name='tempest-SnapshotDataIntegrityTests-server-425835316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-425835316',id=15,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfii4FMkd/GlcN10MafXmbTff/4PzXa0nSqVQgaOB0SNTuzZUoJxz61fBVxzkybhlW83jCdOx1Ku64rZ2KdUbn2Pns4BMIGh5pYj+ntXHi5axVPiX+PR8h0EM5rwyOGFQ==',key_name='tempest-keypair-1607569311',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c08ce66a727943c7a4e1cf96225c9ff1',ramdisk_id='',reservation_id='r-69fzhje0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-750605823',owner_user_name='tempest-SnapshotDataIntegrityTests-750605823-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:03:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54cf3afd4b904266877afc19aca2d223',uuid=5c50a6a8-2500-4408-a932-48f0116713b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "address": "fa:16:3e:f3:41:7d", "network": {"id": "6838b696-43bf-4794-ae4c-82828037f5cf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1983647302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ce66a727943c7a4e1cf96225c9ff1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e699ac5-b0", "ovs_interfaceid": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Converting VIF {"id": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "address": "fa:16:3e:f3:41:7d", "network": {"id": "6838b696-43bf-4794-ae4c-82828037f5cf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1983647302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08ce66a727943c7a4e1cf96225c9ff1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e699ac5-b0", "ovs_interfaceid": "7e699ac5-b079-428e-9728-ce1b30ed4feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:41:7d,bridge_name='br-int',has_traffic_filtering=True,id=7e699ac5-b079-428e-9728-ce1b30ed4feb,network=Network(6838b696-43bf-4794-ae4c-82828037f5cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e699ac5-b0') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG os_vif [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:41:7d,bridge_name='br-int',has_traffic_filtering=True,id=7e699ac5-b079-428e-9728-ce1b30ed4feb,network=Network(6838b696-43bf-4794-ae4c-82828037f5cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e699ac5-b0') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e699ac5-b0, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=088e6912-55c2-4db0-911d-b17b8f26401e) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:10:58 user nova-compute[75021]: INFO os_vif [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:41:7d,bridge_name='br-int',has_traffic_filtering=True,id=7e699ac5-b079-428e-9728-ce1b30ed4feb,network=Network(6838b696-43bf-4794-ae4c-82828037f5cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e699ac5-b0')
Dec 06 07:10:58 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Deleting instance files /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8_del
Dec 06 07:10:58 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Deletion of /opt/stack/data/nova/instances/5c50a6a8-2500-4408-a932-48f0116713b8_del complete
Dec 06 07:10:58 user nova-compute[75021]: INFO nova.compute.manager [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Took 0.96 seconds to destroy the instance on the hypervisor.
Dec 06 07:10:58 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:10:58 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:10:59 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:10:59 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Took 1.06 seconds to deallocate network for instance.
Dec 06 07:10:59 user nova-compute[75021]: DEBUG nova.compute.manager [req-c1137d0c-cc06-47bb-9f9d-8fa211f3d48f req-ebb9a4a0-8f8a-4707-b2bb-cdb6280fcc3b service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Received event network-vif-deleted-7e699ac5-b079-428e-9728-ce1b30ed4feb {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-9d6c9b15-19c2-498d-95e9-385d5c296f5d req-e4c1b3e7-0cae-4e3a-b5d2-1c51af26b7a5 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Received event network-vif-plugged-7e699ac5-b079-428e-9728-ce1b30ed4feb {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9d6c9b15-19c2-498d-95e9-385d5c296f5d req-e4c1b3e7-0cae-4e3a-b5d2-1c51af26b7a5 service nova] Acquiring lock "5c50a6a8-2500-4408-a932-48f0116713b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9d6c9b15-19c2-498d-95e9-385d5c296f5d req-e4c1b3e7-0cae-4e3a-b5d2-1c51af26b7a5 service nova] Lock "5c50a6a8-2500-4408-a932-48f0116713b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9d6c9b15-19c2-498d-95e9-385d5c296f5d req-e4c1b3e7-0cae-4e3a-b5d2-1c51af26b7a5 service nova] Lock "5c50a6a8-2500-4408-a932-48f0116713b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-9d6c9b15-19c2-498d-95e9-385d5c296f5d req-e4c1b3e7-0cae-4e3a-b5d2-1c51af26b7a5 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] No waiting events found dispatching network-vif-plugged-7e699ac5-b079-428e-9728-ce1b30ed4feb {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:11:00 user nova-compute[75021]: WARNING nova.compute.manager [req-9d6c9b15-19c2-498d-95e9-385d5c296f5d req-e4c1b3e7-0cae-4e3a-b5d2-1c51af26b7a5 service nova] [instance: 5c50a6a8-2500-4408-a932-48f0116713b8] Received unexpected event network-vif-plugged-7e699ac5-b079-428e-9728-ce1b30ed4feb for instance with vm_state deleted and task_state None.
Dec 06 07:11:00 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:11:00 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:11:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.480s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-45d9cbac-43b8-42db-9fa7-9e5b8e0573e3 req-1046dc66-96e9-49c2-a0ab-a3693633985d service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Received event network-changed-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-45d9cbac-43b8-42db-9fa7-9e5b8e0573e3 req-1046dc66-96e9-49c2-a0ab-a3693633985d service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Refreshing instance network info cache due to event network-changed-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:11:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-45d9cbac-43b8-42db-9fa7-9e5b8e0573e3 req-1046dc66-96e9-49c2-a0ab-a3693633985d service nova] Acquiring lock "refresh_cache-65e7540f-3e73-4d4c-8b8f-2a53dac610a0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:11:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-45d9cbac-43b8-42db-9fa7-9e5b8e0573e3 req-1046dc66-96e9-49c2-a0ab-a3693633985d service nova] Acquired lock "refresh_cache-65e7540f-3e73-4d4c-8b8f-2a53dac610a0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:11:00 user nova-compute[75021]: DEBUG nova.network.neutron [req-45d9cbac-43b8-42db-9fa7-9e5b8e0573e3 req-1046dc66-96e9-49c2-a0ab-a3693633985d service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Refreshing network info cache for port 177516ce-7e6c-4c3c-b2bf-d1c538d10f7e {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:11:00 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Deleted allocations for instance 5c50a6a8-2500-4408-a932-48f0116713b8
Dec 06 07:11:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1d540d25-bd73-4eb3-bcdc-667952e43395 tempest-SnapshotDataIntegrityTests-750605823 tempest-SnapshotDataIntegrityTests-750605823-project-member] Lock "5c50a6a8-2500-4408-a932-48f0116713b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.729s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:01 user nova-compute[75021]: DEBUG nova.network.neutron [req-45d9cbac-43b8-42db-9fa7-9e5b8e0573e3 req-1046dc66-96e9-49c2-a0ab-a3693633985d service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Updated VIF entry in instance network info cache for port 177516ce-7e6c-4c3c-b2bf-d1c538d10f7e. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:11:01 user nova-compute[75021]: DEBUG nova.network.neutron [req-45d9cbac-43b8-42db-9fa7-9e5b8e0573e3 req-1046dc66-96e9-49c2-a0ab-a3693633985d service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Updating instance_info_cache with network_info: [{"id": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "address": "fa:16:3e:6d:44:f6", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177516ce-7e", "ovs_interfaceid": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:11:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-45d9cbac-43b8-42db-9fa7-9e5b8e0573e3 req-1046dc66-96e9-49c2-a0ab-a3693633985d service nova] Releasing lock "refresh_cache-65e7540f-3e73-4d4c-8b8f-2a53dac610a0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:11:01 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:11:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:01 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:11:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:11:01 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG nova.objects.instance [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'flavor' on Instance uuid 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.134s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:03 user nova-compute[75021]: INFO nova.compute.manager [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Attaching volume 0a42734f-602c-419a-9043-d77143aec27a to /dev/vdb
Dec 06 07:11:03 user nova-compute[75021]: DEBUG os_brick.utils [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3828ace-9569-42c6-81fd-d2d2b326846e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cdedff-987c-4acd-af9a-93374d374d43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.039s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c845bf8-2867-4cdb-99e8-7d99af4e77c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd49c4f-d941-4740-9b52-6d5531591ed9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:11:03 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:11:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7c0160-25d3-464c-83d3-89e4ae6847db]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG os_brick.utils [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:11:03 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Updating existing volume attachment record: 0127663b-8404-4372-a571-4709b096eec3 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:11:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:11:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:11:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:11:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:11:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:11:06 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:11:06 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:11:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7116MB free_disk=25.177757263183594GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:11:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 8b8eb320-6348-4038-a57e-02bf1e015174 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a6c8e069-46ae-4069-b81e-364bad589ebf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 35da578f-dc7b-4038-869e-3d7528844bf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance e600e40b-0b08-4341-a48e-652da530e59c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:11:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.614s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:09 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:11:09 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:11:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-b9372825-c75d-45a3-a48c-e111869d97a5" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:11:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-b9372825-c75d-45a3-a48c-e111869d97a5" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:11:09 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:11:10 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Updating instance_info_cache with network_info: [{"id": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "address": "fa:16:3e:fb:4a:05", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c8a95e-1a", "ovs_interfaceid": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:11:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-b9372825-c75d-45a3-a48c-e111869d97a5" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:11:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:11:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:11:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:11:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:11:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:11:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:11:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:11:10 user nova-compute[75021]: INFO nova.compute.manager [None req-8f2104de-64f8-4de6-bfa7-9cdee5b441a7 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Unrescuing
Dec 06 07:11:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8f2104de-64f8-4de6-bfa7-9cdee5b441a7 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:11:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8f2104de-64f8-4de6-bfa7-9cdee5b441a7 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquired lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:11:10 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8f2104de-64f8-4de6-bfa7-9cdee5b441a7 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:11:11 user nova-compute[75021]: DEBUG nova.network.neutron [None req-8f2104de-64f8-4de6-bfa7-9cdee5b441a7 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Updating instance_info_cache with network_info: [{"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:11:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8f2104de-64f8-4de6-bfa7-9cdee5b441a7 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Releasing lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:11:11 user nova-compute[75021]: DEBUG nova.objects.instance [None req-8f2104de-64f8-4de6-bfa7-9cdee5b441a7 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'flavor' on Instance uuid 828f5456-6310-4664-87b3-ee0ed6787d3f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:11:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-a15db9eb-2450-406f-87f4-28ccce0d6549 req-03c6cf04-ba49-4b91-9c04-2ee9e8efee67 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received event network-vif-unplugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a15db9eb-2450-406f-87f4-28ccce0d6549 req-03c6cf04-ba49-4b91-9c04-2ee9e8efee67 service nova] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a15db9eb-2450-406f-87f4-28ccce0d6549 req-03c6cf04-ba49-4b91-9c04-2ee9e8efee67 service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a15db9eb-2450-406f-87f4-28ccce0d6549 req-03c6cf04-ba49-4b91-9c04-2ee9e8efee67 service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-a15db9eb-2450-406f-87f4-28ccce0d6549 req-03c6cf04-ba49-4b91-9c04-2ee9e8efee67 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] No waiting events found dispatching network-vif-unplugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:11:11 user nova-compute[75021]: WARNING nova.compute.manager [req-a15db9eb-2450-406f-87f4-28ccce0d6549 req-03c6cf04-ba49-4b91-9c04-2ee9e8efee67 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received unexpected event network-vif-unplugged-a3831721-6988-44ee-89a6-35d80066e41b for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:11:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:11 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Instance destroyed successfully.
Dec 06 07:11:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-f760e7f1-0c52-4014-9c42-999900219d10 req-f42b6b4f-9aea-4bde-8d8d-348b50417e49 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f760e7f1-0c52-4014-9c42-999900219d10 req-f42b6b4f-9aea-4bde-8d8d-348b50417e49 service nova] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f760e7f1-0c52-4014-9c42-999900219d10 req-f42b6b4f-9aea-4bde-8d8d-348b50417e49 service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f760e7f1-0c52-4014-9c42-999900219d10 req-f42b6b4f-9aea-4bde-8d8d-348b50417e49 service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-f760e7f1-0c52-4014-9c42-999900219d10 req-f42b6b4f-9aea-4bde-8d8d-348b50417e49 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] No waiting events found dispatching network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:11:13 user nova-compute[75021]: WARNING nova.compute.manager [req-f760e7f1-0c52-4014-9c42-999900219d10 req-f42b6b4f-9aea-4bde-8d8d-348b50417e49 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received unexpected event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:11:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-f760e7f1-0c52-4014-9c42-999900219d10 req-f42b6b4f-9aea-4bde-8d8d-348b50417e49 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f760e7f1-0c52-4014-9c42-999900219d10 req-f42b6b4f-9aea-4bde-8d8d-348b50417e49 service nova] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f760e7f1-0c52-4014-9c42-999900219d10 req-f42b6b4f-9aea-4bde-8d8d-348b50417e49 service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f760e7f1-0c52-4014-9c42-999900219d10 req-f42b6b4f-9aea-4bde-8d8d-348b50417e49 service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-f760e7f1-0c52-4014-9c42-999900219d10 req-f42b6b4f-9aea-4bde-8d8d-348b50417e49 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] No waiting events found dispatching network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:11:13 user nova-compute[75021]: WARNING nova.compute.manager [req-f760e7f1-0c52-4014-9c42-999900219d10 req-f42b6b4f-9aea-4bde-8d8d-348b50417e49 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received unexpected event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:11:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PadKuxpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:11:14 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:11:14 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:11:14 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bb2964-745e-42df-a0f7-378d9617d600]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:11:14 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a00beb-c6f1-4118-8d3e-fa18f799f6c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a] added
Dec 06 07:11:14 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cfad71-785a-4e68-bfa5-d05ea3f258c8]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7629745-a85a-48ae-a429-af5e84ab7b6e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PadKuxpT {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PadKuxpT" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c21ab96-fb26-43f1-9b8c-981bb4bf7be5]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PadKuxpT'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[166297ae-4633-4f92-bd89-ad1437dac892]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0beca2-7a0d-418e-9047-c5fe666c36da]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e6b720-d787-433a-beb1-5f75efd4e6fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a, portal: 172.16.0.220,3260]
Dec 06 07:11:14 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a, portal: 172.16.0.220,3260] successful.
Dec 06 07:11:14 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5903b9f-dfc7-447a-b695-066c4d89017f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[da176e9d-5567-48ad-8030-2da1f0fd13c9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:11:14 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:11:14 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:11:14 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] HCTL ('39', '-', '-', 0) found on session 37 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[05016665-6ae7-4c8f-a933-624ae30667c7]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Searching for a device in session 37 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:11:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PadKuxpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:11:15 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8f2104de-64f8-4de6-bfa7-9cdee5b441a7 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:11:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-4d2ec0af-4383-46c4-be2e-8b48ba370f79 req-58460c24-1fee-4edb-b785-a83df3e9042e service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4d2ec0af-4383-46c4-be2e-8b48ba370f79 req-58460c24-1fee-4edb-b785-a83df3e9042e service nova] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4d2ec0af-4383-46c4-be2e-8b48ba370f79 req-58460c24-1fee-4edb-b785-a83df3e9042e service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4d2ec0af-4383-46c4-be2e-8b48ba370f79 req-58460c24-1fee-4edb-b785-a83df3e9042e service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-4d2ec0af-4383-46c4-be2e-8b48ba370f79 req-58460c24-1fee-4edb-b785-a83df3e9042e service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] No waiting events found dispatching network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:11:15 user nova-compute[75021]: WARNING nova.compute.manager [req-4d2ec0af-4383-46c4-be2e-8b48ba370f79 req-58460c24-1fee-4edb-b785-a83df3e9042e service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received unexpected event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:11:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:11:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26630383331633462', 'path': '/dev/sdh'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:11:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630383331633462', 'path': '/dev/sdh'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:11:15 user nova-compute[75021]: DEBUG nova.objects.instance [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'flavor' on Instance uuid 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:11:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:11:15 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:11:15 user nova-compute[75021]:   <source dev="/dev/sdh"/>
Dec 06 07:11:15 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:11:15 user nova-compute[75021]:   <serial>0a42734f-602c-419a-9043-d77143aec27a</serial>
Dec 06 07:11:15 user nova-compute[75021]: </disk>
Dec 06 07:11:15 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:11:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:11:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:11:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No VIF found with MAC fa:16:3e:6d:44:f6, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:11:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6b7a2067-7392-498b-91e0-649f8d902899 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.641s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:11:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:19 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:11:19 user nova-compute[75021]: INFO nova.compute.claims [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Claim successful on node user
Dec 06 07:11:20 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.606s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG nova.compute.manager [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG nova.compute.manager [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG nova.network.neutron [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:11:20 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:11:20 user nova-compute[75021]: DEBUG nova.compute.manager [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG nova.policy [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5e1155d2c304bdd8404712faf046b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae65045cef754813bd33f68b9868dc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG nova.compute.manager [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:11:20 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Creating image(s)
Dec 06 07:11:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "/opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "/opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.185s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.234s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk 1073741824" returned: 0 in 0.056s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.237s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG nova.network.neutron [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Successfully created port: 3896309e-3f41-410d-810f-7d794d93e155 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Cannot resize image /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Ensure instance console log exists: /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG nova.network.neutron [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Successfully updated port: 3896309e-3f41-410d-810f-7d794d93e155 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "refresh_cache-0f5cb530-4025-4b9f-988e-c2877a61c9a4" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquired lock "refresh_cache-0f5cb530-4025-4b9f-988e-c2877a61c9a4" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG nova.network.neutron [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-65feffea-34fe-4ce4-b18e-b103c9616e12 req-3fb3d7a9-faaf-4223-8da2-bcb5554073ae service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Received event network-changed-3896309e-3f41-410d-810f-7d794d93e155 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-65feffea-34fe-4ce4-b18e-b103c9616e12 req-3fb3d7a9-faaf-4223-8da2-bcb5554073ae service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Refreshing instance network info cache due to event network-changed-3896309e-3f41-410d-810f-7d794d93e155. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-65feffea-34fe-4ce4-b18e-b103c9616e12 req-3fb3d7a9-faaf-4223-8da2-bcb5554073ae service nova] Acquiring lock "refresh_cache-0f5cb530-4025-4b9f-988e-c2877a61c9a4" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:11:21 user nova-compute[75021]: DEBUG nova.network.neutron [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.network.neutron [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Updating instance_info_cache with network_info: [{"id": "3896309e-3f41-410d-810f-7d794d93e155", "address": "fa:16:3e:e4:37:62", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3896309e-3f", "ovs_interfaceid": "3896309e-3f41-410d-810f-7d794d93e155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Releasing lock "refresh_cache-0f5cb530-4025-4b9f-988e-c2877a61c9a4" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Instance network_info: |[{"id": "3896309e-3f41-410d-810f-7d794d93e155", "address": "fa:16:3e:e4:37:62", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3896309e-3f", "ovs_interfaceid": "3896309e-3f41-410d-810f-7d794d93e155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-65feffea-34fe-4ce4-b18e-b103c9616e12 req-3fb3d7a9-faaf-4223-8da2-bcb5554073ae service nova] Acquired lock "refresh_cache-0f5cb530-4025-4b9f-988e-c2877a61c9a4" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.network.neutron [req-65feffea-34fe-4ce4-b18e-b103c9616e12 req-3fb3d7a9-faaf-4223-8da2-bcb5554073ae service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Refreshing network info cache for port 3896309e-3f41-410d-810f-7d794d93e155 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Start _get_guest_xml network_info=[{"id": "3896309e-3f41-410d-810f-7d794d93e155", "address": "fa:16:3e:e4:37:62", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3896309e-3f", "ovs_interfaceid": "3896309e-3f41-410d-810f-7d794d93e155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:11:22 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:11:22 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-646419153',display_name='tempest-AttachVolumeNegativeTest-server-646419153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-646419153',id=29,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO92eqPUrpRZilu6CKbyGRwaK7yCgNVnydlTKlwm7btQqJRBMBnWqIRRyBCAn54SG6imwVuHLkQrCFGZ9XYBk/4e5mfggQrdyQrySaWf22yGrp8JmLlDMoGXO8nh85PaPA==',key_name='tempest-keypair-471519478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae65045cef754813bd33f68b9868dc9d',ramdisk_id='',reservation_id='r-q7kw38y8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-967416759',owner_user_name='tempest-AttachVolumeNegativeTest-967416759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e1155d2c304bdd8404712faf046b05',uuid=0f5cb530-4025-4b9f-988e-c2877a61c9a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3896309e-3f41-410d-810f-7d794d93e155", "address": "fa:16:3e:e4:37:62", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3896309e-3f", "ovs_interfaceid": "3896309e-3f41-410d-810f-7d794d93e155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converting VIF {"id": "3896309e-3f41-410d-810f-7d794d93e155", "address": "fa:16:3e:e4:37:62", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3896309e-3f", "ovs_interfaceid": "3896309e-3f41-410d-810f-7d794d93e155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:37:62,bridge_name='br-int',has_traffic_filtering=True,id=3896309e-3f41-410d-810f-7d794d93e155,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3896309e-3f') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.objects.instance [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f5cb530-4025-4b9f-988e-c2877a61c9a4 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:11:22 user nova-compute[75021]:   <uuid>0f5cb530-4025-4b9f-988e-c2877a61c9a4</uuid>
Dec 06 07:11:22 user nova-compute[75021]:   <name>instance-0000001d</name>
Dec 06 07:11:22 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:11:22 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:11:22 user nova-compute[75021]:   <metadata>
Dec 06 07:11:22 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:11:22 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:11:22 user nova-compute[75021]:       <nova:name>tempest-AttachVolumeNegativeTest-server-646419153</nova:name>
Dec 06 07:11:22 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:11:22</nova:creationTime>
Dec 06 07:11:22 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:11:22 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:11:22 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:11:22 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:11:22 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:11:22 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:11:22 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:11:22 user nova-compute[75021]:       <nova:owner>
Dec 06 07:11:22 user nova-compute[75021]:         <nova:user uuid="c5e1155d2c304bdd8404712faf046b05">tempest-AttachVolumeNegativeTest-967416759-project-member</nova:user>
Dec 06 07:11:22 user nova-compute[75021]:         <nova:project uuid="ae65045cef754813bd33f68b9868dc9d">tempest-AttachVolumeNegativeTest-967416759</nova:project>
Dec 06 07:11:22 user nova-compute[75021]:       </nova:owner>
Dec 06 07:11:22 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:11:22 user nova-compute[75021]:       <nova:ports>
Dec 06 07:11:22 user nova-compute[75021]:         <nova:port uuid="3896309e-3f41-410d-810f-7d794d93e155">
Dec 06 07:11:22 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 06 07:11:22 user nova-compute[75021]:         </nova:port>
Dec 06 07:11:22 user nova-compute[75021]:       </nova:ports>
Dec 06 07:11:22 user nova-compute[75021]:     </nova:instance>
Dec 06 07:11:22 user nova-compute[75021]:   </metadata>
Dec 06 07:11:22 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:11:22 user nova-compute[75021]:     <system>
Dec 06 07:11:22 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:11:22 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:11:22 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:11:22 user nova-compute[75021]:       <entry name="serial">0f5cb530-4025-4b9f-988e-c2877a61c9a4</entry>
Dec 06 07:11:22 user nova-compute[75021]:       <entry name="uuid">0f5cb530-4025-4b9f-988e-c2877a61c9a4</entry>
Dec 06 07:11:22 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:11:22 user nova-compute[75021]:     </system>
Dec 06 07:11:22 user nova-compute[75021]:   </sysinfo>
Dec 06 07:11:22 user nova-compute[75021]:   <os>
Dec 06 07:11:22 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:11:22 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:11:22 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:11:22 user nova-compute[75021]:   </os>
Dec 06 07:11:22 user nova-compute[75021]:   <features>
Dec 06 07:11:22 user nova-compute[75021]:     <acpi/>
Dec 06 07:11:22 user nova-compute[75021]:     <apic/>
Dec 06 07:11:22 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:11:22 user nova-compute[75021]:   </features>
Dec 06 07:11:22 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:11:22 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:11:22 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:11:22 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:11:22 user nova-compute[75021]:   </clock>
Dec 06 07:11:22 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:11:22 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:11:22 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:11:22 user nova-compute[75021]:   </cpu>
Dec 06 07:11:22 user nova-compute[75021]:   <devices>
Dec 06 07:11:22 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:11:22 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:11:22 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk"/>
Dec 06 07:11:22 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:11:22 user nova-compute[75021]:     </disk>
Dec 06 07:11:22 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:11:22 user nova-compute[75021]:       <mac address="fa:16:3e:e4:37:62"/>
Dec 06 07:11:22 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:11:22 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:11:22 user nova-compute[75021]:       <target dev="tap3896309e-3f"/>
Dec 06 07:11:22 user nova-compute[75021]:     </interface>
Dec 06 07:11:22 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:11:22 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/console.log" append="off"/>
Dec 06 07:11:22 user nova-compute[75021]:     </serial>
Dec 06 07:11:22 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:11:22 user nova-compute[75021]:     <video>
Dec 06 07:11:22 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:11:22 user nova-compute[75021]:     </video>
Dec 06 07:11:22 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:11:22 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:11:22 user nova-compute[75021]:     </rng>
Dec 06 07:11:22 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:11:22 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:11:22 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:11:22 user nova-compute[75021]:     </memballoon>
Dec 06 07:11:22 user nova-compute[75021]:   </devices>
Dec 06 07:11:22 user nova-compute[75021]: </domain>
Dec 06 07:11:22 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-646419153',display_name='tempest-AttachVolumeNegativeTest-server-646419153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-646419153',id=29,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO92eqPUrpRZilu6CKbyGRwaK7yCgNVnydlTKlwm7btQqJRBMBnWqIRRyBCAn54SG6imwVuHLkQrCFGZ9XYBk/4e5mfggQrdyQrySaWf22yGrp8JmLlDMoGXO8nh85PaPA==',key_name='tempest-keypair-471519478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae65045cef754813bd33f68b9868dc9d',ramdisk_id='',reservation_id='r-q7kw38y8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-967416759',owner_user_name='tempest-AttachVolumeNegativeTest-967416759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e1155d2c304bdd8404712faf046b05',uuid=0f5cb530-4025-4b9f-988e-c2877a61c9a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3896309e-3f41-410d-810f-7d794d93e155", "address": "fa:16:3e:e4:37:62", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3896309e-3f", "ovs_interfaceid": "3896309e-3f41-410d-810f-7d794d93e155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converting VIF {"id": "3896309e-3f41-410d-810f-7d794d93e155", "address": "fa:16:3e:e4:37:62", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3896309e-3f", "ovs_interfaceid": "3896309e-3f41-410d-810f-7d794d93e155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:37:62,bridge_name='br-int',has_traffic_filtering=True,id=3896309e-3f41-410d-810f-7d794d93e155,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3896309e-3f') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG os_vif [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:37:62,bridge_name='br-int',has_traffic_filtering=True,id=3896309e-3f41-410d-810f-7d794d93e155,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3896309e-3f') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2f7a84c-2134-5ef0-baf4-cb2022941c5c', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3896309e-3f, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3896309e-3f, col_values=(('qos', UUID('53c1b0b2-44d7-4e6c-8056-1514a47857ad')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3896309e-3f, col_values=(('external_ids', {'iface-id': '3896309e-3f41-410d-810f-7d794d93e155', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:37:62', 'vm-uuid': '0f5cb530-4025-4b9f-988e-c2877a61c9a4'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:22 user nova-compute[75021]: INFO os_vif [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:37:62,bridge_name='br-int',has_traffic_filtering=True,id=3896309e-3f41-410d-810f-7d794d93e155,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3896309e-3f')
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No VIF found with MAC fa:16:3e:e4:37:62, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:22 user nova-compute[75021]: INFO nova.compute.manager [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Terminating instance
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.network.neutron [req-65feffea-34fe-4ce4-b18e-b103c9616e12 req-3fb3d7a9-faaf-4223-8da2-bcb5554073ae service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Updated VIF entry in instance network info cache for port 3896309e-3f41-410d-810f-7d794d93e155. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG nova.network.neutron [req-65feffea-34fe-4ce4-b18e-b103c9616e12 req-3fb3d7a9-faaf-4223-8da2-bcb5554073ae service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Updating instance_info_cache with network_info: [{"id": "3896309e-3f41-410d-810f-7d794d93e155", "address": "fa:16:3e:e4:37:62", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3896309e-3f", "ovs_interfaceid": "3896309e-3f41-410d-810f-7d794d93e155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-65feffea-34fe-4ce4-b18e-b103c9616e12 req-3fb3d7a9-faaf-4223-8da2-bcb5554073ae service nova] Releasing lock "refresh_cache-0f5cb530-4025-4b9f-988e-c2877a61c9a4" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:11:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-8c96550b-cc4f-4ef3-9488-7cbed0d09b1d req-7f8dfee6-ca47-4001-9a26-765c34c7d019 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Received event network-vif-unplugged-f48add70-d28e-43ed-8bc8-cdb69f2b3cee {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8c96550b-cc4f-4ef3-9488-7cbed0d09b1d req-7f8dfee6-ca47-4001-9a26-765c34c7d019 service nova] Acquiring lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8c96550b-cc4f-4ef3-9488-7cbed0d09b1d req-7f8dfee6-ca47-4001-9a26-765c34c7d019 service nova] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8c96550b-cc4f-4ef3-9488-7cbed0d09b1d req-7f8dfee6-ca47-4001-9a26-765c34c7d019 service nova] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-8c96550b-cc4f-4ef3-9488-7cbed0d09b1d req-7f8dfee6-ca47-4001-9a26-765c34c7d019 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] No waiting events found dispatching network-vif-unplugged-f48add70-d28e-43ed-8bc8-cdb69f2b3cee {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-8c96550b-cc4f-4ef3-9488-7cbed0d09b1d req-7f8dfee6-ca47-4001-9a26-765c34c7d019 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Received event network-vif-unplugged-f48add70-d28e-43ed-8bc8-cdb69f2b3cee for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:11:23 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Instance destroyed successfully.
Dec 06 07:11:23 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lazy-loading 'resources' on Instance uuid 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1597141069',display_name='tempest-ServersNegativeTestJSON-server-1597141069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1597141069',id=13,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:02:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70aa47164bdf43a78448ce550774cc70',ramdisk_id='',reservation_id='r-n6mzvwwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1406242964',owner_user_name='tempest-ServersNegativeTestJSON-1406242964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:02:38Z,user_data=None,user_id='bec5e110057b47ac89c85ca77aaa56ec',uuid=7d58e89e-b41f-4eb8-9e92-02e0d017d3fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "address": "fa:16:3e:af:d4:e8", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48add70-d2", "ovs_interfaceid": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Converting VIF {"id": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "address": "fa:16:3e:af:d4:e8", "network": {"id": "ab7aa0ea-4c08-4d4a-b74c-c47298834061", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-683462713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aa47164bdf43a78448ce550774cc70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf48add70-d2", "ovs_interfaceid": "f48add70-d28e-43ed-8bc8-cdb69f2b3cee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:d4:e8,bridge_name='br-int',has_traffic_filtering=True,id=f48add70-d28e-43ed-8bc8-cdb69f2b3cee,network=Network(ab7aa0ea-4c08-4d4a-b74c-c47298834061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48add70-d2') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG os_vif [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:d4:e8,bridge_name='br-int',has_traffic_filtering=True,id=f48add70-d28e-43ed-8bc8-cdb69f2b3cee,network=Network(ab7aa0ea-4c08-4d4a-b74c-c47298834061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48add70-d2') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf48add70-d2, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0b29615-fb8c-405a-948e-695ee424a8ab) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:11:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:23 user nova-compute[75021]: INFO os_vif [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:d4:e8,bridge_name='br-int',has_traffic_filtering=True,id=f48add70-d28e-43ed-8bc8-cdb69f2b3cee,network=Network(ab7aa0ea-4c08-4d4a-b74c-c47298834061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf48add70-d2')
Dec 06 07:11:23 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Deleting instance files /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc_del
Dec 06 07:11:23 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Deletion of /opt/stack/data/nova/instances/7d58e89e-b41f-4eb8-9e92-02e0d017d3fc_del complete
Dec 06 07:11:24 user nova-compute[75021]: INFO nova.compute.manager [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Took 1.33 seconds to destroy the instance on the hypervisor.
Dec 06 07:11:24 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:11:24 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:11:24 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:11:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-550a1d1b-81d8-44f1-82cb-b8a16a1ca81c req-7482dc1a-cf5c-4ba2-8dd7-498025c306f1 service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Received event network-vif-plugged-3896309e-3f41-410d-810f-7d794d93e155 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-550a1d1b-81d8-44f1-82cb-b8a16a1ca81c req-7482dc1a-cf5c-4ba2-8dd7-498025c306f1 service nova] Acquiring lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-550a1d1b-81d8-44f1-82cb-b8a16a1ca81c req-7482dc1a-cf5c-4ba2-8dd7-498025c306f1 service nova] Lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-550a1d1b-81d8-44f1-82cb-b8a16a1ca81c req-7482dc1a-cf5c-4ba2-8dd7-498025c306f1 service nova] Lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-550a1d1b-81d8-44f1-82cb-b8a16a1ca81c req-7482dc1a-cf5c-4ba2-8dd7-498025c306f1 service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] No waiting events found dispatching network-vif-plugged-3896309e-3f41-410d-810f-7d794d93e155 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:11:24 user nova-compute[75021]: WARNING nova.compute.manager [req-550a1d1b-81d8-44f1-82cb-b8a16a1ca81c req-7482dc1a-cf5c-4ba2-8dd7-498025c306f1 service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Received unexpected event network-vif-plugged-3896309e-3f41-410d-810f-7d794d93e155 for instance with vm_state building and task_state spawning.
Dec 06 07:11:24 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:11:24 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Took 0.61 seconds to deallocate network for instance.
Dec 06 07:11:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:25 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:11:25 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:11:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-a0a13056-a4c0-4b7a-b104-cd89262873cf req-f3ad066a-f755-4cdc-9eb0-c534c48b5996 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Received event network-vif-plugged-f48add70-d28e-43ed-8bc8-cdb69f2b3cee {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a0a13056-a4c0-4b7a-b104-cd89262873cf req-f3ad066a-f755-4cdc-9eb0-c534c48b5996 service nova] Acquiring lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a0a13056-a4c0-4b7a-b104-cd89262873cf req-f3ad066a-f755-4cdc-9eb0-c534c48b5996 service nova] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a0a13056-a4c0-4b7a-b104-cd89262873cf req-f3ad066a-f755-4cdc-9eb0-c534c48b5996 service nova] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-a0a13056-a4c0-4b7a-b104-cd89262873cf req-f3ad066a-f755-4cdc-9eb0-c534c48b5996 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] No waiting events found dispatching network-vif-plugged-f48add70-d28e-43ed-8bc8-cdb69f2b3cee {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:11:25 user nova-compute[75021]: WARNING nova.compute.manager [req-a0a13056-a4c0-4b7a-b104-cd89262873cf req-f3ad066a-f755-4cdc-9eb0-c534c48b5996 service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Received unexpected event network-vif-plugged-f48add70-d28e-43ed-8bc8-cdb69f2b3cee for instance with vm_state deleted and task_state None.
Dec 06 07:11:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:25 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Deleted allocations for instance 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc
Dec 06 07:11:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b5aad671-9797-4c70-90e8-f7098af7e7b4 tempest-ServersNegativeTestJSON-1406242964 tempest-ServersNegativeTestJSON-1406242964-project-member] Lock "7d58e89e-b41f-4eb8-9e92-02e0d017d3fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.629s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:26 user nova-compute[75021]: DEBUG nova.compute.manager [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:11:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:11:26 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Instance spawned successfully.
Dec 06 07:11:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:11:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:11:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:11:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:11:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:11:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:11:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:11:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-adcc29d4-708f-4d12-8467-1abd4c45c054 req-176551a1-3239-41ce-8925-8bad8c61181b service nova] [instance: 7d58e89e-b41f-4eb8-9e92-02e0d017d3fc] Received event network-vif-deleted-f48add70-d28e-43ed-8bc8-cdb69f2b3cee {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-adcc29d4-708f-4d12-8467-1abd4c45c054 req-176551a1-3239-41ce-8925-8bad8c61181b service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Received event network-vif-plugged-3896309e-3f41-410d-810f-7d794d93e155 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-adcc29d4-708f-4d12-8467-1abd4c45c054 req-176551a1-3239-41ce-8925-8bad8c61181b service nova] Acquiring lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-adcc29d4-708f-4d12-8467-1abd4c45c054 req-176551a1-3239-41ce-8925-8bad8c61181b service nova] Lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-adcc29d4-708f-4d12-8467-1abd4c45c054 req-176551a1-3239-41ce-8925-8bad8c61181b service nova] Lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-adcc29d4-708f-4d12-8467-1abd4c45c054 req-176551a1-3239-41ce-8925-8bad8c61181b service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] No waiting events found dispatching network-vif-plugged-3896309e-3f41-410d-810f-7d794d93e155 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:11:26 user nova-compute[75021]: WARNING nova.compute.manager [req-adcc29d4-708f-4d12-8467-1abd4c45c054 req-176551a1-3239-41ce-8925-8bad8c61181b service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Received unexpected event network-vif-plugged-3896309e-3f41-410d-810f-7d794d93e155 for instance with vm_state building and task_state spawning.
Dec 06 07:11:26 user nova-compute[75021]: INFO nova.compute.manager [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Took 6.39 seconds to spawn the instance on the hypervisor.
Dec 06 07:11:26 user nova-compute[75021]: DEBUG nova.compute.manager [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:11:26 user nova-compute[75021]: INFO nova.compute.manager [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Took 7.33 seconds to build instance.
Dec 06 07:11:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1389547b-1175-44bb-a322-a903dc9d7dfe tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.427s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:11:32 user nova-compute[75021]: INFO nova.compute.claims [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Claim successful on node user
Dec 06 07:11:32 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG nova.network.neutron [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:11:32 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:11:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG nova.policy [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24f231f563c345b48a998200dbf1384a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e36b4acada439db308e5e816dbf9a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:11:32 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Creating image(s)
Dec 06 07:11:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "/opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "/opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "/opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a.part --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Successfully created port: 1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:11:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a.part --force-share --output=json" returned: 0 in 0.192s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:33 user nova-compute[75021]: DEBUG nova.virt.images [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] a7a58751-9b36-4563-ad03-1e65e6a63091 was qcow2, converting to raw {{(pid=75021) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 07:11:33 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 07:11:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a.part /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a.converted {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a.part /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a.converted" returned: 0 in 0.267s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a.converted --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a.converted --force-share --output=json" returned: 0 in 0.245s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.107s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-39dc06c0-1260-4da1-9b7c-ac260e92c221 req-e50c5639-cee6-4445-b562-bb83f41a26ec service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Received event network-changed-f2029bf5-89e2-4759-90a2-a17f8721653c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-39dc06c0-1260-4da1-9b7c-ac260e92c221 req-e50c5639-cee6-4445-b562-bb83f41a26ec service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Refreshing instance network info cache due to event network-changed-f2029bf5-89e2-4759-90a2-a17f8721653c. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-39dc06c0-1260-4da1-9b7c-ac260e92c221 req-e50c5639-cee6-4445-b562-bb83f41a26ec service nova] Acquiring lock "refresh_cache-35da578f-dc7b-4038-869e-3d7528844bf0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-39dc06c0-1260-4da1-9b7c-ac260e92c221 req-e50c5639-cee6-4445-b562-bb83f41a26ec service nova] Acquired lock "refresh_cache-35da578f-dc7b-4038-869e-3d7528844bf0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-39dc06c0-1260-4da1-9b7c-ac260e92c221 req-e50c5639-cee6-4445-b562-bb83f41a26ec service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Refreshing network info cache for port f2029bf5-89e2-4759-90a2-a17f8721653c {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.network.neutron [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Successfully updated port: 1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquired lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.network.neutron [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-a0699741-49e5-4fe1-9a41-b35bea8d67f3 req-b842c158-ec15-49a8-a15b-fe9419f3ead3 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received event network-changed-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-a0699741-49e5-4fe1-9a41-b35bea8d67f3 req-b842c158-ec15-49a8-a15b-fe9419f3ead3 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Refreshing instance network info cache due to event network-changed-1edcce6c-0464-4647-acec-43b63a19fec3. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a0699741-49e5-4fe1-9a41-b35bea8d67f3 req-b842c158-ec15-49a8-a15b-fe9419f3ead3 service nova] Acquiring lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.network.neutron [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a --force-share --output=json" returned: 0 in 0.215s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a,backing_fmt=raw /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a,backing_fmt=raw /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk 1073741824" returned: 0 in 0.058s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "35da578f-dc7b-4038-869e-3d7528844bf0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "35da578f-dc7b-4038-869e-3d7528844bf0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.objects.instance [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lazy-loading 'flavor' on Instance uuid 35da578f-dc7b-4038-869e-3d7528844bf0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:11:34 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Ignoring supplied device name: /dev/vdb
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "35da578f-dc7b-4038-869e-3d7528844bf0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.132s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.network.neutron [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Updating instance_info_cache with network_info: [{"id": "1edcce6c-0464-4647-acec-43b63a19fec3", "address": "fa:16:3e:39:da:e2", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1edcce6c-04", "ovs_interfaceid": "1edcce6c-0464-4647-acec-43b63a19fec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Releasing lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Instance network_info: |[{"id": "1edcce6c-0464-4647-acec-43b63a19fec3", "address": "fa:16:3e:39:da:e2", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1edcce6c-04", "ovs_interfaceid": "1edcce6c-0464-4647-acec-43b63a19fec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a0699741-49e5-4fe1-9a41-b35bea8d67f3 req-b842c158-ec15-49a8-a15b-fe9419f3ead3 service nova] Acquired lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-a0699741-49e5-4fe1-9a41-b35bea8d67f3 req-b842c158-ec15-49a8-a15b-fe9419f3ead3 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Refreshing network info cache for port 1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "35da578f-dc7b-4038-869e-3d7528844bf0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "35da578f-dc7b-4038-869e-3d7528844bf0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:34 user nova-compute[75021]: INFO nova.compute.manager [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Attaching volume a7458a77-a9fe-4c77-8435-01f0765dbbf3 to /dev/vdb
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-39dc06c0-1260-4da1-9b7c-ac260e92c221 req-e50c5639-cee6-4445-b562-bb83f41a26ec service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Updated VIF entry in instance network info cache for port f2029bf5-89e2-4759-90a2-a17f8721653c. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-39dc06c0-1260-4da1-9b7c-ac260e92c221 req-e50c5639-cee6-4445-b562-bb83f41a26ec service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Updating instance_info_cache with network_info: [{"id": "f2029bf5-89e2-4759-90a2-a17f8721653c", "address": "fa:16:3e:74:63:fb", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2029bf5-89", "ovs_interfaceid": "f2029bf5-89e2-4759-90a2-a17f8721653c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-39dc06c0-1260-4da1-9b7c-ac260e92c221 req-e50c5639-cee6-4445-b562-bb83f41a26ec service nova] Releasing lock "refresh_cache-35da578f-dc7b-4038-869e-3d7528844bf0" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Cannot resize image /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Ensure instance console log exists: /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Start _get_guest_xml network_info=[{"id": "1edcce6c-0464-4647-acec-43b63a19fec3", "address": "fa:16:3e:39:da:e2", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1edcce6c-04", "ovs_interfaceid": "1edcce6c-0464-4647-acec-43b63a19fec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T07:11:29Z,direct_url=<?>,disk_format='qcow2',id=a7a58751-9b36-4563-ad03-1e65e6a63091,min_disk=0,min_ram=0,name='tempest-scenario-img--473780503',owner='78e36b4acada439db308e5e816dbf9a7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T07:11:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a7a58751-9b36-4563-ad03-1e65e6a63091'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:11:34 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:11:34 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:11:34 user nova-compute[75021]: DEBUG os_brick.utils [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T07:11:29Z,direct_url=<?>,disk_format='qcow2',id=a7a58751-9b36-4563-ad03-1e65e6a63091,min_disk=0,min_ram=0,name='tempest-scenario-img--473780503',owner='78e36b4acada439db308e5e816dbf9a7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T07:11:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1755716713',display_name='tempest-TestMinimumBasicScenario-server-1755716713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1755716713',id=30,image_ref='a7a58751-9b36-4563-ad03-1e65e6a63091',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzFEXjZqYWN/VOrm0W/J/e8cauXWobaJeUOp7fEDeV6rTUnqHDRo9pCOhEKAWGMF1UAWts7NnR1enZvWdPqSbV7BHLfp7tXkCiWtrMCpbrxftL6id6Sn9hR+52ZFifAJg==',key_name='tempest-TestMinimumBasicScenario-1108525570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78e36b4acada439db308e5e816dbf9a7',ramdisk_id='',reservation_id='r-agf1s9cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a7a58751-9b36-4563-ad03-1e65e6a63091',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-757290889',owner_user_name='tempest-TestMinimumBasicScenario-757290889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:11:33Z,user_data=None,user_id='24f231f563c345b48a998200dbf1384a',uuid=c08cfdd8-44fc-4736-b5dd-d216c75afef6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1edcce6c-0464-4647-acec-43b63a19fec3", "address": "fa:16:3e:39:da:e2", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1edcce6c-04", "ovs_interfaceid": "1edcce6c-0464-4647-acec-43b63a19fec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converting VIF {"id": "1edcce6c-0464-4647-acec-43b63a19fec3", "address": "fa:16:3e:39:da:e2", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1edcce6c-04", "ovs_interfaceid": "1edcce6c-0464-4647-acec-43b63a19fec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:da:e2,bridge_name='br-int',has_traffic_filtering=True,id=1edcce6c-0464-4647-acec-43b63a19fec3,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1edcce6c-04') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.objects.instance [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lazy-loading 'pci_devices' on Instance uuid c08cfdd8-44fc-4736-b5dd-d216c75afef6 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a41462-e502-4852-8791-8bedce6f6f61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:11:34 user nova-compute[75021]:   <uuid>c08cfdd8-44fc-4736-b5dd-d216c75afef6</uuid>
Dec 06 07:11:34 user nova-compute[75021]:   <name>instance-0000001e</name>
Dec 06 07:11:34 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:11:34 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:11:34 user nova-compute[75021]:   <metadata>
Dec 06 07:11:34 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:11:34 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:11:34 user nova-compute[75021]:       <nova:name>tempest-TestMinimumBasicScenario-server-1755716713</nova:name>
Dec 06 07:11:34 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:11:34</nova:creationTime>
Dec 06 07:11:34 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:11:34 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:11:34 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:11:34 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:11:34 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:11:34 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:11:34 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:11:34 user nova-compute[75021]:       <nova:owner>
Dec 06 07:11:34 user nova-compute[75021]:         <nova:user uuid="24f231f563c345b48a998200dbf1384a">tempest-TestMinimumBasicScenario-757290889-project-member</nova:user>
Dec 06 07:11:34 user nova-compute[75021]:         <nova:project uuid="78e36b4acada439db308e5e816dbf9a7">tempest-TestMinimumBasicScenario-757290889</nova:project>
Dec 06 07:11:34 user nova-compute[75021]:       </nova:owner>
Dec 06 07:11:34 user nova-compute[75021]:       <nova:root type="image" uuid="a7a58751-9b36-4563-ad03-1e65e6a63091"/>
Dec 06 07:11:34 user nova-compute[75021]:       <nova:ports>
Dec 06 07:11:34 user nova-compute[75021]:         <nova:port uuid="1edcce6c-0464-4647-acec-43b63a19fec3">
Dec 06 07:11:34 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 06 07:11:34 user nova-compute[75021]:         </nova:port>
Dec 06 07:11:34 user nova-compute[75021]:       </nova:ports>
Dec 06 07:11:34 user nova-compute[75021]:     </nova:instance>
Dec 06 07:11:34 user nova-compute[75021]:   </metadata>
Dec 06 07:11:34 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:11:34 user nova-compute[75021]:     <system>
Dec 06 07:11:34 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:11:34 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:11:34 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:11:34 user nova-compute[75021]:       <entry name="serial">c08cfdd8-44fc-4736-b5dd-d216c75afef6</entry>
Dec 06 07:11:34 user nova-compute[75021]:       <entry name="uuid">c08cfdd8-44fc-4736-b5dd-d216c75afef6</entry>
Dec 06 07:11:34 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:11:34 user nova-compute[75021]:     </system>
Dec 06 07:11:34 user nova-compute[75021]:   </sysinfo>
Dec 06 07:11:34 user nova-compute[75021]:   <os>
Dec 06 07:11:34 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:11:34 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:11:34 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:11:34 user nova-compute[75021]:   </os>
Dec 06 07:11:34 user nova-compute[75021]:   <features>
Dec 06 07:11:34 user nova-compute[75021]:     <acpi/>
Dec 06 07:11:34 user nova-compute[75021]:     <apic/>
Dec 06 07:11:34 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:11:34 user nova-compute[75021]:   </features>
Dec 06 07:11:34 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:11:34 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:11:34 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:11:34 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:11:34 user nova-compute[75021]:   </clock>
Dec 06 07:11:34 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:11:34 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:11:34 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:11:34 user nova-compute[75021]:   </cpu>
Dec 06 07:11:34 user nova-compute[75021]:   <devices>
Dec 06 07:11:34 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:11:34 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:11:34 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk"/>
Dec 06 07:11:34 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:11:34 user nova-compute[75021]:     </disk>
Dec 06 07:11:34 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:11:34 user nova-compute[75021]:       <mac address="fa:16:3e:39:da:e2"/>
Dec 06 07:11:34 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:11:34 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:11:34 user nova-compute[75021]:       <target dev="tap1edcce6c-04"/>
Dec 06 07:11:34 user nova-compute[75021]:     </interface>
Dec 06 07:11:34 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:11:34 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/console.log" append="off"/>
Dec 06 07:11:34 user nova-compute[75021]:     </serial>
Dec 06 07:11:34 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:11:34 user nova-compute[75021]:     <video>
Dec 06 07:11:34 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:11:34 user nova-compute[75021]:     </video>
Dec 06 07:11:34 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:11:34 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:11:34 user nova-compute[75021]:     </rng>
Dec 06 07:11:34 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:11:34 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:11:34 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:11:34 user nova-compute[75021]:     </memballoon>
Dec 06 07:11:34 user nova-compute[75021]:   </devices>
Dec 06 07:11:34 user nova-compute[75021]: </domain>
Dec 06 07:11:34 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1755716713',display_name='tempest-TestMinimumBasicScenario-server-1755716713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1755716713',id=30,image_ref='a7a58751-9b36-4563-ad03-1e65e6a63091',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzFEXjZqYWN/VOrm0W/J/e8cauXWobaJeUOp7fEDeV6rTUnqHDRo9pCOhEKAWGMF1UAWts7NnR1enZvWdPqSbV7BHLfp7tXkCiWtrMCpbrxftL6id6Sn9hR+52ZFifAJg==',key_name='tempest-TestMinimumBasicScenario-1108525570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78e36b4acada439db308e5e816dbf9a7',ramdisk_id='',reservation_id='r-agf1s9cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a7a58751-9b36-4563-ad03-1e65e6a63091',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-757290889',owner_user_name='tempest-TestMinimumBasicScenario-757290889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:11:33Z,user_data=None,user_id='24f231f563c345b48a998200dbf1384a',uuid=c08cfdd8-44fc-4736-b5dd-d216c75afef6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1edcce6c-0464-4647-acec-43b63a19fec3", "address": "fa:16:3e:39:da:e2", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1edcce6c-04", "ovs_interfaceid": "1edcce6c-0464-4647-acec-43b63a19fec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converting VIF {"id": "1edcce6c-0464-4647-acec-43b63a19fec3", "address": "fa:16:3e:39:da:e2", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1edcce6c-04", "ovs_interfaceid": "1edcce6c-0464-4647-acec-43b63a19fec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:da:e2,bridge_name='br-int',has_traffic_filtering=True,id=1edcce6c-0464-4647-acec-43b63a19fec3,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1edcce6c-04') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG os_vif [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:da:e2,bridge_name='br-int',has_traffic_filtering=True,id=1edcce6c-0464-4647-acec-43b63a19fec3,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1edcce6c-04') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '627b8248-859c-5dec-8f7d-e98827774765', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2dad2d-a855-4e0e-bc37-0a070a43839f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1edcce6c-04, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1edcce6c-04, col_values=(('qos', UUID('de7ce347-09d1-4970-b898-e3c44c267e61')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1edcce6c-04, col_values=(('external_ids', {'iface-id': '1edcce6c-0464-4647-acec-43b63a19fec3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:da:e2', 'vm-uuid': 'c08cfdd8-44fc-4736-b5dd-d216c75afef6'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d524c082-4472-4637-9540-06f1277cd674]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:34 user nova-compute[75021]: INFO os_vif [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:da:e2,bridge_name='br-int',has_traffic_filtering=True,id=1edcce6c-0464-4647-acec-43b63a19fec3,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1edcce6c-04')
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4bbc7c-4120-41fc-8456-a6c7c8d129b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:11:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:11:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:11:35 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:11:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8da14b-ef05-4fb0-9b3f-675491b46719]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:11:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:11:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:11:35 user nova-compute[75021]: DEBUG os_brick.utils [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] <== get_connector_properties: return (196ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:11:35 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Updating existing volume attachment record: c6e6b9a9-f18b-4c74-958e-1a71a2e13a33 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:11:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:11:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] No VIF found with MAC fa:16:3e:39:da:e2, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:11:35 user nova-compute[75021]: DEBUG nova.network.neutron [req-a0699741-49e5-4fe1-9a41-b35bea8d67f3 req-b842c158-ec15-49a8-a15b-fe9419f3ead3 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Updated VIF entry in instance network info cache for port 1edcce6c-0464-4647-acec-43b63a19fec3. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:11:35 user nova-compute[75021]: DEBUG nova.network.neutron [req-a0699741-49e5-4fe1-9a41-b35bea8d67f3 req-b842c158-ec15-49a8-a15b-fe9419f3ead3 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Updating instance_info_cache with network_info: [{"id": "1edcce6c-0464-4647-acec-43b63a19fec3", "address": "fa:16:3e:39:da:e2", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1edcce6c-04", "ovs_interfaceid": "1edcce6c-0464-4647-acec-43b63a19fec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:11:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a0699741-49e5-4fe1-9a41-b35bea8d67f3 req-b842c158-ec15-49a8-a15b-fe9419f3ead3 service nova] Releasing lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:11:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-d184bef2-bef9-4c44-9cf3-cf591f11e3e5 req-aa78c35d-6ee3-41d7-8f71-a1574570aa3c service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received event network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d184bef2-bef9-4c44-9cf3-cf591f11e3e5 req-aa78c35d-6ee3-41d7-8f71-a1574570aa3c service nova] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d184bef2-bef9-4c44-9cf3-cf591f11e3e5 req-aa78c35d-6ee3-41d7-8f71-a1574570aa3c service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d184bef2-bef9-4c44-9cf3-cf591f11e3e5 req-aa78c35d-6ee3-41d7-8f71-a1574570aa3c service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-d184bef2-bef9-4c44-9cf3-cf591f11e3e5 req-aa78c35d-6ee3-41d7-8f71-a1574570aa3c service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] No waiting events found dispatching network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:11:36 user nova-compute[75021]: WARNING nova.compute.manager [req-d184bef2-bef9-4c44-9cf3-cf591f11e3e5 req-aa78c35d-6ee3-41d7-8f71-a1574570aa3c service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received unexpected event network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 for instance with vm_state building and task_state spawning.
Dec 06 07:11:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-1502b62f-721e-45f9-a9f7-1368e3ad0bef req-d7ac03de-8069-4df5-be0a-506a145aae04 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received event network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1502b62f-721e-45f9-a9f7-1368e3ad0bef req-d7ac03de-8069-4df5-be0a-506a145aae04 service nova] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1502b62f-721e-45f9-a9f7-1368e3ad0bef req-d7ac03de-8069-4df5-be0a-506a145aae04 service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1502b62f-721e-45f9-a9f7-1368e3ad0bef req-d7ac03de-8069-4df5-be0a-506a145aae04 service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-1502b62f-721e-45f9-a9f7-1368e3ad0bef req-d7ac03de-8069-4df5-be0a-506a145aae04 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] No waiting events found dispatching network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:11:38 user nova-compute[75021]: WARNING nova.compute.manager [req-1502b62f-721e-45f9-a9f7-1368e3ad0bef req-d7ac03de-8069-4df5-be0a-506a145aae04 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received unexpected event network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 for instance with vm_state building and task_state spawning.
Dec 06 07:11:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:11:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:11:38 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Instance spawned successfully.
Dec 06 07:11:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:11:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:11:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:11:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:11:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:11:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:11:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:11:38 user nova-compute[75021]: INFO nova.compute.manager [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Took 5.99 seconds to spawn the instance on the hypervisor.
Dec 06 07:11:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:11:38 user nova-compute[75021]: INFO nova.compute.manager [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Took 6.83 seconds to build instance.
Dec 06 07:11:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-83ef9933-5459-4262-b29a-6303b7f11167 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.922s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjJoqtPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:11:46 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:11:46 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:11:46 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da8f81d-6d77-4a07-af80-72ce908e1f22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:11:46 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce3438f-76f4-459d-bba6-2df59d86d7d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3] added
Dec 06 07:11:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b33415a-90af-4d17-a632-df5b705a9c21]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b423a5-abfb-4579-8cbc-db8477509c96]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjJoqtPb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjJoqtPb" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cc279d-3fed-42c3-add7-6f780462fa4b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AjJoqtPb'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[791713bd-52df-49bd-bb95-9d4780a75606]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c33730-4ffa-4dbd-b796-ee65a0ea5e19]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:11:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:11:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4843036e-7613-4036-82d3-d57b0c0f2356]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3, portal: 172.16.0.220,3260]
Dec 06 07:11:46 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3, portal: 172.16.0.220,3260] successful.
Dec 06 07:11:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f32b5ca-2f18-4df2-9381-1bf9a94306c8]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[397d75ef-61be-4862-a1bb-46f8e2df9414]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:11:46 user nova-compute[75021]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 (non-flash)
Dec 06 07:11:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] HCTL ('40', '-', '-', 0) found on session 38 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c427c3-620a-4062-b102-ae6eff93ebd8]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Searching for a device in session 38 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:11:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjJoqtPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:11:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:11:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26663323838643066', 'path': '/dev/sdi'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:11:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663323838643066', 'path': '/dev/sdi'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:11:47 user nova-compute[75021]: DEBUG nova.objects.instance [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lazy-loading 'flavor' on Instance uuid 35da578f-dc7b-4038-869e-3d7528844bf0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:11:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:11:47 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:11:47 user nova-compute[75021]:   <source dev="/dev/sdi"/>
Dec 06 07:11:47 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:11:47 user nova-compute[75021]:   <serial>a7458a77-a9fe-4c77-8435-01f0765dbbf3</serial>
Dec 06 07:11:47 user nova-compute[75021]: </disk>
Dec 06 07:11:47 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:11:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:11:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:11:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] No VIF found with MAC fa:16:3e:74:63:fb, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:11:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82735b69-3efe-48ba-9fd9-0d5381ad3699 tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "35da578f-dc7b-4038-869e-3d7528844bf0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.326s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:51 user nova-compute[75021]: INFO nova.compute.manager [None req-b45c961e-eac5-4da3-be83-74b0f7531720 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Unrescuing
Dec 06 07:11:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b45c961e-eac5-4da3-be83-74b0f7531720 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:11:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b45c961e-eac5-4da3-be83-74b0f7531720 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquired lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:11:51 user nova-compute[75021]: DEBUG nova.network.neutron [None req-b45c961e-eac5-4da3-be83-74b0f7531720 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:11:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:52 user nova-compute[75021]: DEBUG nova.network.neutron [None req-b45c961e-eac5-4da3-be83-74b0f7531720 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Updating instance_info_cache with network_info: [{"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:11:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b45c961e-eac5-4da3-be83-74b0f7531720 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Releasing lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:11:52 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b45c961e-eac5-4da3-be83-74b0f7531720 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'flavor' on Instance uuid 8b8eb320-6348-4038-a57e-02bf1e015174 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:11:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-a9331861-d3b1-48eb-8f07-e42fc0285066 req-9f4b90e3-a872-4ee0-ac46-477dcb9e2ee3 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-vif-unplugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a9331861-d3b1-48eb-8f07-e42fc0285066 req-9f4b90e3-a872-4ee0-ac46-477dcb9e2ee3 service nova] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a9331861-d3b1-48eb-8f07-e42fc0285066 req-9f4b90e3-a872-4ee0-ac46-477dcb9e2ee3 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a9331861-d3b1-48eb-8f07-e42fc0285066 req-9f4b90e3-a872-4ee0-ac46-477dcb9e2ee3 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-a9331861-d3b1-48eb-8f07-e42fc0285066 req-9f4b90e3-a872-4ee0-ac46-477dcb9e2ee3 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] No waiting events found dispatching network-vif-unplugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:11:52 user nova-compute[75021]: WARNING nova.compute.manager [req-a9331861-d3b1-48eb-8f07-e42fc0285066 req-9f4b90e3-a872-4ee0-ac46-477dcb9e2ee3 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received unexpected event network-vif-unplugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:11:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:53 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Instance destroyed successfully.
Dec 06 07:11:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-74499b35-308a-445e-828e-2a3f64863e50 req-ee03cf0b-9aa8-40d3-b095-094ee611e5b8 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-74499b35-308a-445e-828e-2a3f64863e50 req-ee03cf0b-9aa8-40d3-b095-094ee611e5b8 service nova] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-74499b35-308a-445e-828e-2a3f64863e50 req-ee03cf0b-9aa8-40d3-b095-094ee611e5b8 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-74499b35-308a-445e-828e-2a3f64863e50 req-ee03cf0b-9aa8-40d3-b095-094ee611e5b8 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-74499b35-308a-445e-828e-2a3f64863e50 req-ee03cf0b-9aa8-40d3-b095-094ee611e5b8 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] No waiting events found dispatching network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:11:54 user nova-compute[75021]: WARNING nova.compute.manager [req-74499b35-308a-445e-828e-2a3f64863e50 req-ee03cf0b-9aa8-40d3-b095-094ee611e5b8 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received unexpected event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:11:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:56 user nova-compute[75021]: DEBUG nova.compute.manager [req-5e4d715d-2af2-4f11-afb6-07f8efcf27f7 req-5a2e9cf7-c2a5-43f9-bc00-c566f3b91e71 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5e4d715d-2af2-4f11-afb6-07f8efcf27f7 req-5a2e9cf7-c2a5-43f9-bc00-c566f3b91e71 service nova] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5e4d715d-2af2-4f11-afb6-07f8efcf27f7 req-5a2e9cf7-c2a5-43f9-bc00-c566f3b91e71 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5e4d715d-2af2-4f11-afb6-07f8efcf27f7 req-5a2e9cf7-c2a5-43f9-bc00-c566f3b91e71 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:57 user nova-compute[75021]: DEBUG nova.compute.manager [req-5e4d715d-2af2-4f11-afb6-07f8efcf27f7 req-5a2e9cf7-c2a5-43f9-bc00-c566f3b91e71 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] No waiting events found dispatching network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:11:57 user nova-compute[75021]: WARNING nova.compute.manager [req-5e4d715d-2af2-4f11-afb6-07f8efcf27f7 req-5a2e9cf7-c2a5-43f9-bc00-c566f3b91e71 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received unexpected event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:11:57 user nova-compute[75021]: DEBUG nova.compute.manager [req-5e4d715d-2af2-4f11-afb6-07f8efcf27f7 req-5a2e9cf7-c2a5-43f9-bc00-c566f3b91e71 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:11:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5e4d715d-2af2-4f11-afb6-07f8efcf27f7 req-5a2e9cf7-c2a5-43f9-bc00-c566f3b91e71 service nova] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:11:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5e4d715d-2af2-4f11-afb6-07f8efcf27f7 req-5a2e9cf7-c2a5-43f9-bc00-c566f3b91e71 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:11:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5e4d715d-2af2-4f11-afb6-07f8efcf27f7 req-5a2e9cf7-c2a5-43f9-bc00-c566f3b91e71 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:11:57 user nova-compute[75021]: DEBUG nova.compute.manager [req-5e4d715d-2af2-4f11-afb6-07f8efcf27f7 req-5a2e9cf7-c2a5-43f9-bc00-c566f3b91e71 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] No waiting events found dispatching network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:11:57 user nova-compute[75021]: WARNING nova.compute.manager [req-5e4d715d-2af2-4f11-afb6-07f8efcf27f7 req-5a2e9cf7-c2a5-43f9-bc00-c566f3b91e71 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received unexpected event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:11:57 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b45c961e-eac5-4da3-be83-74b0f7531720 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:11:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:11:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:03 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:12:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:03 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:12:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:12:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:12:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:12:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:12:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:12:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:12:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:12:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:08 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:12:08 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7298MB free_disk=25.11682891845703GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 8b8eb320-6348-4038-a57e-02bf1e015174 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a6c8e069-46ae-4069-b81e-364bad589ebf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 35da578f-dc7b-4038-869e-3d7528844bf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance e600e40b-0b08-4341-a48e-652da530e59c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 0f5cb530-4025-4b9f-988e-c2877a61c9a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance c08cfdd8-44fc-4736-b5dd-d216c75afef6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:12:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:12:09 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:12:09 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:12:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:12:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:12:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:12:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 07:12:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:12:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:12:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:12:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:12:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:12:11 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:12:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:12:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:14 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:12:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "35da578f-dc7b-4038-869e-3d7528844bf0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "35da578f-dc7b-4038-869e-3d7528844bf0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:14 user nova-compute[75021]: INFO nova.compute.manager [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Detaching volume a7458a77-a9fe-4c77-8435-01f0765dbbf3
Dec 06 07:12:14 user nova-compute[75021]: INFO nova.virt.block_device [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Attempting to driver detach volume a7458a77-a9fe-4c77-8435-01f0765dbbf3 from mountpoint /dev/vdb
Dec 06 07:12:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Attempting to detach device vdb from instance 35da578f-dc7b-4038-869e-3d7528844bf0 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:12:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:12:14 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:12:14 user nova-compute[75021]:   <source dev="/dev/sdi"/>
Dec 06 07:12:14 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:12:14 user nova-compute[75021]:   <serial>a7458a77-a9fe-4c77-8435-01f0765dbbf3</serial>
Dec 06 07:12:14 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:12:14 user nova-compute[75021]: </disk>
Dec 06 07:12:14 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:12:14 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Successfully detached device vdb from instance 35da578f-dc7b-4038-869e-3d7528844bf0 from the persistent domain config.
Dec 06 07:12:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35da578f-dc7b-4038-869e-3d7528844bf0 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:12:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:12:14 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:12:14 user nova-compute[75021]:   <source dev="/dev/sdi"/>
Dec 06 07:12:14 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:12:14 user nova-compute[75021]:   <serial>a7458a77-a9fe-4c77-8435-01f0765dbbf3</serial>
Dec 06 07:12:14 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:12:14 user nova-compute[75021]: </disk>
Dec 06 07:12:14 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:12:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "35da578f-dc7b-4038-869e-3d7528844bf0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35da578f-dc7b-4038-869e-3d7528844bf0 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:12:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:18 user nova-compute[75021]: INFO nova.compute.manager [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Detaching volume aaa85e8a-1642-438b-9d04-aa5ca22d3d5b
Dec 06 07:12:18 user nova-compute[75021]: INFO nova.virt.block_device [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Attempting to driver detach volume aaa85e8a-1642-438b-9d04-aa5ca22d3d5b from mountpoint /dev/vdb
Dec 06 07:12:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Attempting to detach device vdb from instance bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:12:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:12:18 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:12:18 user nova-compute[75021]:   <source dev="/dev/sdc"/>
Dec 06 07:12:18 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:12:18 user nova-compute[75021]:   <serial>aaa85e8a-1642-438b-9d04-aa5ca22d3d5b</serial>
Dec 06 07:12:18 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 07:12:18 user nova-compute[75021]: </disk>
Dec 06 07:12:18 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:12:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:18 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Successfully detached device vdb from instance bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a from the persistent domain config.
Dec 06 07:12:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:12:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:12:18 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:12:18 user nova-compute[75021]:   <source dev="/dev/sdc"/>
Dec 06 07:12:18 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:12:18 user nova-compute[75021]:   <serial>aaa85e8a-1642-438b-9d04-aa5ca22d3d5b</serial>
Dec 06 07:12:18 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 07:12:18 user nova-compute[75021]: </disk>
Dec 06 07:12:18 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:12:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:12:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-defe5ec5-ed29-4d09-99ac-a65da883ec44 req-475782a8-440b-499d-aea3-7369798d7f02 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-changed-07acf2eb-ace0-4ae1-b719-e179921b4283 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-defe5ec5-ed29-4d09-99ac-a65da883ec44 req-475782a8-440b-499d-aea3-7369798d7f02 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing instance network info cache due to event network-changed-07acf2eb-ace0-4ae1-b719-e179921b4283. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:12:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-defe5ec5-ed29-4d09-99ac-a65da883ec44 req-475782a8-440b-499d-aea3-7369798d7f02 service nova] Acquiring lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:12:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-defe5ec5-ed29-4d09-99ac-a65da883ec44 req-475782a8-440b-499d-aea3-7369798d7f02 service nova] Acquired lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:12:21 user nova-compute[75021]: DEBUG nova.network.neutron [req-defe5ec5-ed29-4d09-99ac-a65da883ec44 req-475782a8-440b-499d-aea3-7369798d7f02 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Refreshing network info cache for port 07acf2eb-ace0-4ae1-b719-e179921b4283 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:12:22 user nova-compute[75021]: DEBUG nova.network.neutron [req-defe5ec5-ed29-4d09-99ac-a65da883ec44 req-475782a8-440b-499d-aea3-7369798d7f02 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updated VIF entry in instance network info cache for port 07acf2eb-ace0-4ae1-b719-e179921b4283. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:12:22 user nova-compute[75021]: DEBUG nova.network.neutron [req-defe5ec5-ed29-4d09-99ac-a65da883ec44 req-475782a8-440b-499d-aea3-7369798d7f02 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updating instance_info_cache with network_info: [{"id": "07acf2eb-ace0-4ae1-b719-e179921b4283", "address": "fa:16:3e:19:ae:56", "network": {"id": "22ab25bd-67a1-4324-a7b4-8930fe53ac86", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-305871487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07acf2eb-ac", "ovs_interfaceid": "07acf2eb-ace0-4ae1-b719-e179921b4283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "address": "fa:16:3e:f5:54:25", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2b8ff7-15", "ovs_interfaceid": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "address": "fa:16:3e:64:b5:e3", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5462413e-c2", "ovs_interfaceid": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "address": "fa:16:3e:8e:dc:5b", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eaf5559-41", "ovs_interfaceid": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b61841a9-756e-4ad4-b803-017c7bd985de", "address": "fa:16:3e:28:9f:3d", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61841a9-75", "ovs_interfaceid": "b61841a9-756e-4ad4-b803-017c7bd985de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cb1e15ad-aa13-4507-b83c-035a05d32268", "address": "fa:16:3e:c6:50:d5", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1e15ad-aa", "ovs_interfaceid": "cb1e15ad-aa13-4507-b83c-035a05d32268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fe07857-5428-4598-b751-b88ff51d7c18", "address": "fa:16:3e:2f:4c:a3", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe07857-54", "ovs_interfaceid": "0fe07857-5428-4598-b751-b88ff51d7c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:12:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-defe5ec5-ed29-4d09-99ac-a65da883ec44 req-475782a8-440b-499d-aea3-7369798d7f02 service nova] Releasing lock "refresh_cache-a6c8e069-46ae-4069-b81e-364bad589ebf" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:12:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "e600e40b-0b08-4341-a48e-652da530e59c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "e600e40b-0b08-4341-a48e-652da530e59c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "e600e40b-0b08-4341-a48e-652da530e59c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:22 user nova-compute[75021]: INFO nova.compute.manager [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Terminating instance
Dec 06 07:12:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:12:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:23 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Instance destroyed successfully.
Dec 06 07:12:23 user nova-compute[75021]: DEBUG nova.objects.instance [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lazy-loading 'resources' on Instance uuid e600e40b-0b08-4341-a48e-652da530e59c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T07:06:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1837730268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1837730268',id=22,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5hWtq5TK0J0vpeo8aXAbvXCQ9ENJgvBGr2J66uQaNfFfPKHwNmVUNM2CHMhzie5xHYDXLzmEqeLL/Q6avdg1NwA1Dnzt6JyxnqTPO0wuy2VUmBr2q/1R0+cnZW8dXADA==',key_name='tempest-keypair-1138365958',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:10:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d75ae216dcb345c79a5c2a4d38e51b38',ramdisk_id='',reservation_id='r-98ifjfwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1923852465',owner_user_name='tempest-AttachVolumeShelveTestJSON-1923852465-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:10:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4daf20c071c4b5cb826452811323abd',uuid=e600e40b-0b08-4341-a48e-652da530e59c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converting VIF {"id": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "address": "fa:16:3e:a4:13:29", "network": {"id": "68104ea5-2afc-4495-8aa9-cc0c2e505c06", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1274013872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d75ae216dcb345c79a5c2a4d38e51b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18bb07e-28", "ovs_interfaceid": "d18bb07e-28df-49e3-b5b2-5e7cec5adee4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:13:29,bridge_name='br-int',has_traffic_filtering=True,id=d18bb07e-28df-49e3-b5b2-5e7cec5adee4,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bb07e-28') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG os_vif [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:13:29,bridge_name='br-int',has_traffic_filtering=True,id=d18bb07e-28df-49e3-b5b2-5e7cec5adee4,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bb07e-28') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd18bb07e-28, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb2bc307-214b-4e7d-89d5-0494143df5e0) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:23 user nova-compute[75021]: INFO os_vif [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:13:29,bridge_name='br-int',has_traffic_filtering=True,id=d18bb07e-28df-49e3-b5b2-5e7cec5adee4,network=Network(68104ea5-2afc-4495-8aa9-cc0c2e505c06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18bb07e-28')
Dec 06 07:12:23 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Deleting instance files /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c_del
Dec 06 07:12:23 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Deletion of /opt/stack/data/nova/instances/e600e40b-0b08-4341-a48e-652da530e59c_del complete
Dec 06 07:12:23 user nova-compute[75021]: INFO nova.compute.manager [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Took 0.68 seconds to destroy the instance on the hypervisor.
Dec 06 07:12:23 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: e600e40b-0b08-4341-a48e-652da530e59c] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-ef07ddf1-a7f3-45da-a92c-40daa3e8d24c req-af148578-d18a-4f71-a0cb-5d28864d545b service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received event network-vif-unplugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ef07ddf1-a7f3-45da-a92c-40daa3e8d24c req-af148578-d18a-4f71-a0cb-5d28864d545b service nova] Acquiring lock "e600e40b-0b08-4341-a48e-652da530e59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ef07ddf1-a7f3-45da-a92c-40daa3e8d24c req-af148578-d18a-4f71-a0cb-5d28864d545b service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ef07ddf1-a7f3-45da-a92c-40daa3e8d24c req-af148578-d18a-4f71-a0cb-5d28864d545b service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-ef07ddf1-a7f3-45da-a92c-40daa3e8d24c req-af148578-d18a-4f71-a0cb-5d28864d545b service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] No waiting events found dispatching network-vif-unplugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-ef07ddf1-a7f3-45da-a92c-40daa3e8d24c req-af148578-d18a-4f71-a0cb-5d28864d545b service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received event network-vif-unplugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-ef07ddf1-a7f3-45da-a92c-40daa3e8d24c req-af148578-d18a-4f71-a0cb-5d28864d545b service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received event network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ef07ddf1-a7f3-45da-a92c-40daa3e8d24c req-af148578-d18a-4f71-a0cb-5d28864d545b service nova] Acquiring lock "e600e40b-0b08-4341-a48e-652da530e59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ef07ddf1-a7f3-45da-a92c-40daa3e8d24c req-af148578-d18a-4f71-a0cb-5d28864d545b service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ef07ddf1-a7f3-45da-a92c-40daa3e8d24c req-af148578-d18a-4f71-a0cb-5d28864d545b service nova] Lock "e600e40b-0b08-4341-a48e-652da530e59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-ef07ddf1-a7f3-45da-a92c-40daa3e8d24c req-af148578-d18a-4f71-a0cb-5d28864d545b service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] No waiting events found dispatching network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:23 user nova-compute[75021]: WARNING nova.compute.manager [req-ef07ddf1-a7f3-45da-a92c-40daa3e8d24c req-af148578-d18a-4f71-a0cb-5d28864d545b service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received unexpected event network-vif-plugged-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 for instance with vm_state active and task_state deleting.
Dec 06 07:12:24 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:12:24 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Took 0.82 seconds to deallocate network for instance.
Dec 06 07:12:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-ed2c9ce7-a8a2-4ff7-8af1-673205e8e55b req-0b80f869-9d93-4ea8-9689-81bbbc4c9880 service nova] [instance: e600e40b-0b08-4341-a48e-652da530e59c] Received event network-vif-deleted-d18bb07e-28df-49e3-b5b2-5e7cec5adee4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:24 user nova-compute[75021]: INFO nova.compute.manager [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Terminating instance
Dec 06 07:12:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:24 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Deleted allocations for instance e600e40b-0b08-4341-a48e-652da530e59c
Dec 06 07:12:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5329ceae-a989-4416-b0ec-e22ed7960923 tempest-AttachVolumeShelveTestJSON-1923852465 tempest-AttachVolumeShelveTestJSON-1923852465-project-member] Lock "e600e40b-0b08-4341-a48e-652da530e59c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.253s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-f650e351-2b87-40c2-8271-2e198ac036c8 req-62ae37ab-4916-4667-a165-fbfaae7363b6 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-unplugged-07acf2eb-ace0-4ae1-b719-e179921b4283 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f650e351-2b87-40c2-8271-2e198ac036c8 req-62ae37ab-4916-4667-a165-fbfaae7363b6 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f650e351-2b87-40c2-8271-2e198ac036c8 req-62ae37ab-4916-4667-a165-fbfaae7363b6 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f650e351-2b87-40c2-8271-2e198ac036c8 req-62ae37ab-4916-4667-a165-fbfaae7363b6 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-f650e351-2b87-40c2-8271-2e198ac036c8 req-62ae37ab-4916-4667-a165-fbfaae7363b6 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-unplugged-07acf2eb-ace0-4ae1-b719-e179921b4283 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-f650e351-2b87-40c2-8271-2e198ac036c8 req-62ae37ab-4916-4667-a165-fbfaae7363b6 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-unplugged-07acf2eb-ace0-4ae1-b719-e179921b4283 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-unplugged-cb1e15ad-aa13-4507-b83c-035a05d32268 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-unplugged-cb1e15ad-aa13-4507-b83c-035a05d32268 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-unplugged-cb1e15ad-aa13-4507-b83c-035a05d32268 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-cb1e15ad-aa13-4507-b83c-035a05d32268 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-cb1e15ad-aa13-4507-b83c-035a05d32268 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:26 user nova-compute[75021]: WARNING nova.compute.manager [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-cb1e15ad-aa13-4507-b83c-035a05d32268 for instance with vm_state active and task_state deleting.
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-unplugged-0fe07857-5428-4598-b751-b88ff51d7c18 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-unplugged-0fe07857-5428-4598-b751-b88ff51d7c18 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-b6655344-e1ae-4f18-9da4-f448a97b83f8 req-1424f49f-b023-408c-b872-a1225d3ff088 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-unplugged-0fe07857-5428-4598-b751-b88ff51d7c18 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:12:26 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Instance destroyed successfully.
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.objects.instance [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lazy-loading 'resources' on Instance uuid a6c8e069-46ae-4069-b81e-364bad589ebf {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:10:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:10:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07acf2eb-ace0-4ae1-b719-e179921b4283", "address": "fa:16:3e:19:ae:56", "network": {"id": "22ab25bd-67a1-4324-a7b4-8930fe53ac86", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-305871487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07acf2eb-ac", "ovs_interfaceid": "07acf2eb-ace0-4ae1-b719-e179921b4283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "07acf2eb-ace0-4ae1-b719-e179921b4283", "address": "fa:16:3e:19:ae:56", "network": {"id": "22ab25bd-67a1-4324-a7b4-8930fe53ac86", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-305871487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07acf2eb-ac", "ovs_interfaceid": "07acf2eb-ace0-4ae1-b719-e179921b4283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:ae:56,bridge_name='br-int',has_traffic_filtering=True,id=07acf2eb-ace0-4ae1-b719-e179921b4283,network=Network(22ab25bd-67a1-4324-a7b4-8930fe53ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07acf2eb-ac') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:ae:56,bridge_name='br-int',has_traffic_filtering=True,id=07acf2eb-ace0-4ae1-b719-e179921b4283,network=Network(22ab25bd-67a1-4324-a7b4-8930fe53ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07acf2eb-ac') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07acf2eb-ac, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3d1fd95-5bfe-473d-b58c-a1e69b5f658a) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-unplugged-5462413e-c273-42de-8ba8-1fde5c39c0a4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-unplugged-5462413e-c273-42de-8ba8-1fde5c39c0a4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-unplugged-5462413e-c273-42de-8ba8-1fde5c39c0a4 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-5462413e-c273-42de-8ba8-1fde5c39c0a4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-5462413e-c273-42de-8ba8-1fde5c39c0a4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:26 user nova-compute[75021]: WARNING nova.compute.manager [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-5462413e-c273-42de-8ba8-1fde5c39c0a4 for instance with vm_state active and task_state deleting.
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-unplugged-3eaf5559-41b4-4e36-85dc-dcfcde324aa8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-unplugged-3eaf5559-41b4-4e36-85dc-dcfcde324aa8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-unplugged-3eaf5559-41b4-4e36-85dc-dcfcde324aa8 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-3eaf5559-41b4-4e36-85dc-dcfcde324aa8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-3eaf5559-41b4-4e36-85dc-dcfcde324aa8 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:26 user nova-compute[75021]: WARNING nova.compute.manager [req-2e43d8ee-bafc-4a96-bfec-dfa3a12e2f98 req-ca293d7c-0987-4761-aeb7-6e46031314a4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-3eaf5559-41b4-4e36-85dc-dcfcde324aa8 for instance with vm_state active and task_state deleting.
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: INFO os_vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:ae:56,bridge_name='br-int',has_traffic_filtering=True,id=07acf2eb-ace0-4ae1-b719-e179921b4283,network=Network(22ab25bd-67a1-4324-a7b4-8930fe53ac86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07acf2eb-ac')
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:10:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:10:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "address": "fa:16:3e:f5:54:25", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2b8ff7-15", "ovs_interfaceid": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "address": "fa:16:3e:f5:54:25", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2b8ff7-15", "ovs_interfaceid": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:54:25,bridge_name='br-int',has_traffic_filtering=True,id=3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f2b8ff7-15') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:54:25,bridge_name='br-int',has_traffic_filtering=True,id=3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f2b8ff7-15') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f2b8ff7-15, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ab40b3a-35e1-4df5-a2e1-427fdb247bff) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: INFO os_vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:54:25,bridge_name='br-int',has_traffic_filtering=True,id=3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f2b8ff7-15')
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:10:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:10:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "address": "fa:16:3e:64:b5:e3", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5462413e-c2", "ovs_interfaceid": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "address": "fa:16:3e:64:b5:e3", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5462413e-c2", "ovs_interfaceid": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:b5:e3,bridge_name='br-int',has_traffic_filtering=True,id=5462413e-c273-42de-8ba8-1fde5c39c0a4,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5462413e-c2') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:b5:e3,bridge_name='br-int',has_traffic_filtering=True,id=5462413e-c273-42de-8ba8-1fde5c39c0a4,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5462413e-c2') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5462413e-c2, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e889783-5500-46a1-94d2-698d741a5759) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: INFO os_vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:b5:e3,bridge_name='br-int',has_traffic_filtering=True,id=5462413e-c273-42de-8ba8-1fde5c39c0a4,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5462413e-c2')
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:10:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:10:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "address": "fa:16:3e:8e:dc:5b", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eaf5559-41", "ovs_interfaceid": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "address": "fa:16:3e:8e:dc:5b", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eaf5559-41", "ovs_interfaceid": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:dc:5b,bridge_name='br-int',has_traffic_filtering=True,id=3eaf5559-41b4-4e36-85dc-dcfcde324aa8,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eaf5559-41') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:dc:5b,bridge_name='br-int',has_traffic_filtering=True,id=3eaf5559-41b4-4e36-85dc-dcfcde324aa8,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eaf5559-41') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3eaf5559-41, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00ec3d0b-3f20-46b7-8226-897eaa616268) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: INFO os_vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:dc:5b,bridge_name='br-int',has_traffic_filtering=True,id=3eaf5559-41b4-4e36-85dc-dcfcde324aa8,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eaf5559-41')
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:10:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:10:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b61841a9-756e-4ad4-b803-017c7bd985de", "address": "fa:16:3e:28:9f:3d", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61841a9-75", "ovs_interfaceid": "b61841a9-756e-4ad4-b803-017c7bd985de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "b61841a9-756e-4ad4-b803-017c7bd985de", "address": "fa:16:3e:28:9f:3d", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61841a9-75", "ovs_interfaceid": "b61841a9-756e-4ad4-b803-017c7bd985de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:9f:3d,bridge_name='br-int',has_traffic_filtering=True,id=b61841a9-756e-4ad4-b803-017c7bd985de,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb61841a9-75') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9f:3d,bridge_name='br-int',has_traffic_filtering=True,id=b61841a9-756e-4ad4-b803-017c7bd985de,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb61841a9-75') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb61841a9-75, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48eecf76-5dd4-43a4-8a81-83be3c9f0c30) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: INFO os_vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9f:3d,bridge_name='br-int',has_traffic_filtering=True,id=b61841a9-756e-4ad4-b803-017c7bd985de,network=Network(1d755613-7e2f-4bbb-b4cf-0d0d2135957c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb61841a9-75')
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:10:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:10:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb1e15ad-aa13-4507-b83c-035a05d32268", "address": "fa:16:3e:c6:50:d5", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1e15ad-aa", "ovs_interfaceid": "cb1e15ad-aa13-4507-b83c-035a05d32268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "cb1e15ad-aa13-4507-b83c-035a05d32268", "address": "fa:16:3e:c6:50:d5", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1e15ad-aa", "ovs_interfaceid": "cb1e15ad-aa13-4507-b83c-035a05d32268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:50:d5,bridge_name='br-int',has_traffic_filtering=True,id=cb1e15ad-aa13-4507-b83c-035a05d32268,network=Network(ac205859-e685-4363-98db-558784812e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1e15ad-aa') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:50:d5,bridge_name='br-int',has_traffic_filtering=True,id=cb1e15ad-aa13-4507-b83c-035a05d32268,network=Network(ac205859-e685-4363-98db-558784812e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1e15ad-aa') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb1e15ad-aa, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2c80037-2f53-4285-82bc-33a9cdb11238) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: INFO os_vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:50:d5,bridge_name='br-int',has_traffic_filtering=True,id=cb1e15ad-aa13-4507-b83c-035a05d32268,network=Network(ac205859-e685-4363-98db-558784812e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1e15ad-aa')
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-06T07:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-213657073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-213657073',id=27,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIrT1REm/O6o3LIAkLGPod2mRhDMURolHAoxx4R1lC3MAfXvXYSdNMIso2uOoErKI6IdsWocDzR6pFopy2/y316HRSs90dXVBQMygiNSWscYD5lls7q7TsVMa0cxKXIiA==',key_name='tempest-keypair-362773283',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:10:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88e7a9eedb83455fab3446e497feae40',ramdisk_id='',reservation_id='r-0k30sou0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1777802644',owner_user_name='tempest-TaggedBootDevicesTest_v242-1777802644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:10:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b894e8943b54078832aab4f727af7cb',uuid=a6c8e069-46ae-4069-b81e-364bad589ebf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fe07857-5428-4598-b751-b88ff51d7c18", "address": "fa:16:3e:2f:4c:a3", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe07857-54", "ovs_interfaceid": "0fe07857-5428-4598-b751-b88ff51d7c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converting VIF {"id": "0fe07857-5428-4598-b751-b88ff51d7c18", "address": "fa:16:3e:2f:4c:a3", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe07857-54", "ovs_interfaceid": "0fe07857-5428-4598-b751-b88ff51d7c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=0fe07857-5428-4598-b751-b88ff51d7c18,network=Network(ac205859-e685-4363-98db-558784812e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe07857-54') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=0fe07857-5428-4598-b751-b88ff51d7c18,network=Network(ac205859-e685-4363-98db-558784812e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe07857-54') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fe07857-54, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61fc119c-f2e1-4bdb-9bfb-b45ce25d6f50) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:26 user nova-compute[75021]: INFO os_vif [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=0fe07857-5428-4598-b751-b88ff51d7c18,network=Network(ac205859-e685-4363-98db-558784812e98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe07857-54')
Dec 06 07:12:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qbVwGWhU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:12:26 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5f377f-650c-4cff-8b5f-6da0377d6a0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:12:26 user nova-compute[75021]: No targets found.
Dec 06 07:12:26 user nova-compute[75021]: iSNS:
Dec 06 07:12:26 user nova-compute[75021]: No targets found.
Dec 06 07:12:26 user nova-compute[75021]: STATIC:
Dec 06 07:12:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a
Dec 06 07:12:26 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:26 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d
Dec 06 07:12:26 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:26 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:12:26 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:26 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3
Dec 06 07:12:26 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:26 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7
Dec 06 07:12:26 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:26 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30
Dec 06 07:12:26 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:26 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b
Dec 06 07:12:26 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:26 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:26 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000
Dec 06 07:12:26 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:26 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:26 user nova-compute[75021]: FIRMWARE:
Dec 06 07:12:26 user nova-compute[75021]: No targets found.
Dec 06 07:12:26 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:12:26 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:12:26 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[913d2836-19b6-4f04-a3fe-78e6041a5a6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbcb4c9-b0d6-45c5-8530-26f0c038e3e5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:12:26 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:12:26 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:12:26 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:12:26 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:12:26 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:12:26 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:12:26 user nova-compute[75021]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 (non-flash)
Dec 06 07:12:26 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:12:26 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:12:26 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:12:26 user nova-compute[75021]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 (non-flash)
Dec 06 07:12:26 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:12:26 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:12:26 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:12:26 user nova-compute[75021]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 (non-flash)
Dec 06 07:12:26 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b45281f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f207ed-2aa9-42d7-85a2-0d32a225eb80]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c414ead-0bca-4c4b-9e11-6c750f064d37]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f6eab5-d5d3-41c0-8e91-d5e27ff07094]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c288dc0-0234-4203-a618-d4d1bcdf7744]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bf32eb-9f20-41f0-9170-502638e67ef0]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[100605fb-473f-458d-85b5-a24e59a47175]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000, portal: 172.16.0.220,3260]
Dec 06 07:12:27 user nova-compute[75021]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000, portal: 172.16.0.220,3260] successful.
Dec 06 07:12:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-07acf2eb-ace0-4ae1-b719-e179921b4283 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-07acf2eb-ace0-4ae1-b719-e179921b4283 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:27 user nova-compute[75021]: WARNING nova.compute.manager [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-07acf2eb-ace0-4ae1-b719-e179921b4283 for instance with vm_state active and task_state deleting.
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-unplugged-3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-unplugged-3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-unplugged-3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:27 user nova-compute[75021]: WARNING nova.compute.manager [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190 for instance with vm_state active and task_state deleting.
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-unplugged-b61841a9-756e-4ad4-b803-017c7bd985de {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-unplugged-b61841a9-756e-4ad4-b803-017c7bd985de {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-unplugged-b61841a9-756e-4ad4-b803-017c7bd985de for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-b61841a9-756e-4ad4-b803-017c7bd985de {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-b61841a9-756e-4ad4-b803-017c7bd985de {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:27 user nova-compute[75021]: WARNING nova.compute.manager [req-42d84a5a-ddf6-4714-8f85-41230eea6fd3 req-937799d2-0bfa-412e-b51b-bb479a2d23a2 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-b61841a9-756e-4ad4-b803-017c7bd985de for instance with vm_state active and task_state deleting.
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dbe0266-71c4-4370-b543-da543f3cd000 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f397b7-e13e-4c1e-89d4-042931ff7e04]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] <== disconnect_volume: return (458ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwHvKSmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:12:27 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d455db-0861-4aab-a188-39aaa1ab734c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:12:27 user nova-compute[75021]: No targets found.
Dec 06 07:12:27 user nova-compute[75021]: iSNS:
Dec 06 07:12:27 user nova-compute[75021]: No targets found.
Dec 06 07:12:27 user nova-compute[75021]: STATIC:
Dec 06 07:12:27 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a
Dec 06 07:12:27 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:27 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:27 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d
Dec 06 07:12:27 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:27 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:27 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:12:27 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:27 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:27 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3
Dec 06 07:12:27 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:27 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:27 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7
Dec 06 07:12:27 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:27 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:27 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30
Dec 06 07:12:27 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:27 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:27 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b
Dec 06 07:12:27 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:27 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:27 user nova-compute[75021]: FIRMWARE:
Dec 06 07:12:27 user nova-compute[75021]: No targets found.
Dec 06 07:12:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:12:27 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:12:27 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab45da1-2883-46e3-a0d5-ad9532058456]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b36666-1522-435f-9e6f-5c6ff8a7026d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d851cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d'): ({'sdf'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Removing single pathed devices sdf {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[51171aba-3d4f-4eef-9146-5d869a7ca209]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af65640-5e8b-4b85-87e1-3b7e671583dd]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Flushing IO for device /dev/sdf {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc06708-5053-4fb8-9a05-bf3a3ec6d260]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda5e598-f25a-42f9-9c28-e757eb4f2216]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[027df7f2-8820-4a5f-b63c-f246a5a7590e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c9280d-060d-4d8c-b554-97174ec28121]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d, portal: 172.16.0.220,3260]
Dec 06 07:12:27 user nova-compute[75021]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d, portal: 172.16.0.220,3260] successful.
Dec 06 07:12:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001fedc6-da7e-4ac9-8d7b-c55c95377a4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[672b12bb-4aa2-45fa-b8cc-d7837952b71e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] <== disconnect_volume: return (331ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEcfqJBo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:12:27 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d5dc6f-8a24-491b-b6cd-161d056bba89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:12:27 user nova-compute[75021]: No targets found.
Dec 06 07:12:27 user nova-compute[75021]: iSNS:
Dec 06 07:12:27 user nova-compute[75021]: No targets found.
Dec 06 07:12:27 user nova-compute[75021]: STATIC:
Dec 06 07:12:27 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a
Dec 06 07:12:27 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:27 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:27 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:12:27 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:27 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:27 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3
Dec 06 07:12:27 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:27 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:27 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7
Dec 06 07:12:27 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:27 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:27 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30
Dec 06 07:12:27 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:27 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:27 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b
Dec 06 07:12:27 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:27 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:27 user nova-compute[75021]: FIRMWARE:
Dec 06 07:12:27 user nova-compute[75021]: No targets found.
Dec 06 07:12:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:12:27 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:12:27 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1810f53a-f55e-458b-be14-111add343d33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[439c8be5-43d0-423c-b702-77ec4652f121]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:12:27 user nova-compute[75021]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 (non-flash)
Dec 06 07:12:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d851cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7'): ({'sdg'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Removing single pathed devices sdg {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b532c2-6758-4e11-a60f-2a53ce85db94]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[85581f35-bb69-456e-9e05-ca3bae69bc29]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Flushing IO for device /dev/sdg {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5f9724-2d50-4d56-a901-b3d547d123c3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a2e58a-1ba7-4432-86bb-465e3329c095]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] SCSI volumes sdg have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[591a5ff0-cf0d-43a8-9bdb-572afd3d630b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e0b272-f2a3-4336-8e0c-b4bd06a8ef20]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7, portal: 172.16.0.220,3260]
Dec 06 07:12:27 user nova-compute[75021]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7, portal: 172.16.0.220,3260] successful.
Dec 06 07:12:27 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:febfff55-7926-4e60-a4a1-c947e77f62c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[46649726-edbd-4926-b1fa-9d90f5c41fba]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] <== disconnect_volume: return (345ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:12:27 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Deleting instance files /opt/stack/data/nova/instances/a6c8e069-46ae-4069-b81e-364bad589ebf_del
Dec 06 07:12:27 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Deletion of /opt/stack/data/nova/instances/a6c8e069-46ae-4069-b81e-364bad589ebf_del complete
Dec 06 07:12:27 user nova-compute[75021]: INFO nova.compute.manager [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Took 3.44 seconds to destroy the instance on the hypervisor.
Dec 06 07:12:27 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:12:27 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:12:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-ee266600-66eb-4e1e-8552-7f868512497e req-98b003a2-305a-41e3-b0c2-fae49582e0e3 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-plugged-0fe07857-5428-4598-b751-b88ff51d7c18 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ee266600-66eb-4e1e-8552-7f868512497e req-98b003a2-305a-41e3-b0c2-fae49582e0e3 service nova] Acquiring lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ee266600-66eb-4e1e-8552-7f868512497e req-98b003a2-305a-41e3-b0c2-fae49582e0e3 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ee266600-66eb-4e1e-8552-7f868512497e req-98b003a2-305a-41e3-b0c2-fae49582e0e3 service nova] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-ee266600-66eb-4e1e-8552-7f868512497e req-98b003a2-305a-41e3-b0c2-fae49582e0e3 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] No waiting events found dispatching network-vif-plugged-0fe07857-5428-4598-b751-b88ff51d7c18 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:28 user nova-compute[75021]: WARNING nova.compute.manager [req-ee266600-66eb-4e1e-8552-7f868512497e req-98b003a2-305a-41e3-b0c2-fae49582e0e3 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received unexpected event network-vif-plugged-0fe07857-5428-4598-b751-b88ff51d7c18 for instance with vm_state active and task_state deleting.
Dec 06 07:12:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-e38a55ec-487b-4d54-871e-fc568b9a8a93 req-30933395-cdbb-41c8-8748-ff616eb221fe service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-deleted-cb1e15ad-aa13-4507-b83c-035a05d32268 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:29 user nova-compute[75021]: INFO nova.compute.manager [req-e38a55ec-487b-4d54-871e-fc568b9a8a93 req-30933395-cdbb-41c8-8748-ff616eb221fe service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Neutron deleted interface cb1e15ad-aa13-4507-b83c-035a05d32268; detaching it from the instance and deleting it from the info cache
Dec 06 07:12:29 user nova-compute[75021]: DEBUG nova.network.neutron [req-e38a55ec-487b-4d54-871e-fc568b9a8a93 req-30933395-cdbb-41c8-8748-ff616eb221fe service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updating instance_info_cache with network_info: [{"id": "07acf2eb-ace0-4ae1-b719-e179921b4283", "address": "fa:16:3e:19:ae:56", "network": {"id": "22ab25bd-67a1-4324-a7b4-8930fe53ac86", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-305871487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07acf2eb-ac", "ovs_interfaceid": "07acf2eb-ace0-4ae1-b719-e179921b4283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "address": "fa:16:3e:f5:54:25", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2b8ff7-15", "ovs_interfaceid": "3f2b8ff7-15fe-4def-a0d0-bee6f3f6a190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "address": "fa:16:3e:64:b5:e3", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5462413e-c2", "ovs_interfaceid": "5462413e-c273-42de-8ba8-1fde5c39c0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "address": "fa:16:3e:8e:dc:5b", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eaf5559-41", "ovs_interfaceid": "3eaf5559-41b4-4e36-85dc-dcfcde324aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b61841a9-756e-4ad4-b803-017c7bd985de", "address": "fa:16:3e:28:9f:3d", "network": {"id": "1d755613-7e2f-4bbb-b4cf-0d0d2135957c", "bridge": "br-int", "label": "tempest-device-tagging-net1-175109179", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb61841a9-75", "ovs_interfaceid": "b61841a9-756e-4ad4-b803-017c7bd985de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fe07857-5428-4598-b751-b88ff51d7c18", "address": "fa:16:3e:2f:4c:a3", "network": {"id": "ac205859-e685-4363-98db-558784812e98", "bridge": "br-int", "label": "tempest-device-tagging-net2-1256131676", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88e7a9eedb83455fab3446e497feae40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe07857-54", "ovs_interfaceid": "0fe07857-5428-4598-b751-b88ff51d7c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:12:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-e38a55ec-487b-4d54-871e-fc568b9a8a93 req-30933395-cdbb-41c8-8748-ff616eb221fe service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Detach interface failed, port_id=cb1e15ad-aa13-4507-b83c-035a05d32268, reason: Instance a6c8e069-46ae-4069-b81e-364bad589ebf could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 07:12:31 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:12:31 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Took 3.54 seconds to deallocate network for instance.
Dec 06 07:12:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-8b410bd0-d1d1-446b-bec5-d90b8da1f877 req-146d19cf-b1fe-4759-a52f-a47733b7dac4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-deleted-07acf2eb-ace0-4ae1-b719-e179921b4283 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-8b410bd0-d1d1-446b-bec5-d90b8da1f877 req-146d19cf-b1fe-4759-a52f-a47733b7dac4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-deleted-3eaf5559-41b4-4e36-85dc-dcfcde324aa8 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-8b410bd0-d1d1-446b-bec5-d90b8da1f877 req-146d19cf-b1fe-4759-a52f-a47733b7dac4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-deleted-b61841a9-756e-4ad4-b803-017c7bd985de {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-8b410bd0-d1d1-446b-bec5-d90b8da1f877 req-146d19cf-b1fe-4759-a52f-a47733b7dac4 service nova] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Received event network-vif-deleted-0fe07857-5428-4598-b751-b88ff51d7c18 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:34 user nova-compute[75021]: INFO nova.compute.manager [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] [instance: a6c8e069-46ae-4069-b81e-364bad589ebf] Took 2.55 seconds to detach 3 volumes for instance.
Dec 06 07:12:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:34 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:12:34 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:12:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:34 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Deleted allocations for instance a6c8e069-46ae-4069-b81e-364bad589ebf
Dec 06 07:12:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-68b7eecb-d849-4123-a5ab-bddac4ff5a68 tempest-TaggedBootDevicesTest_v242-1777802644 tempest-TaggedBootDevicesTest_v242-1777802644-project-member] Lock "a6c8e069-46ae-4069-b81e-364bad589ebf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.186s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:35 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 35da578f-dc7b-4038-869e-3d7528844bf0 is timed out.
Dec 06 07:12:35 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Successfully detached device vdb from instance 35da578f-dc7b-4038-869e-3d7528844bf0 from the live domain config.
Dec 06 07:12:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjJoqtPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:12:35 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f764ac-6290-4e85-860f-6543f6173b67]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:12:35 user nova-compute[75021]: No targets found.
Dec 06 07:12:35 user nova-compute[75021]: iSNS:
Dec 06 07:12:35 user nova-compute[75021]: No targets found.
Dec 06 07:12:35 user nova-compute[75021]: STATIC:
Dec 06 07:12:35 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a
Dec 06 07:12:35 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:35 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:35 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:12:35 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:35 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:35 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3
Dec 06 07:12:35 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:35 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:35 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30
Dec 06 07:12:35 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:35 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:35 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b
Dec 06 07:12:35 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:35 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:35 user nova-compute[75021]: FIRMWARE:
Dec 06 07:12:35 user nova-compute[75021]: No targets found.
Dec 06 07:12:35 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:12:35 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:12:35 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7abe17-6122-4750-9ae3-89462e6dc49d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9d92fc-c9dc-4668-9d41-8e23940384fe]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:12:35 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:12:35 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:12:35 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:12:35 user nova-compute[75021]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 (non-flash)
Dec 06 07:12:35 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:12:35 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:12:35 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:12:35 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:12:35 user nova-compute[75021]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 (non-flash)
Dec 06 07:12:35 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b47736d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3'): ({'sdi'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Removing single pathed devices sdi {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2136f6c5-550b-4750-9588-1b8a6600b020]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3194f4-294e-45d0-a109-51c10f3ad8cf]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Flushing IO for device /dev/sdi {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ab53a0-2d55-442b-9860-ba3fba2f54e2]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.049s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc3bd76-b621-4cc9-a768-931503bde359]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] SCSI volumes sdi have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b51e08-3708-4651-bfea-92de04b167da]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab2dcb8-8a39-4a26-96bf-e2d7ca19d7b6]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3, portal: 172.16.0.220,3260]
Dec 06 07:12:35 user nova-compute[75021]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3, portal: 172.16.0.220,3260] successful.
Dec 06 07:12:35 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b0ead6-94ee-4e0c-9106-7feb94491453]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] <== disconnect_volume: return (355ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:12:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lazy-loading 'flavor' on Instance uuid 35da578f-dc7b-4038-869e-3d7528844bf0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9ba90962-dfd5-4ca6-9fb2-1908e5246c8c tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "35da578f-dc7b-4038-869e-3d7528844bf0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.745s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "35da578f-dc7b-4038-869e-3d7528844bf0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.617s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "35da578f-dc7b-4038-869e-3d7528844bf0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "35da578f-dc7b-4038-869e-3d7528844bf0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "35da578f-dc7b-4038-869e-3d7528844bf0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:36 user nova-compute[75021]: INFO nova.compute.manager [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Terminating instance
Dec 06 07:12:36 user nova-compute[75021]: DEBUG nova.compute.manager [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-70271ebe-ae72-4fd6-a7ed-4a94f5441f1c req-e9bae7a4-2100-486b-a0c4-9cbe62cc8b6f service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Received event network-vif-unplugged-f2029bf5-89e2-4759-90a2-a17f8721653c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-70271ebe-ae72-4fd6-a7ed-4a94f5441f1c req-e9bae7a4-2100-486b-a0c4-9cbe62cc8b6f service nova] Acquiring lock "35da578f-dc7b-4038-869e-3d7528844bf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-70271ebe-ae72-4fd6-a7ed-4a94f5441f1c req-e9bae7a4-2100-486b-a0c4-9cbe62cc8b6f service nova] Lock "35da578f-dc7b-4038-869e-3d7528844bf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-70271ebe-ae72-4fd6-a7ed-4a94f5441f1c req-e9bae7a4-2100-486b-a0c4-9cbe62cc8b6f service nova] Lock "35da578f-dc7b-4038-869e-3d7528844bf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-70271ebe-ae72-4fd6-a7ed-4a94f5441f1c req-e9bae7a4-2100-486b-a0c4-9cbe62cc8b6f service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] No waiting events found dispatching network-vif-unplugged-f2029bf5-89e2-4759-90a2-a17f8721653c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-70271ebe-ae72-4fd6-a7ed-4a94f5441f1c req-e9bae7a4-2100-486b-a0c4-9cbe62cc8b6f service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Received event network-vif-unplugged-f2029bf5-89e2-4759-90a2-a17f8721653c for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:12:37 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Instance destroyed successfully.
Dec 06 07:12:37 user nova-compute[75021]: DEBUG nova.objects.instance [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lazy-loading 'resources' on Instance uuid 35da578f-dc7b-4038-869e-3d7528844bf0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:09:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-594079257',display_name='tempest-VolumesSnapshotTestJSON-instance-594079257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-594079257',id=28,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8hbyTR4tkK7wWHpweEPc08jsEncPc9TJh9OoWvv8ggc3jVq8g6TIEI+Z9TA40DLVfcwfcw60FATuR9MBnUNcmmmJmWcy77LX/LYnY0xrPsARE57xk22UzytdnDJeVKdg==',key_name='tempest-keypair-136075890',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:09:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d731b9dfe44549609091c48e8d19a1e9',ramdisk_id='',reservation_id='r-esca31v4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-591172318',owner_user_name='tempest-VolumesSnapshotTestJSON-591172318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b72f254ecf4447b4fcaada0ce327d6',uuid=35da578f-dc7b-4038-869e-3d7528844bf0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2029bf5-89e2-4759-90a2-a17f8721653c", "address": "fa:16:3e:74:63:fb", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2029bf5-89", "ovs_interfaceid": "f2029bf5-89e2-4759-90a2-a17f8721653c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Converting VIF {"id": "f2029bf5-89e2-4759-90a2-a17f8721653c", "address": "fa:16:3e:74:63:fb", "network": {"id": "a9cc5472-9cbe-42f2-bae2-532a8daa36e9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-443495687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d731b9dfe44549609091c48e8d19a1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2029bf5-89", "ovs_interfaceid": "f2029bf5-89e2-4759-90a2-a17f8721653c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:63:fb,bridge_name='br-int',has_traffic_filtering=True,id=f2029bf5-89e2-4759-90a2-a17f8721653c,network=Network(a9cc5472-9cbe-42f2-bae2-532a8daa36e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2029bf5-89') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG os_vif [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:63:fb,bridge_name='br-int',has_traffic_filtering=True,id=f2029bf5-89e2-4759-90a2-a17f8721653c,network=Network(a9cc5472-9cbe-42f2-bae2-532a8daa36e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2029bf5-89') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2029bf5-89, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7d3a268-a7e2-4f88-9eb2-edfc414259a9) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:37 user nova-compute[75021]: INFO os_vif [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:63:fb,bridge_name='br-int',has_traffic_filtering=True,id=f2029bf5-89e2-4759-90a2-a17f8721653c,network=Network(a9cc5472-9cbe-42f2-bae2-532a8daa36e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2029bf5-89')
Dec 06 07:12:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjJoqtPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:12:37 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:12:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4141faf-c866-49f4-8bdf-d67a5781407f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:12:37 user nova-compute[75021]: No targets found.
Dec 06 07:12:37 user nova-compute[75021]: iSNS:
Dec 06 07:12:37 user nova-compute[75021]: No targets found.
Dec 06 07:12:37 user nova-compute[75021]: STATIC:
Dec 06 07:12:37 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a
Dec 06 07:12:37 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:37 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:37 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:12:37 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:37 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:37 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30
Dec 06 07:12:37 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:37 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:37 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b
Dec 06 07:12:37 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:37 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:37 user nova-compute[75021]: FIRMWARE:
Dec 06 07:12:37 user nova-compute[75021]: No targets found.
Dec 06 07:12:37 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:12:37 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:12:37 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7458a77-a9fe-4c77-8435-01f0765dbbf3', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[342523dc-67e4-438d-a660-3b957d4a7c51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a22ff4-9b18-499d-92e6-14150dcb1e80]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:12:37 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:12:37 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:12:37 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:12:37 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:12:37 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:12:37 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:12:37 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:12:37 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d866fd90>, {}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Disconnecting from: [] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] <== disconnect_volume: return (80ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:12:37 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Deleting instance files /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0_del
Dec 06 07:12:37 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Deletion of /opt/stack/data/nova/instances/35da578f-dc7b-4038-869e-3d7528844bf0_del complete
Dec 06 07:12:37 user nova-compute[75021]: INFO nova.compute.manager [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Took 0.92 seconds to destroy the instance on the hypervisor.
Dec 06 07:12:37 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:12:37 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:12:38 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:12:38 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Took 0.96 seconds to deallocate network for instance.
Dec 06 07:12:38 user nova-compute[75021]: WARNING nova.volume.cinder [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Attachment c6e6b9a9-f18b-4c74-958e-1a71a2e13a33 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c6e6b9a9-f18b-4c74-958e-1a71a2e13a33. (HTTP 404) (Request-ID: req-d13da40d-a88b-4418-a056-a46839f21140)
Dec 06 07:12:38 user nova-compute[75021]: INFO nova.compute.manager [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Took 0.02 seconds to detach 1 volumes for instance.
Dec 06 07:12:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:38 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:12:38 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:12:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-2314cb43-294a-40bb-bf01-fc7217bf6f81 req-440380ca-8eca-4c5c-ae71-55711c76c653 service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Received event network-vif-plugged-f2029bf5-89e2-4759-90a2-a17f8721653c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2314cb43-294a-40bb-bf01-fc7217bf6f81 req-440380ca-8eca-4c5c-ae71-55711c76c653 service nova] Acquiring lock "35da578f-dc7b-4038-869e-3d7528844bf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:12:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2314cb43-294a-40bb-bf01-fc7217bf6f81 req-440380ca-8eca-4c5c-ae71-55711c76c653 service nova] Lock "35da578f-dc7b-4038-869e-3d7528844bf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:12:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2314cb43-294a-40bb-bf01-fc7217bf6f81 req-440380ca-8eca-4c5c-ae71-55711c76c653 service nova] Lock "35da578f-dc7b-4038-869e-3d7528844bf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-2314cb43-294a-40bb-bf01-fc7217bf6f81 req-440380ca-8eca-4c5c-ae71-55711c76c653 service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] No waiting events found dispatching network-vif-plugged-f2029bf5-89e2-4759-90a2-a17f8721653c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:12:38 user nova-compute[75021]: WARNING nova.compute.manager [req-2314cb43-294a-40bb-bf01-fc7217bf6f81 req-440380ca-8eca-4c5c-ae71-55711c76c653 service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Received unexpected event network-vif-plugged-f2029bf5-89e2-4759-90a2-a17f8721653c for instance with vm_state deleted and task_state None.
Dec 06 07:12:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-2314cb43-294a-40bb-bf01-fc7217bf6f81 req-440380ca-8eca-4c5c-ae71-55711c76c653 service nova] [instance: 35da578f-dc7b-4038-869e-3d7528844bf0] Received event network-vif-deleted-f2029bf5-89e2-4759-90a2-a17f8721653c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:12:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:38 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Deleted allocations for instance 35da578f-dc7b-4038-869e-3d7528844bf0
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8e873836-e22f-4421-8c2f-3c06de2af33d tempest-VolumesSnapshotTestJSON-591172318 tempest-VolumesSnapshotTestJSON-591172318-project-member] Lock "35da578f-dc7b-4038-869e-3d7528844bf0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.498s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:39 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a is timed out.
Dec 06 07:12:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Successfully detached device vdb from instance bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a from the live domain config.
Dec 06 07:12:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQPmIpsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:12:39 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[482d68fb-e661-48e5-b136-bcc314cb0c47]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:12:39 user nova-compute[75021]: No targets found.
Dec 06 07:12:39 user nova-compute[75021]: iSNS:
Dec 06 07:12:39 user nova-compute[75021]: No targets found.
Dec 06 07:12:39 user nova-compute[75021]: STATIC:
Dec 06 07:12:39 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a
Dec 06 07:12:39 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:39 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:39 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:12:39 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:39 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:39 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30
Dec 06 07:12:39 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:39 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:39 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b
Dec 06 07:12:39 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:12:39 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:12:39 user nova-compute[75021]: FIRMWARE:
Dec 06 07:12:39 user nova-compute[75021]: No targets found.
Dec 06 07:12:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:12:39 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:12:39 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc14261-722f-49e5-b354-4c8c92a95c60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a8d576-d66e-41f3-8d51-ddc37f95a5ef]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:12:39 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:12:39 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:12:39 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:12:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:12:39 user nova-compute[75021]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b (non-flash)
Dec 06 07:12:39 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:12:39 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:12:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b4683910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b'): ({'sdc'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Removing single pathed devices sdc {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5023fe64-ef28-4f71-ad5f-d37531a83bf6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8591e33d-bee2-4d8c-bad4-f8c73671d450]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Flushing IO for device /dev/sdc {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbaa48a-21db-4a75-b17e-93104e33573d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9188c6-7fab-4d1f-989e-8b903104c183]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bbce90-f303-465d-b866-039be4a70909]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e30b90f-9ab0-4d5e-baa8-45ff9f7a9989]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260]
Dec 06 07:12:39 user nova-compute[75021]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b, portal: 172.16.0.220,3260] successful.
Dec 06 07:12:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa85e8a-1642-438b-9d04-aa5ca22d3d5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[89da35e4-b09f-4ff0-9ecb-e6862b422955]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] <== disconnect_volume: return (351ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:12:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:12:40 user nova-compute[75021]: DEBUG nova.objects.instance [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lazy-loading 'flavor' on Instance uuid bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:12:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-310bd97e-4760-4ded-899e-c03c155228ba tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.845s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:12:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:12:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:12:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:12:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:12:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:12:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:12:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:13:02 user nova-compute[75021]: INFO nova.compute.claims [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Claim successful on node user
Dec 06 07:13:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG nova.network.neutron [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:13:02 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:13:02 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG nova.policy [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0774aa1e3ee4b69b195b575d116ee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9895e43bf76d4760a26a5e64ea6d4e14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:13:02 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Creating image(s)
Dec 06 07:13:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "/opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "/opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "/opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk 1073741824" returned: 0 in 0.062s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Successfully created port: 8d305221-2e91-46cc-99d8-428d63a55a80 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.203s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Cannot resize image /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Ensure instance console log exists: /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Successfully updated port: 8d305221-2e91-46cc-99d8-428d63a55a80 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "refresh_cache-58ef39ae-4b66-42e6-ae22-5308a98eb55d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquired lock "refresh_cache-58ef39ae-4b66-42e6-ae22-5308a98eb55d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.network.neutron [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-b73a2f00-5d8b-4323-87fc-503620eff338 req-9c9dca79-ed38-4fa6-b220-7114438eb63f service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Received event network-changed-8d305221-2e91-46cc-99d8-428d63a55a80 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-b73a2f00-5d8b-4323-87fc-503620eff338 req-9c9dca79-ed38-4fa6-b220-7114438eb63f service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Refreshing instance network info cache due to event network-changed-8d305221-2e91-46cc-99d8-428d63a55a80. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b73a2f00-5d8b-4323-87fc-503620eff338 req-9c9dca79-ed38-4fa6-b220-7114438eb63f service nova] Acquiring lock "refresh_cache-58ef39ae-4b66-42e6-ae22-5308a98eb55d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.network.neutron [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.network.neutron [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Updating instance_info_cache with network_info: [{"id": "8d305221-2e91-46cc-99d8-428d63a55a80", "address": "fa:16:3e:e3:57:1d", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d305221-2e", "ovs_interfaceid": "8d305221-2e91-46cc-99d8-428d63a55a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Releasing lock "refresh_cache-58ef39ae-4b66-42e6-ae22-5308a98eb55d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Instance network_info: |[{"id": "8d305221-2e91-46cc-99d8-428d63a55a80", "address": "fa:16:3e:e3:57:1d", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d305221-2e", "ovs_interfaceid": "8d305221-2e91-46cc-99d8-428d63a55a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b73a2f00-5d8b-4323-87fc-503620eff338 req-9c9dca79-ed38-4fa6-b220-7114438eb63f service nova] Acquired lock "refresh_cache-58ef39ae-4b66-42e6-ae22-5308a98eb55d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.network.neutron [req-b73a2f00-5d8b-4323-87fc-503620eff338 req-9c9dca79-ed38-4fa6-b220-7114438eb63f service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Refreshing network info cache for port 8d305221-2e91-46cc-99d8-428d63a55a80 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Start _get_guest_xml network_info=[{"id": "8d305221-2e91-46cc-99d8-428d63a55a80", "address": "fa:16:3e:e3:57:1d", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d305221-2e", "ovs_interfaceid": "8d305221-2e91-46cc-99d8-428d63a55a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:13:04 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:13:04 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:13:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-184221298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-184221298',id=31,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9895e43bf76d4760a26a5e64ea6d4e14',ramdisk_id='',reservation_id='r-nkjflk1n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:13:03Z,user_data=None,user_id='c0774aa1e3ee4b69b195b575d116ee96',uuid=58ef39ae-4b66-42e6-ae22-5308a98eb55d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d305221-2e91-46cc-99d8-428d63a55a80", "address": "fa:16:3e:e3:57:1d", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d305221-2e", "ovs_interfaceid": "8d305221-2e91-46cc-99d8-428d63a55a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converting VIF {"id": "8d305221-2e91-46cc-99d8-428d63a55a80", "address": "fa:16:3e:e3:57:1d", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d305221-2e", "ovs_interfaceid": "8d305221-2e91-46cc-99d8-428d63a55a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:57:1d,bridge_name='br-int',has_traffic_filtering=True,id=8d305221-2e91-46cc-99d8-428d63a55a80,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d305221-2e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.objects.instance [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'pci_devices' on Instance uuid 58ef39ae-4b66-42e6-ae22-5308a98eb55d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:13:04 user nova-compute[75021]:   <uuid>58ef39ae-4b66-42e6-ae22-5308a98eb55d</uuid>
Dec 06 07:13:04 user nova-compute[75021]:   <name>instance-0000001f</name>
Dec 06 07:13:04 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:13:04 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:13:04 user nova-compute[75021]:   <metadata>
Dec 06 07:13:04 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:13:04 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:13:04 user nova-compute[75021]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-184221298</nova:name>
Dec 06 07:13:04 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:13:04</nova:creationTime>
Dec 06 07:13:04 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:13:04 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:13:04 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:13:04 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:13:04 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:13:04 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:13:04 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:13:04 user nova-compute[75021]:       <nova:owner>
Dec 06 07:13:04 user nova-compute[75021]:         <nova:user uuid="c0774aa1e3ee4b69b195b575d116ee96">tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member</nova:user>
Dec 06 07:13:04 user nova-compute[75021]:         <nova:project uuid="9895e43bf76d4760a26a5e64ea6d4e14">tempest-ServerBootFromVolumeStableRescueTest-1272250883</nova:project>
Dec 06 07:13:04 user nova-compute[75021]:       </nova:owner>
Dec 06 07:13:04 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:13:04 user nova-compute[75021]:       <nova:ports>
Dec 06 07:13:04 user nova-compute[75021]:         <nova:port uuid="8d305221-2e91-46cc-99d8-428d63a55a80">
Dec 06 07:13:04 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 07:13:04 user nova-compute[75021]:         </nova:port>
Dec 06 07:13:04 user nova-compute[75021]:       </nova:ports>
Dec 06 07:13:04 user nova-compute[75021]:     </nova:instance>
Dec 06 07:13:04 user nova-compute[75021]:   </metadata>
Dec 06 07:13:04 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:13:04 user nova-compute[75021]:     <system>
Dec 06 07:13:04 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:13:04 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:13:04 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:13:04 user nova-compute[75021]:       <entry name="serial">58ef39ae-4b66-42e6-ae22-5308a98eb55d</entry>
Dec 06 07:13:04 user nova-compute[75021]:       <entry name="uuid">58ef39ae-4b66-42e6-ae22-5308a98eb55d</entry>
Dec 06 07:13:04 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:13:04 user nova-compute[75021]:     </system>
Dec 06 07:13:04 user nova-compute[75021]:   </sysinfo>
Dec 06 07:13:04 user nova-compute[75021]:   <os>
Dec 06 07:13:04 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:13:04 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:13:04 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:13:04 user nova-compute[75021]:   </os>
Dec 06 07:13:04 user nova-compute[75021]:   <features>
Dec 06 07:13:04 user nova-compute[75021]:     <acpi/>
Dec 06 07:13:04 user nova-compute[75021]:     <apic/>
Dec 06 07:13:04 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:13:04 user nova-compute[75021]:   </features>
Dec 06 07:13:04 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:13:04 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:13:04 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:13:04 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:13:04 user nova-compute[75021]:   </clock>
Dec 06 07:13:04 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:13:04 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:13:04 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:13:04 user nova-compute[75021]:   </cpu>
Dec 06 07:13:04 user nova-compute[75021]:   <devices>
Dec 06 07:13:04 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:13:04 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:13:04 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk"/>
Dec 06 07:13:04 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:13:04 user nova-compute[75021]:     </disk>
Dec 06 07:13:04 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:13:04 user nova-compute[75021]:       <mac address="fa:16:3e:e3:57:1d"/>
Dec 06 07:13:04 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:13:04 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:13:04 user nova-compute[75021]:       <target dev="tap8d305221-2e"/>
Dec 06 07:13:04 user nova-compute[75021]:     </interface>
Dec 06 07:13:04 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:13:04 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/console.log" append="off"/>
Dec 06 07:13:04 user nova-compute[75021]:     </serial>
Dec 06 07:13:04 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:13:04 user nova-compute[75021]:     <video>
Dec 06 07:13:04 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:13:04 user nova-compute[75021]:     </video>
Dec 06 07:13:04 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:13:04 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:13:04 user nova-compute[75021]:     </rng>
Dec 06 07:13:04 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:13:04 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:13:04 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:13:04 user nova-compute[75021]:     </memballoon>
Dec 06 07:13:04 user nova-compute[75021]:   </devices>
Dec 06 07:13:04 user nova-compute[75021]: </domain>
Dec 06 07:13:04 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:13:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-184221298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-184221298',id=31,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9895e43bf76d4760a26a5e64ea6d4e14',ramdisk_id='',reservation_id='r-nkjflk1n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:13:03Z,user_data=None,user_id='c0774aa1e3ee4b69b195b575d116ee96',uuid=58ef39ae-4b66-42e6-ae22-5308a98eb55d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d305221-2e91-46cc-99d8-428d63a55a80", "address": "fa:16:3e:e3:57:1d", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d305221-2e", "ovs_interfaceid": "8d305221-2e91-46cc-99d8-428d63a55a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converting VIF {"id": "8d305221-2e91-46cc-99d8-428d63a55a80", "address": "fa:16:3e:e3:57:1d", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d305221-2e", "ovs_interfaceid": "8d305221-2e91-46cc-99d8-428d63a55a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:57:1d,bridge_name='br-int',has_traffic_filtering=True,id=8d305221-2e91-46cc-99d8-428d63a55a80,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d305221-2e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG os_vif [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:57:1d,bridge_name='br-int',has_traffic_filtering=True,id=8d305221-2e91-46cc-99d8-428d63a55a80,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d305221-2e') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6a3d23b-a8f4-54c5-853f-92c5241cf8a2', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d305221-2e, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d305221-2e, col_values=(('qos', UUID('ec499d75-33a6-4c76-9ea0-94bdb4d75bcc')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d305221-2e, col_values=(('external_ids', {'iface-id': '8d305221-2e91-46cc-99d8-428d63a55a80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:57:1d', 'vm-uuid': '58ef39ae-4b66-42e6-ae22-5308a98eb55d'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:13:04 user nova-compute[75021]: INFO os_vif [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:57:1d,bridge_name='br-int',has_traffic_filtering=True,id=8d305221-2e91-46cc-99d8-428d63a55a80,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d305221-2e')
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] No VIF found with MAC fa:16:3e:e3:57:1d, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.network.neutron [req-b73a2f00-5d8b-4323-87fc-503620eff338 req-9c9dca79-ed38-4fa6-b220-7114438eb63f service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Updated VIF entry in instance network info cache for port 8d305221-2e91-46cc-99d8-428d63a55a80. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG nova.network.neutron [req-b73a2f00-5d8b-4323-87fc-503620eff338 req-9c9dca79-ed38-4fa6-b220-7114438eb63f service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Updating instance_info_cache with network_info: [{"id": "8d305221-2e91-46cc-99d8-428d63a55a80", "address": "fa:16:3e:e3:57:1d", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d305221-2e", "ovs_interfaceid": "8d305221-2e91-46cc-99d8-428d63a55a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b73a2f00-5d8b-4323-87fc-503620eff338 req-9c9dca79-ed38-4fa6-b220-7114438eb63f service nova] Releasing lock "refresh_cache-58ef39ae-4b66-42e6-ae22-5308a98eb55d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-1c3d1e11-7092-4432-a39d-9cd7dd94d247 req-3f70c8bd-4c93-460b-b500-3a0ee05cbf2d service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Received event network-vif-plugged-8d305221-2e91-46cc-99d8-428d63a55a80 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1c3d1e11-7092-4432-a39d-9cd7dd94d247 req-3f70c8bd-4c93-460b-b500-3a0ee05cbf2d service nova] Acquiring lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1c3d1e11-7092-4432-a39d-9cd7dd94d247 req-3f70c8bd-4c93-460b-b500-3a0ee05cbf2d service nova] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1c3d1e11-7092-4432-a39d-9cd7dd94d247 req-3f70c8bd-4c93-460b-b500-3a0ee05cbf2d service nova] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-1c3d1e11-7092-4432-a39d-9cd7dd94d247 req-3f70c8bd-4c93-460b-b500-3a0ee05cbf2d service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] No waiting events found dispatching network-vif-plugged-8d305221-2e91-46cc-99d8-428d63a55a80 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:13:06 user nova-compute[75021]: WARNING nova.compute.manager [req-1c3d1e11-7092-4432-a39d-9cd7dd94d247 req-3f70c8bd-4c93-460b-b500-3a0ee05cbf2d service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Received unexpected event network-vif-plugged-8d305221-2e91-46cc-99d8-428d63a55a80 for instance with vm_state building and task_state spawning.
Dec 06 07:13:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:13:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:13:08 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Instance spawned successfully.
Dec 06 07:13:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-c0ede414-a709-44a4-bd99-f8fcf0422327 req-8814ce8d-a086-44f2-9532-14f9878c837a service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Received event network-vif-plugged-8d305221-2e91-46cc-99d8-428d63a55a80 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c0ede414-a709-44a4-bd99-f8fcf0422327 req-8814ce8d-a086-44f2-9532-14f9878c837a service nova] Acquiring lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c0ede414-a709-44a4-bd99-f8fcf0422327 req-8814ce8d-a086-44f2-9532-14f9878c837a service nova] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c0ede414-a709-44a4-bd99-f8fcf0422327 req-8814ce8d-a086-44f2-9532-14f9878c837a service nova] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-c0ede414-a709-44a4-bd99-f8fcf0422327 req-8814ce8d-a086-44f2-9532-14f9878c837a service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] No waiting events found dispatching network-vif-plugged-8d305221-2e91-46cc-99d8-428d63a55a80 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:13:08 user nova-compute[75021]: WARNING nova.compute.manager [req-c0ede414-a709-44a4-bd99-f8fcf0422327 req-8814ce8d-a086-44f2-9532-14f9878c837a service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Received unexpected event network-vif-plugged-8d305221-2e91-46cc-99d8-428d63a55a80 for instance with vm_state building and task_state spawning.
Dec 06 07:13:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:13:08 user nova-compute[75021]: INFO nova.compute.manager [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Took 5.76 seconds to spawn the instance on the hypervisor.
Dec 06 07:13:08 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:08 user nova-compute[75021]: INFO nova.compute.manager [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Took 6.58 seconds to build instance.
Dec 06 07:13:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43c03477-b19b-4aa0-bc51-3539eb87c59f tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.683s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:13:09 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:13:09 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7756MB free_disk=25.160663604736328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:09 user nova-compute[75021]: INFO nova.compute.manager [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Terminating instance
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.manager [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 8b8eb320-6348-4038-a57e-02bf1e015174 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 0f5cb530-4025-4b9f-988e-c2877a61c9a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance c08cfdd8-44fc-4736-b5dd-d216c75afef6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 58ef39ae-4b66-42e6-ae22-5308a98eb55d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-4b9125c9-0b1d-4d82-84eb-f84c515d2380 req-6ee6d410-0617-423e-ab07-ff3639f03ec2 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received event network-vif-unplugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4b9125c9-0b1d-4d82-84eb-f84c515d2380 req-6ee6d410-0617-423e-ab07-ff3639f03ec2 service nova] Acquiring lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4b9125c9-0b1d-4d82-84eb-f84c515d2380 req-6ee6d410-0617-423e-ab07-ff3639f03ec2 service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4b9125c9-0b1d-4d82-84eb-f84c515d2380 req-6ee6d410-0617-423e-ab07-ff3639f03ec2 service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-4b9125c9-0b1d-4d82-84eb-f84c515d2380 req-6ee6d410-0617-423e-ab07-ff3639f03ec2 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] No waiting events found dispatching network-vif-unplugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-4b9125c9-0b1d-4d82-84eb-f84c515d2380 req-6ee6d410-0617-423e-ab07-ff3639f03ec2 service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received event network-vif-unplugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:13:09 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.748s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Instance destroyed successfully.
Dec 06 07:13:10 user nova-compute[75021]: DEBUG nova.objects.instance [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lazy-loading 'resources' on Instance uuid bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T07:07:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-539874617',display_name='tempest-ServerActionsTestOtherA-server-870482488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-539874617',id=23,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxMZDJearrqT1wUGZvs3O52CzZfwP1GjFMeARj7hE5D0gbwuEL8g69EQlk0/Gaz87I7q8l13RwvXJO8/uCJGPJUARCdsIZV2q0Xn5wU6S7uMKYYqJ1LfnAJ/jSYJUWTQA==',key_name='tempest-keypair-1224381594',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:09:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f011c1a70ac1465d8eb31e20850fdbad',ramdisk_id='',reservation_id='r-p5qweqeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1761792884',owner_user_name='tempest-ServerActionsTestOtherA-1761792884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:09:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3369c937ad24537a114a71eb4674750',uuid=bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converting VIF {"id": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "address": "fa:16:3e:11:9c:c0", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c80ab-da", "ovs_interfaceid": "6a9c80ab-da5d-4fd5-b757-3c09fa3c1563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:9c:c0,bridge_name='br-int',has_traffic_filtering=True,id=6a9c80ab-da5d-4fd5-b757-3c09fa3c1563,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c80ab-da') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG os_vif [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9c:c0,bridge_name='br-int',has_traffic_filtering=True,id=6a9c80ab-da5d-4fd5-b757-3c09fa3c1563,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c80ab-da') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a9c80ab-da, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3cb7e2c4-d83b-4aa0-a356-f63335294a29) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:10 user nova-compute[75021]: INFO os_vif [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9c:c0,bridge_name='br-int',has_traffic_filtering=True,id=6a9c80ab-da5d-4fd5-b757-3c09fa3c1563,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c80ab-da')
Dec 06 07:13:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Deleting instance files /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a_del
Dec 06 07:13:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Deletion of /opt/stack/data/nova/instances/bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a_del complete
Dec 06 07:13:10 user nova-compute[75021]: INFO nova.compute.manager [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Took 1.22 seconds to destroy the instance on the hypervisor.
Dec 06 07:13:10 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-aaeac8d1-d6bd-49df-9310-9c5c0b493816 req-f0234486-b49f-4d0a-b420-9aeb2496dea9 service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Received event network-changed-3896309e-3f41-410d-810f-7d794d93e155 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-aaeac8d1-d6bd-49df-9310-9c5c0b493816 req-f0234486-b49f-4d0a-b420-9aeb2496dea9 service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Refreshing instance network info cache due to event network-changed-3896309e-3f41-410d-810f-7d794d93e155. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-aaeac8d1-d6bd-49df-9310-9c5c0b493816 req-f0234486-b49f-4d0a-b420-9aeb2496dea9 service nova] Acquiring lock "refresh_cache-0f5cb530-4025-4b9f-988e-c2877a61c9a4" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-aaeac8d1-d6bd-49df-9310-9c5c0b493816 req-f0234486-b49f-4d0a-b420-9aeb2496dea9 service nova] Acquired lock "refresh_cache-0f5cb530-4025-4b9f-988e-c2877a61c9a4" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:13:10 user nova-compute[75021]: DEBUG nova.network.neutron [req-aaeac8d1-d6bd-49df-9310-9c5c0b493816 req-f0234486-b49f-4d0a-b420-9aeb2496dea9 service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Refreshing network info cache for port 3896309e-3f41-410d-810f-7d794d93e155 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Skipping network cache update for instance because it is being deleted. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid 4ffc6429-3f3c-4a7e-98e5-0db984266eae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:11 user nova-compute[75021]: INFO nova.compute.manager [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Terminating instance
Dec 06 07:13:11 user nova-compute[75021]: DEBUG nova.compute.manager [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG nova.network.neutron [req-aaeac8d1-d6bd-49df-9310-9c5c0b493816 req-f0234486-b49f-4d0a-b420-9aeb2496dea9 service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Updated VIF entry in instance network info cache for port 3896309e-3f41-410d-810f-7d794d93e155. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG nova.network.neutron [req-aaeac8d1-d6bd-49df-9310-9c5c0b493816 req-f0234486-b49f-4d0a-b420-9aeb2496dea9 service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Updating instance_info_cache with network_info: [{"id": "3896309e-3f41-410d-810f-7d794d93e155", "address": "fa:16:3e:e4:37:62", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3896309e-3f", "ovs_interfaceid": "3896309e-3f41-410d-810f-7d794d93e155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-aaeac8d1-d6bd-49df-9310-9c5c0b493816 req-f0234486-b49f-4d0a-b420-9aeb2496dea9 service nova] Releasing lock "refresh_cache-0f5cb530-4025-4b9f-988e-c2877a61c9a4" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:13:11 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Took 1.23 seconds to deallocate network for instance.
Dec 06 07:13:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-183f6894-6929-4988-92dc-80109547c4cb req-d7e2e908-3d8f-4a65-9f50-226c4819214e service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received event network-vif-deleted-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-2f348261-ca27-4c29-b817-54c06d6063a2 req-c42c2220-f806-493f-8605-5c6a4402a17e service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received event network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2f348261-ca27-4c29-b817-54c06d6063a2 req-c42c2220-f806-493f-8605-5c6a4402a17e service nova] Acquiring lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2f348261-ca27-4c29-b817-54c06d6063a2 req-c42c2220-f806-493f-8605-5c6a4402a17e service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2f348261-ca27-4c29-b817-54c06d6063a2 req-c42c2220-f806-493f-8605-5c6a4402a17e service nova] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-2f348261-ca27-4c29-b817-54c06d6063a2 req-c42c2220-f806-493f-8605-5c6a4402a17e service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] No waiting events found dispatching network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:13:11 user nova-compute[75021]: WARNING nova.compute.manager [req-2f348261-ca27-4c29-b817-54c06d6063a2 req-c42c2220-f806-493f-8605-5c6a4402a17e service nova] [instance: bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a] Received unexpected event network-vif-plugged-6a9c80ab-da5d-4fd5-b757-3c09fa3c1563 for instance with vm_state active and task_state deleting.
Dec 06 07:13:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:11 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Updating instance_info_cache with network_info: [{"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-4ffc6429-3f3c-4a7e-98e5-0db984266eae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:13:12 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Instance destroyed successfully.
Dec 06 07:13:12 user nova-compute[75021]: DEBUG nova.objects.instance [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'resources' on Instance uuid 0f5cb530-4025-4b9f-988e-c2877a61c9a4 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-646419153',display_name='tempest-AttachVolumeNegativeTest-server-646419153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-646419153',id=29,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO92eqPUrpRZilu6CKbyGRwaK7yCgNVnydlTKlwm7btQqJRBMBnWqIRRyBCAn54SG6imwVuHLkQrCFGZ9XYBk/4e5mfggQrdyQrySaWf22yGrp8JmLlDMoGXO8nh85PaPA==',key_name='tempest-keypair-471519478',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:11:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae65045cef754813bd33f68b9868dc9d',ramdisk_id='',reservation_id='r-q7kw38y8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-967416759',owner_user_name='tempest-AttachVolumeNegativeTest-967416759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e1155d2c304bdd8404712faf046b05',uuid=0f5cb530-4025-4b9f-988e-c2877a61c9a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3896309e-3f41-410d-810f-7d794d93e155", "address": "fa:16:3e:e4:37:62", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3896309e-3f", "ovs_interfaceid": "3896309e-3f41-410d-810f-7d794d93e155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converting VIF {"id": "3896309e-3f41-410d-810f-7d794d93e155", "address": "fa:16:3e:e4:37:62", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3896309e-3f", "ovs_interfaceid": "3896309e-3f41-410d-810f-7d794d93e155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:37:62,bridge_name='br-int',has_traffic_filtering=True,id=3896309e-3f41-410d-810f-7d794d93e155,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3896309e-3f') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG os_vif [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:37:62,bridge_name='br-int',has_traffic_filtering=True,id=3896309e-3f41-410d-810f-7d794d93e155,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3896309e-3f') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3896309e-3f, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53c1b0b2-44d7-4e6c-8056-1514a47857ad) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:12 user nova-compute[75021]: INFO os_vif [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:37:62,bridge_name='br-int',has_traffic_filtering=True,id=3896309e-3f41-410d-810f-7d794d93e155,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3896309e-3f')
Dec 06 07:13:12 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Deleting instance files /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4_del
Dec 06 07:13:12 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Deletion of /opt/stack/data/nova/instances/0f5cb530-4025-4b9f-988e-c2877a61c9a4_del complete
Dec 06 07:13:12 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:12 user nova-compute[75021]: INFO nova.compute.manager [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Took 0.96 seconds to destroy the instance on the hypervisor.
Dec 06 07:13:12 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:13:12 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Deleted allocations for instance bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a
Dec 06 07:13:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-69034a81-0b3b-4f8d-a5bb-33d79900934f tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "bcfd68e9-f8a3-4fe5-8cda-9230af0e2e2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.189s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-fd170672-ca39-47d5-aaa7-3e56ee63c0d9 req-4b4cd3bf-c936-422b-af74-468e25cff458 service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Received event network-vif-unplugged-3896309e-3f41-410d-810f-7d794d93e155 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fd170672-ca39-47d5-aaa7-3e56ee63c0d9 req-4b4cd3bf-c936-422b-af74-468e25cff458 service nova] Acquiring lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fd170672-ca39-47d5-aaa7-3e56ee63c0d9 req-4b4cd3bf-c936-422b-af74-468e25cff458 service nova] Lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fd170672-ca39-47d5-aaa7-3e56ee63c0d9 req-4b4cd3bf-c936-422b-af74-468e25cff458 service nova] Lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-fd170672-ca39-47d5-aaa7-3e56ee63c0d9 req-4b4cd3bf-c936-422b-af74-468e25cff458 service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] No waiting events found dispatching network-vif-unplugged-3896309e-3f41-410d-810f-7d794d93e155 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-fd170672-ca39-47d5-aaa7-3e56ee63c0d9 req-4b4cd3bf-c936-422b-af74-468e25cff458 service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Received event network-vif-unplugged-3896309e-3f41-410d-810f-7d794d93e155 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-fd170672-ca39-47d5-aaa7-3e56ee63c0d9 req-4b4cd3bf-c936-422b-af74-468e25cff458 service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Received event network-vif-plugged-3896309e-3f41-410d-810f-7d794d93e155 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fd170672-ca39-47d5-aaa7-3e56ee63c0d9 req-4b4cd3bf-c936-422b-af74-468e25cff458 service nova] Acquiring lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fd170672-ca39-47d5-aaa7-3e56ee63c0d9 req-4b4cd3bf-c936-422b-af74-468e25cff458 service nova] Lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fd170672-ca39-47d5-aaa7-3e56ee63c0d9 req-4b4cd3bf-c936-422b-af74-468e25cff458 service nova] Lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-fd170672-ca39-47d5-aaa7-3e56ee63c0d9 req-4b4cd3bf-c936-422b-af74-468e25cff458 service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] No waiting events found dispatching network-vif-plugged-3896309e-3f41-410d-810f-7d794d93e155 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:13:12 user nova-compute[75021]: WARNING nova.compute.manager [req-fd170672-ca39-47d5-aaa7-3e56ee63c0d9 req-4b4cd3bf-c936-422b-af74-468e25cff458 service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Received unexpected event network-vif-plugged-3896309e-3f41-410d-810f-7d794d93e155 for instance with vm_state active and task_state deleting.
Dec 06 07:13:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:13:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:13 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:13:13 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Took 1.60 seconds to deallocate network for instance.
Dec 06 07:13:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-eeafc241-9502-4102-a446-1aec0a3ad263 req-52dc8e7f-be37-4f05-8de9-0d2a5d90719f service nova] [instance: 0f5cb530-4025-4b9f-988e-c2877a61c9a4] Received event network-vif-deleted-3896309e-3f41-410d-810f-7d794d93e155 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:14 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:13:14 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:13:14 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:13:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:14 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Deleted allocations for instance 0f5cb530-4025-4b9f-988e-c2877a61c9a4
Dec 06 07:13:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4cf11781-9617-49a4-8a24-f623e8fcd73d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "0f5cb530-4025-4b9f-988e-c2877a61c9a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.288s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:17 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:13:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG nova.objects.instance [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lazy-loading 'flavor' on Instance uuid c08cfdd8-44fc-4736-b5dd-d216c75afef6 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.122s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:27 user nova-compute[75021]: INFO nova.compute.manager [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Attaching volume a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 to /dev/vdb
Dec 06 07:13:27 user nova-compute[75021]: DEBUG os_brick.utils [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfea66d-5b4f-4246-a2f2-c652fd008342]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4305fc9-efd7-4d29-9674-12f2592dd4d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[500c5169-4a90-42df-9239-977c22988b0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[41659f1a-c9ac-48df-8f3d-9476f7a0c43b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:13:27 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:13:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a86e3f-b2d0-4894-9999-c1b9e4652d70]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG os_brick.utils [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:13:27 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Updating existing volume attachment record: 4e101b7f-2110-4616-bf69-3c8946238a5e {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:13:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGMRQwfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:13:43 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:13:43 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:13:43 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f44eea-7fd9-418b-931a-629a0cdebc26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:13:43 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.121s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af4881a-d515-49f7-8f5e-d08810859dd4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8] added
Dec 06 07:13:43 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[959ecdb8-b8db-46bc-bb19-f901286a6384]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0fdac3-6feb-44b2-ad45-7b923e401eba]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGMRQwfi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGMRQwfi" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8d0b74-c831-44ba-8f1e-5601c0791050]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HGMRQwfi'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62f280c-6a89-4d72-a1eb-8d22d5fc5884]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f96782-0133-4b5c-812a-2a2d0d40bab2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:13:43 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:13:43 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:13:43 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:13:43 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:13:43 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:13:43 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2b9560-6d94-4638-82d5-de0bf901ff12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8, portal: 172.16.0.220,3260]
Dec 06 07:13:43 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8, portal: 172.16.0.220,3260] successful.
Dec 06 07:13:43 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b095a7-6f8d-47af-9764-f96db229b4c8]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fea859b-000d-4362-a27e-f8d74c5cbc93]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:13:43 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:13:43 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:13:43 user nova-compute[75021]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)
Dec 06 07:13:43 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:13:43 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:13:43 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:13:43 user nova-compute[75021]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)
Dec 06 07:13:43 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[286edba9-cba9-4fc4-91ad-326c56908995]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGMRQwfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-67ae3897-f343-4961-a195-cd32206ab398 req-53363243-a7b0-440b-8186-8da29cf6e0fe service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-changed-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-67ae3897-f343-4961-a195-cd32206ab398 req-53363243-a7b0-440b-8186-8da29cf6e0fe service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Refreshing instance network info cache due to event network-changed-2d2bc1b9-24cd-4992-93a5-e3638e21a35e. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-67ae3897-f343-4961-a195-cd32206ab398 req-53363243-a7b0-440b-8186-8da29cf6e0fe service nova] Acquiring lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-67ae3897-f343-4961-a195-cd32206ab398 req-53363243-a7b0-440b-8186-8da29cf6e0fe service nova] Acquired lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:13:43 user nova-compute[75021]: DEBUG nova.network.neutron [req-67ae3897-f343-4961-a195-cd32206ab398 req-53363243-a7b0-440b-8186-8da29cf6e0fe service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Refreshing network info cache for port 2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:13:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "8b8eb320-6348-4038-a57e-02bf1e015174" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:44 user nova-compute[75021]: INFO nova.compute.manager [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Detaching volume 1b160044-a407-4c86-8077-0e9284134d30
Dec 06 07:13:44 user nova-compute[75021]: INFO nova.virt.block_device [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Attempting to driver detach volume 1b160044-a407-4c86-8077-0e9284134d30 from mountpoint /dev/vdb
Dec 06 07:13:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Attempting to detach device vdb from instance 8b8eb320-6348-4038-a57e-02bf1e015174 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:13:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:13:44 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:13:44 user nova-compute[75021]:   <source dev="/dev/sde"/>
Dec 06 07:13:44 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:13:44 user nova-compute[75021]:   <serial>1b160044-a407-4c86-8077-0e9284134d30</serial>
Dec 06 07:13:44 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:13:44 user nova-compute[75021]: </disk>
Dec 06 07:13:44 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:13:44 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Successfully detached device vdb from instance 8b8eb320-6348-4038-a57e-02bf1e015174 from the persistent domain config.
Dec 06 07:13:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8b8eb320-6348-4038-a57e-02bf1e015174 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:13:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:13:44 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:13:44 user nova-compute[75021]:   <source dev="/dev/sde"/>
Dec 06 07:13:44 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:13:44 user nova-compute[75021]:   <serial>1b160044-a407-4c86-8077-0e9284134d30</serial>
Dec 06 07:13:44 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:13:44 user nova-compute[75021]: </disk>
Dec 06 07:13:44 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:13:44 user nova-compute[75021]: DEBUG nova.network.neutron [req-67ae3897-f343-4961-a195-cd32206ab398 req-53363243-a7b0-440b-8186-8da29cf6e0fe service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Updated VIF entry in instance network info cache for port 2d2bc1b9-24cd-4992-93a5-e3638e21a35e. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:13:44 user nova-compute[75021]: DEBUG nova.network.neutron [req-67ae3897-f343-4961-a195-cd32206ab398 req-53363243-a7b0-440b-8186-8da29cf6e0fe service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Updating instance_info_cache with network_info: [{"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:13:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-67ae3897-f343-4961-a195-cd32206ab398 req-53363243-a7b0-440b-8186-8da29cf6e0fe service nova] Releasing lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:13:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:13:44 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '23566383765393930', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:13:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566383765393930', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:13:44 user nova-compute[75021]: DEBUG nova.objects.instance [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lazy-loading 'flavor' on Instance uuid c08cfdd8-44fc-4736-b5dd-d216c75afef6 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:13:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:13:44 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:13:44 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:13:44 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:13:44 user nova-compute[75021]:   <serial>a8d959d0-5cf0-41ee-bfd5-1341589a9ee8</serial>
Dec 06 07:13:44 user nova-compute[75021]: </disk>
Dec 06 07:13:44 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:13:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8b8eb320-6348-4038-a57e-02bf1e015174 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:13:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:13:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:13:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] No VIF found with MAC fa:16:3e:39:da:e2, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:13:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c8a92460-fe4a-4ee8-9267-5a925a0f6d27 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.278s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-5d92e002-f36a-4eb1-a594-f0a6fbe329a5 req-5a597314-5d4f-4e64-b333-bfb0c45edddd service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-changed-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-5d92e002-f36a-4eb1-a594-f0a6fbe329a5 req-5a597314-5d4f-4e64-b333-bfb0c45edddd service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Refreshing instance network info cache due to event network-changed-2d2bc1b9-24cd-4992-93a5-e3638e21a35e. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:13:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5d92e002-f36a-4eb1-a594-f0a6fbe329a5 req-5a597314-5d4f-4e64-b333-bfb0c45edddd service nova] Acquiring lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:13:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5d92e002-f36a-4eb1-a594-f0a6fbe329a5 req-5a597314-5d4f-4e64-b333-bfb0c45edddd service nova] Acquired lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:13:45 user nova-compute[75021]: DEBUG nova.network.neutron [req-5d92e002-f36a-4eb1-a594-f0a6fbe329a5 req-5a597314-5d4f-4e64-b333-bfb0c45edddd service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Refreshing network info cache for port 2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:13:46 user nova-compute[75021]: DEBUG nova.network.neutron [req-5d92e002-f36a-4eb1-a594-f0a6fbe329a5 req-5a597314-5d4f-4e64-b333-bfb0c45edddd service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Updated VIF entry in instance network info cache for port 2d2bc1b9-24cd-4992-93a5-e3638e21a35e. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:13:46 user nova-compute[75021]: DEBUG nova.network.neutron [req-5d92e002-f36a-4eb1-a594-f0a6fbe329a5 req-5a597314-5d4f-4e64-b333-bfb0c45edddd service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Updating instance_info_cache with network_info: [{"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:13:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5d92e002-f36a-4eb1-a594-f0a6fbe329a5 req-5a597314-5d4f-4e64-b333-bfb0c45edddd service nova] Releasing lock "refresh_cache-8b8eb320-6348-4038-a57e-02bf1e015174" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:13:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-ef8a46fb-0693-407c-971b-10912cbb5198 req-4098047e-9956-4ba8-8037-17a4eadfe809 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received event network-changed-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-ef8a46fb-0693-407c-971b-10912cbb5198 req-4098047e-9956-4ba8-8037-17a4eadfe809 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Refreshing instance network info cache due to event network-changed-1edcce6c-0464-4647-acec-43b63a19fec3. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:13:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ef8a46fb-0693-407c-971b-10912cbb5198 req-4098047e-9956-4ba8-8037-17a4eadfe809 service nova] Acquiring lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:13:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ef8a46fb-0693-407c-971b-10912cbb5198 req-4098047e-9956-4ba8-8037-17a4eadfe809 service nova] Acquired lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:13:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-ef8a46fb-0693-407c-971b-10912cbb5198 req-4098047e-9956-4ba8-8037-17a4eadfe809 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Refreshing network info cache for port 1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:13:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-ef8a46fb-0693-407c-971b-10912cbb5198 req-4098047e-9956-4ba8-8037-17a4eadfe809 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Updated VIF entry in instance network info cache for port 1edcce6c-0464-4647-acec-43b63a19fec3. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:13:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-ef8a46fb-0693-407c-971b-10912cbb5198 req-4098047e-9956-4ba8-8037-17a4eadfe809 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Updating instance_info_cache with network_info: [{"id": "1edcce6c-0464-4647-acec-43b63a19fec3", "address": "fa:16:3e:39:da:e2", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1edcce6c-04", "ovs_interfaceid": "1edcce6c-0464-4647-acec-43b63a19fec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:13:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ef8a46fb-0693-407c-971b-10912cbb5198 req-4098047e-9956-4ba8-8037-17a4eadfe809 service nova] Releasing lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:13:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-f8dbc527-d5df-4db4-94de-0cde95a448a8 req-5e286a52-6c54-42ca-8306-a08c2a1f90b5 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received event network-changed-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-f8dbc527-d5df-4db4-94de-0cde95a448a8 req-5e286a52-6c54-42ca-8306-a08c2a1f90b5 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Refreshing instance network info cache due to event network-changed-1edcce6c-0464-4647-acec-43b63a19fec3. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:13:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f8dbc527-d5df-4db4-94de-0cde95a448a8 req-5e286a52-6c54-42ca-8306-a08c2a1f90b5 service nova] Acquiring lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:13:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f8dbc527-d5df-4db4-94de-0cde95a448a8 req-5e286a52-6c54-42ca-8306-a08c2a1f90b5 service nova] Acquired lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:13:52 user nova-compute[75021]: DEBUG nova.network.neutron [req-f8dbc527-d5df-4db4-94de-0cde95a448a8 req-5e286a52-6c54-42ca-8306-a08c2a1f90b5 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Refreshing network info cache for port 1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:13:53 user nova-compute[75021]: DEBUG nova.network.neutron [req-f8dbc527-d5df-4db4-94de-0cde95a448a8 req-5e286a52-6c54-42ca-8306-a08c2a1f90b5 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Updated VIF entry in instance network info cache for port 1edcce6c-0464-4647-acec-43b63a19fec3. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:13:53 user nova-compute[75021]: DEBUG nova.network.neutron [req-f8dbc527-d5df-4db4-94de-0cde95a448a8 req-5e286a52-6c54-42ca-8306-a08c2a1f90b5 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Updating instance_info_cache with network_info: [{"id": "1edcce6c-0464-4647-acec-43b63a19fec3", "address": "fa:16:3e:39:da:e2", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1edcce6c-04", "ovs_interfaceid": "1edcce6c-0464-4647-acec-43b63a19fec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:13:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f8dbc527-d5df-4db4-94de-0cde95a448a8 req-5e286a52-6c54-42ca-8306-a08c2a1f90b5 service nova] Releasing lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:13:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fcf6190e-1b74-4ee2-9865-a98021062e0d tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fcf6190e-1b74-4ee2-9865-a98021062e0d tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:53 user nova-compute[75021]: INFO nova.compute.manager [None req-fcf6190e-1b74-4ee2-9865-a98021062e0d tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Rebooting instance
Dec 06 07:13:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fcf6190e-1b74-4ee2-9865-a98021062e0d tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:13:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fcf6190e-1b74-4ee2-9865-a98021062e0d tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquired lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:13:53 user nova-compute[75021]: DEBUG nova.network.neutron [None req-fcf6190e-1b74-4ee2-9865-a98021062e0d tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:13:54 user nova-compute[75021]: DEBUG nova.network.neutron [None req-fcf6190e-1b74-4ee2-9865-a98021062e0d tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Updating instance_info_cache with network_info: [{"id": "1edcce6c-0464-4647-acec-43b63a19fec3", "address": "fa:16:3e:39:da:e2", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1edcce6c-04", "ovs_interfaceid": "1edcce6c-0464-4647-acec-43b63a19fec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:13:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fcf6190e-1b74-4ee2-9865-a98021062e0d tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Releasing lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:13:54 user nova-compute[75021]: DEBUG nova.compute.manager [None req-fcf6190e-1b74-4ee2-9865-a98021062e0d tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:13:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Acquiring lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:55 user nova-compute[75021]: DEBUG nova.compute.manager [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:13:56 user nova-compute[75021]: INFO nova.compute.claims [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Claim successful on node user
Dec 06 07:13:56 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG nova.network.neutron [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:13:56 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:13:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG nova.compute.manager [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:13:56 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Creating image(s)
Dec 06 07:13:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "/opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "/opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.200s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG nova.policy [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9dd157c8c515451e8c42bf3f680e06e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091460ed1e440eb8a804df83ceb0f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk 1073741824" returned: 0 in 0.056s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.226s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Cannot resize image /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Ensure instance console log exists: /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:57 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-fcf6190e-1b74-4ee2-9865-a98021062e0d tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Instance shutdown successfully.
Dec 06 07:13:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG nova.network.neutron [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Successfully created port: 15808503-611b-40de-a90c-0275293306ff {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:57 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:13:57 user nova-compute[75021]: INFO nova.compute.claims [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Claim successful on node user
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.network.neutron [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:13:58 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-fb14d4f1-948f-4cf8-8924-586d1e458c23 req-9bc1799c-c378-4111-b43c-42bc7069ec74 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received event network-vif-unplugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fb14d4f1-948f-4cf8-8924-586d1e458c23 req-9bc1799c-c378-4111-b43c-42bc7069ec74 service nova] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fb14d4f1-948f-4cf8-8924-586d1e458c23 req-9bc1799c-c378-4111-b43c-42bc7069ec74 service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fb14d4f1-948f-4cf8-8924-586d1e458c23 req-9bc1799c-c378-4111-b43c-42bc7069ec74 service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-fb14d4f1-948f-4cf8-8924-586d1e458c23 req-9bc1799c-c378-4111-b43c-42bc7069ec74 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] No waiting events found dispatching network-vif-unplugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:13:58 user nova-compute[75021]: WARNING nova.compute.manager [req-fb14d4f1-948f-4cf8-8924-586d1e458c23 req-9bc1799c-c378-4111-b43c-42bc7069ec74 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received unexpected event network-vif-unplugged-1edcce6c-0464-4647-acec-43b63a19fec3 for instance with vm_state active and task_state reboot_started.
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.policy [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9947f4c20feb463fb485de2a7d4bbef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a2ff3d04db4832a990891c79df356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:13:58 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Creating image(s)
Dec 06 07:13:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "/opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "/opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.network.neutron [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Successfully updated port: 15808503-611b-40de-a90c-0275293306ff {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Acquiring lock "refresh_cache-5c88eb99-a014-4ff2-86e7-2d34683cd67c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Acquired lock "refresh_cache-5c88eb99-a014-4ff2-86e7-2d34683cd67c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.network.neutron [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-cbff4327-fc44-4ae3-a0c1-d2676ef1934f req-9de54f1b-276d-455a-9a74-9addf5e4f652 service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Received event network-changed-15808503-611b-40de-a90c-0275293306ff {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-cbff4327-fc44-4ae3-a0c1-d2676ef1934f req-9de54f1b-276d-455a-9a74-9addf5e4f652 service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Refreshing instance network info cache due to event network-changed-15808503-611b-40de-a90c-0275293306ff. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cbff4327-fc44-4ae3-a0c1-d2676ef1934f req-9de54f1b-276d-455a-9a74-9addf5e4f652 service nova] Acquiring lock "refresh_cache-5c88eb99-a014-4ff2-86e7-2d34683cd67c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG nova.network.neutron [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.231s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:58 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.232s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk 1073741824" returned: 0 in 0.077s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.network.neutron [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Updating instance_info_cache with network_info: [{"id": "15808503-611b-40de-a90c-0275293306ff", "address": "fa:16:3e:d0:b0:31", "network": {"id": "fd50bddc-4523-4213-9284-9c538352a85b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4d272cf95f0431d87ca72a2872f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15808503-61", "ovs_interfaceid": "15808503-611b-40de-a90c-0275293306ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Releasing lock "refresh_cache-5c88eb99-a014-4ff2-86e7-2d34683cd67c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Instance network_info: |[{"id": "15808503-611b-40de-a90c-0275293306ff", "address": "fa:16:3e:d0:b0:31", "network": {"id": "fd50bddc-4523-4213-9284-9c538352a85b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4d272cf95f0431d87ca72a2872f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15808503-61", "ovs_interfaceid": "15808503-611b-40de-a90c-0275293306ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cbff4327-fc44-4ae3-a0c1-d2676ef1934f req-9de54f1b-276d-455a-9a74-9addf5e4f652 service nova] Acquired lock "refresh_cache-5c88eb99-a014-4ff2-86e7-2d34683cd67c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.network.neutron [req-cbff4327-fc44-4ae3-a0c1-d2676ef1934f req-9de54f1b-276d-455a-9a74-9addf5e4f652 service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Refreshing network info cache for port 15808503-611b-40de-a90c-0275293306ff {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Start _get_guest_xml network_info=[{"id": "15808503-611b-40de-a90c-0275293306ff", "address": "fa:16:3e:d0:b0:31", "network": {"id": "fd50bddc-4523-4213-9284-9c538352a85b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4d272cf95f0431d87ca72a2872f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15808503-61", "ovs_interfaceid": "15808503-611b-40de-a90c-0275293306ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:13:59 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:13:59 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1581071268',display_name='tempest-VolumesNegativeTest-instance-1581071268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1581071268',id=32,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f091460ed1e440eb8a804df83ceb0f43',ramdisk_id='',reservation_id='r-kyqjbkde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1729588497',owner_user_name='tempest-VolumesNegativeTest-1729588497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:13:57Z,user_data=None,user_id='9dd157c8c515451e8c42bf3f680e06e2',uuid=5c88eb99-a014-4ff2-86e7-2d34683cd67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15808503-611b-40de-a90c-0275293306ff", "address": "fa:16:3e:d0:b0:31", "network": {"id": "fd50bddc-4523-4213-9284-9c538352a85b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4d272cf95f0431d87ca72a2872f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15808503-61", "ovs_interfaceid": "15808503-611b-40de-a90c-0275293306ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Converting VIF {"id": "15808503-611b-40de-a90c-0275293306ff", "address": "fa:16:3e:d0:b0:31", "network": {"id": "fd50bddc-4523-4213-9284-9c538352a85b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4d272cf95f0431d87ca72a2872f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15808503-61", "ovs_interfaceid": "15808503-611b-40de-a90c-0275293306ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b0:31,bridge_name='br-int',has_traffic_filtering=True,id=15808503-611b-40de-a90c-0275293306ff,network=Network(fd50bddc-4523-4213-9284-9c538352a85b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15808503-61') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.objects.instance [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c88eb99-a014-4ff2-86e7-2d34683cd67c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.207s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:13:59 user nova-compute[75021]:   <uuid>5c88eb99-a014-4ff2-86e7-2d34683cd67c</uuid>
Dec 06 07:13:59 user nova-compute[75021]:   <name>instance-00000020</name>
Dec 06 07:13:59 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:13:59 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:13:59 user nova-compute[75021]:   <metadata>
Dec 06 07:13:59 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:13:59 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:13:59 user nova-compute[75021]:       <nova:name>tempest-VolumesNegativeTest-instance-1581071268</nova:name>
Dec 06 07:13:59 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:13:59</nova:creationTime>
Dec 06 07:13:59 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:13:59 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:13:59 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:13:59 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:13:59 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:13:59 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:13:59 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:13:59 user nova-compute[75021]:       <nova:owner>
Dec 06 07:13:59 user nova-compute[75021]:         <nova:user uuid="9dd157c8c515451e8c42bf3f680e06e2">tempest-VolumesNegativeTest-1729588497-project-member</nova:user>
Dec 06 07:13:59 user nova-compute[75021]:         <nova:project uuid="f091460ed1e440eb8a804df83ceb0f43">tempest-VolumesNegativeTest-1729588497</nova:project>
Dec 06 07:13:59 user nova-compute[75021]:       </nova:owner>
Dec 06 07:13:59 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:13:59 user nova-compute[75021]:       <nova:ports>
Dec 06 07:13:59 user nova-compute[75021]:         <nova:port uuid="15808503-611b-40de-a90c-0275293306ff">
Dec 06 07:13:59 user nova-compute[75021]:           <nova:ip type="fixed" address="192.168.233.242" ipVersion="4"/>
Dec 06 07:13:59 user nova-compute[75021]:         </nova:port>
Dec 06 07:13:59 user nova-compute[75021]:       </nova:ports>
Dec 06 07:13:59 user nova-compute[75021]:     </nova:instance>
Dec 06 07:13:59 user nova-compute[75021]:   </metadata>
Dec 06 07:13:59 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:13:59 user nova-compute[75021]:     <system>
Dec 06 07:13:59 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:13:59 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:13:59 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:13:59 user nova-compute[75021]:       <entry name="serial">5c88eb99-a014-4ff2-86e7-2d34683cd67c</entry>
Dec 06 07:13:59 user nova-compute[75021]:       <entry name="uuid">5c88eb99-a014-4ff2-86e7-2d34683cd67c</entry>
Dec 06 07:13:59 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:13:59 user nova-compute[75021]:     </system>
Dec 06 07:13:59 user nova-compute[75021]:   </sysinfo>
Dec 06 07:13:59 user nova-compute[75021]:   <os>
Dec 06 07:13:59 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:13:59 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:13:59 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:13:59 user nova-compute[75021]:   </os>
Dec 06 07:13:59 user nova-compute[75021]:   <features>
Dec 06 07:13:59 user nova-compute[75021]:     <acpi/>
Dec 06 07:13:59 user nova-compute[75021]:     <apic/>
Dec 06 07:13:59 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:13:59 user nova-compute[75021]:   </features>
Dec 06 07:13:59 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:13:59 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:13:59 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:13:59 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:13:59 user nova-compute[75021]:   </clock>
Dec 06 07:13:59 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:13:59 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:13:59 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:13:59 user nova-compute[75021]:   </cpu>
Dec 06 07:13:59 user nova-compute[75021]:   <devices>
Dec 06 07:13:59 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:13:59 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:13:59 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk"/>
Dec 06 07:13:59 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:13:59 user nova-compute[75021]:     </disk>
Dec 06 07:13:59 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:13:59 user nova-compute[75021]:       <mac address="fa:16:3e:d0:b0:31"/>
Dec 06 07:13:59 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:13:59 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:13:59 user nova-compute[75021]:       <target dev="tap15808503-61"/>
Dec 06 07:13:59 user nova-compute[75021]:     </interface>
Dec 06 07:13:59 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:13:59 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/console.log" append="off"/>
Dec 06 07:13:59 user nova-compute[75021]:     </serial>
Dec 06 07:13:59 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:13:59 user nova-compute[75021]:     <video>
Dec 06 07:13:59 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:13:59 user nova-compute[75021]:     </video>
Dec 06 07:13:59 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:13:59 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:13:59 user nova-compute[75021]:     </rng>
Dec 06 07:13:59 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:13:59 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:13:59 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:13:59 user nova-compute[75021]:     </memballoon>
Dec 06 07:13:59 user nova-compute[75021]:   </devices>
Dec 06 07:13:59 user nova-compute[75021]: </domain>
Dec 06 07:13:59 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1581071268',display_name='tempest-VolumesNegativeTest-instance-1581071268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1581071268',id=32,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f091460ed1e440eb8a804df83ceb0f43',ramdisk_id='',reservation_id='r-kyqjbkde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1729588497',owner_user_name='tempest-VolumesNegativeTest-1729588497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:13:57Z,user_data=None,user_id='9dd157c8c515451e8c42bf3f680e06e2',uuid=5c88eb99-a014-4ff2-86e7-2d34683cd67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15808503-611b-40de-a90c-0275293306ff", "address": "fa:16:3e:d0:b0:31", "network": {"id": "fd50bddc-4523-4213-9284-9c538352a85b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4d272cf95f0431d87ca72a2872f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15808503-61", "ovs_interfaceid": "15808503-611b-40de-a90c-0275293306ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Converting VIF {"id": "15808503-611b-40de-a90c-0275293306ff", "address": "fa:16:3e:d0:b0:31", "network": {"id": "fd50bddc-4523-4213-9284-9c538352a85b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4d272cf95f0431d87ca72a2872f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15808503-61", "ovs_interfaceid": "15808503-611b-40de-a90c-0275293306ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b0:31,bridge_name='br-int',has_traffic_filtering=True,id=15808503-611b-40de-a90c-0275293306ff,network=Network(fd50bddc-4523-4213-9284-9c538352a85b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15808503-61') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG os_vif [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b0:31,bridge_name='br-int',has_traffic_filtering=True,id=15808503-611b-40de-a90c-0275293306ff,network=Network(fd50bddc-4523-4213-9284-9c538352a85b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15808503-61') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef988eae-31ed-5579-9e20-2a8795224d55', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15808503-61, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15808503-61, col_values=(('qos', UUID('4f4f2403-6202-4819-b5cf-1bc69a3cbdd5')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15808503-61, col_values=(('external_ids', {'iface-id': '15808503-611b-40de-a90c-0275293306ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:b0:31', 'vm-uuid': '5c88eb99-a014-4ff2-86e7-2d34683cd67c'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:59 user nova-compute[75021]: INFO os_vif [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b0:31,bridge_name='br-int',has_traffic_filtering=True,id=15808503-611b-40de-a90c-0275293306ff,network=Network(fd50bddc-4523-4213-9284-9c538352a85b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15808503-61')
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] No VIF found with MAC fa:16:3e:d0:b0:31, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Cannot resize image /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Ensure instance console log exists: /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:13:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG nova.network.neutron [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Successfully created port: ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG nova.network.neutron [req-cbff4327-fc44-4ae3-a0c1-d2676ef1934f req-9de54f1b-276d-455a-9a74-9addf5e4f652 service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Updated VIF entry in instance network info cache for port 15808503-611b-40de-a90c-0275293306ff. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG nova.network.neutron [req-cbff4327-fc44-4ae3-a0c1-d2676ef1934f req-9de54f1b-276d-455a-9a74-9addf5e4f652 service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Updating instance_info_cache with network_info: [{"id": "15808503-611b-40de-a90c-0275293306ff", "address": "fa:16:3e:d0:b0:31", "network": {"id": "fd50bddc-4523-4213-9284-9c538352a85b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4d272cf95f0431d87ca72a2872f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15808503-61", "ovs_interfaceid": "15808503-611b-40de-a90c-0275293306ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cbff4327-fc44-4ae3-a0c1-d2676ef1934f req-9de54f1b-276d-455a-9a74-9addf5e4f652 service nova] Releasing lock "refresh_cache-5c88eb99-a014-4ff2-86e7-2d34683cd67c" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received event network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] No waiting events found dispatching network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:14:00 user nova-compute[75021]: WARNING nova.compute.manager [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received unexpected event network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 for instance with vm_state active and task_state reboot_started.
Dec 06 07:14:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received event network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] No waiting events found dispatching network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:14:00 user nova-compute[75021]: WARNING nova.compute.manager [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received unexpected event network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 for instance with vm_state active and task_state reboot_started.
Dec 06 07:14:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received event network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] No waiting events found dispatching network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:14:00 user nova-compute[75021]: WARNING nova.compute.manager [req-cac8b675-4c55-45ee-8792-885958e1975f req-97b47fb4-66dc-449d-9e13-ca8e5a20f71d service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received unexpected event network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 for instance with vm_state active and task_state reboot_started.
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Successfully updated port: ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquired lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Updating instance_info_cache with network_info: [{"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Releasing lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Instance network_info: |[{"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Start _get_guest_xml network_info=[{"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:14:01 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:14:01 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-964895959',display_name='tempest-AttachVolumeTestJSON-server-964895959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-964895959',id=33,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXnsp33Va88K9HMduz0isu8LdTEYh6ifTevR8F0QY6TmOty18bkV5GKJPhgdUF5uYfbmmBq+t2VYhMvKtNZZK1CejSjAntwpRgpOFPsHdEq6Y3WTe/qlOipA1Kn8ihHeQ==',key_name='tempest-keypair-645111669',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0a2ff3d04db4832a990891c79df356c',ramdisk_id='',reservation_id='r-9za7bkf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-280062788',owner_user_name='tempest-AttachVolumeTestJSON-280062788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9947f4c20feb463fb485de2a7d4bbef5',uuid=0dc18c93-5a40-4c98-a6bf-7422e45b245d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converting VIF {"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:14:01 user nova-compute[75021]:   <uuid>0dc18c93-5a40-4c98-a6bf-7422e45b245d</uuid>
Dec 06 07:14:01 user nova-compute[75021]:   <name>instance-00000021</name>
Dec 06 07:14:01 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:14:01 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:14:01 user nova-compute[75021]:   <metadata>
Dec 06 07:14:01 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:14:01 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:14:01 user nova-compute[75021]:       <nova:name>tempest-AttachVolumeTestJSON-server-964895959</nova:name>
Dec 06 07:14:01 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:14:01</nova:creationTime>
Dec 06 07:14:01 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:14:01 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:14:01 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:14:01 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:14:01 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:14:01 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:14:01 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:14:01 user nova-compute[75021]:       <nova:owner>
Dec 06 07:14:01 user nova-compute[75021]:         <nova:user uuid="9947f4c20feb463fb485de2a7d4bbef5">tempest-AttachVolumeTestJSON-280062788-project-member</nova:user>
Dec 06 07:14:01 user nova-compute[75021]:         <nova:project uuid="f0a2ff3d04db4832a990891c79df356c">tempest-AttachVolumeTestJSON-280062788</nova:project>
Dec 06 07:14:01 user nova-compute[75021]:       </nova:owner>
Dec 06 07:14:01 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:14:01 user nova-compute[75021]:       <nova:ports>
Dec 06 07:14:01 user nova-compute[75021]:         <nova:port uuid="ac69c289-818f-48bb-a95e-2e72646ef67e">
Dec 06 07:14:01 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 07:14:01 user nova-compute[75021]:         </nova:port>
Dec 06 07:14:01 user nova-compute[75021]:       </nova:ports>
Dec 06 07:14:01 user nova-compute[75021]:     </nova:instance>
Dec 06 07:14:01 user nova-compute[75021]:   </metadata>
Dec 06 07:14:01 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:14:01 user nova-compute[75021]:     <system>
Dec 06 07:14:01 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:14:01 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:14:01 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:14:01 user nova-compute[75021]:       <entry name="serial">0dc18c93-5a40-4c98-a6bf-7422e45b245d</entry>
Dec 06 07:14:01 user nova-compute[75021]:       <entry name="uuid">0dc18c93-5a40-4c98-a6bf-7422e45b245d</entry>
Dec 06 07:14:01 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:14:01 user nova-compute[75021]:     </system>
Dec 06 07:14:01 user nova-compute[75021]:   </sysinfo>
Dec 06 07:14:01 user nova-compute[75021]:   <os>
Dec 06 07:14:01 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:14:01 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:14:01 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:14:01 user nova-compute[75021]:   </os>
Dec 06 07:14:01 user nova-compute[75021]:   <features>
Dec 06 07:14:01 user nova-compute[75021]:     <acpi/>
Dec 06 07:14:01 user nova-compute[75021]:     <apic/>
Dec 06 07:14:01 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:14:01 user nova-compute[75021]:   </features>
Dec 06 07:14:01 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:14:01 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:14:01 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:14:01 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:14:01 user nova-compute[75021]:   </clock>
Dec 06 07:14:01 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:14:01 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:14:01 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:14:01 user nova-compute[75021]:   </cpu>
Dec 06 07:14:01 user nova-compute[75021]:   <devices>
Dec 06 07:14:01 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:14:01 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:14:01 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk"/>
Dec 06 07:14:01 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:14:01 user nova-compute[75021]:     </disk>
Dec 06 07:14:01 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:14:01 user nova-compute[75021]:       <mac address="fa:16:3e:4f:e9:89"/>
Dec 06 07:14:01 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:14:01 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:14:01 user nova-compute[75021]:       <target dev="tapac69c289-81"/>
Dec 06 07:14:01 user nova-compute[75021]:     </interface>
Dec 06 07:14:01 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:14:01 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/console.log" append="off"/>
Dec 06 07:14:01 user nova-compute[75021]:     </serial>
Dec 06 07:14:01 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:14:01 user nova-compute[75021]:     <video>
Dec 06 07:14:01 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:14:01 user nova-compute[75021]:     </video>
Dec 06 07:14:01 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:14:01 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:14:01 user nova-compute[75021]:     </rng>
Dec 06 07:14:01 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:14:01 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:14:01 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:14:01 user nova-compute[75021]:     </memballoon>
Dec 06 07:14:01 user nova-compute[75021]:   </devices>
Dec 06 07:14:01 user nova-compute[75021]: </domain>
Dec 06 07:14:01 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-964895959',display_name='tempest-AttachVolumeTestJSON-server-964895959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-964895959',id=33,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXnsp33Va88K9HMduz0isu8LdTEYh6ifTevR8F0QY6TmOty18bkV5GKJPhgdUF5uYfbmmBq+t2VYhMvKtNZZK1CejSjAntwpRgpOFPsHdEq6Y3WTe/qlOipA1Kn8ihHeQ==',key_name='tempest-keypair-645111669',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0a2ff3d04db4832a990891c79df356c',ramdisk_id='',reservation_id='r-9za7bkf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-280062788',owner_user_name='tempest-AttachVolumeTestJSON-280062788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9947f4c20feb463fb485de2a7d4bbef5',uuid=0dc18c93-5a40-4c98-a6bf-7422e45b245d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converting VIF {"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG os_vif [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4ed3d22-b952-5c98-80b7-3eb177e4b1bb', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac69c289-81, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac69c289-81, col_values=(('qos', UUID('d5558db3-4d12-4c7e-a4e7-276252df414b')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac69c289-81, col_values=(('external_ids', {'iface-id': 'ac69c289-818f-48bb-a95e-2e72646ef67e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:e9:89', 'vm-uuid': '0dc18c93-5a40-4c98-a6bf-7422e45b245d'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:01 user nova-compute[75021]: INFO os_vif [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81')
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] No VIF found with MAC fa:16:3e:4f:e9:89, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:14:01 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Instance running successfully.
Dec 06 07:14:01 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-fcf6190e-1b74-4ee2-9865-a98021062e0d tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Instance soft rebooted successfully.
Dec 06 07:14:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-fcf6190e-1b74-4ee2-9865-a98021062e0d tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:14:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fcf6190e-1b74-4ee2-9865-a98021062e0d tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.088s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-changed-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Refreshing instance network info cache due to event network-changed-ac69c289-818f-48bb-a95e-2e72646ef67e. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:14:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] Acquiring lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:14:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] Acquired lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:14:02 user nova-compute[75021]: DEBUG nova.network.neutron [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Refreshing network info cache for port ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:14:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:02 user nova-compute[75021]: INFO nova.compute.manager [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Detaching volume 0a42734f-602c-419a-9043-d77143aec27a
Dec 06 07:14:03 user nova-compute[75021]: INFO nova.virt.block_device [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Attempting to driver detach volume 0a42734f-602c-419a-9043-d77143aec27a from mountpoint /dev/vdb
Dec 06 07:14:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Attempting to detach device vdb from instance 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:14:03 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:14:03 user nova-compute[75021]:   <source dev="/dev/sdh"/>
Dec 06 07:14:03 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:14:03 user nova-compute[75021]:   <serial>0a42734f-602c-419a-9043-d77143aec27a</serial>
Dec 06 07:14:03 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:14:03 user nova-compute[75021]: </disk>
Dec 06 07:14:03 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:14:03 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Successfully detached device vdb from instance 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 from the persistent domain config.
Dec 06 07:14:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:14:03 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:14:03 user nova-compute[75021]:   <source dev="/dev/sdh"/>
Dec 06 07:14:03 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:14:03 user nova-compute[75021]:   <serial>0a42734f-602c-419a-9043-d77143aec27a</serial>
Dec 06 07:14:03 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:14:03 user nova-compute[75021]: </disk>
Dec 06 07:14:03 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG nova.network.neutron [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Updated VIF entry in instance network info cache for port ac69c289-818f-48bb-a95e-2e72646ef67e. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG nova.network.neutron [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Updating instance_info_cache with network_info: [{"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] Releasing lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Received event network-vif-plugged-15808503-611b-40de-a90c-0275293306ff {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] Acquiring lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] No waiting events found dispatching network-vif-plugged-15808503-611b-40de-a90c-0275293306ff {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:14:03 user nova-compute[75021]: WARNING nova.compute.manager [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Received unexpected event network-vif-plugged-15808503-611b-40de-a90c-0275293306ff for instance with vm_state building and task_state spawning.
Dec 06 07:14:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Received event network-vif-plugged-15808503-611b-40de-a90c-0275293306ff {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] Acquiring lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] No waiting events found dispatching network-vif-plugged-15808503-611b-40de-a90c-0275293306ff {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:14:03 user nova-compute[75021]: WARNING nova.compute.manager [req-380f79fa-c229-4a8e-917a-59c6a1f5f122 req-dfbf425c-9e58-4433-8acd-79f5d7c5daa1 service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Received unexpected event network-vif-plugged-15808503-611b-40de-a90c-0275293306ff for instance with vm_state building and task_state spawning.
Dec 06 07:14:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-2091fed2-087a-473c-b0b6-44fad259d0b7 req-aea94a75-6402-491f-bb6c-24e8b3b5bd62 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2091fed2-087a-473c-b0b6-44fad259d0b7 req-aea94a75-6402-491f-bb6c-24e8b3b5bd62 service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2091fed2-087a-473c-b0b6-44fad259d0b7 req-aea94a75-6402-491f-bb6c-24e8b3b5bd62 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2091fed2-087a-473c-b0b6-44fad259d0b7 req-aea94a75-6402-491f-bb6c-24e8b3b5bd62 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-2091fed2-087a-473c-b0b6-44fad259d0b7 req-aea94a75-6402-491f-bb6c-24e8b3b5bd62 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:14:03 user nova-compute[75021]: WARNING nova.compute.manager [req-2091fed2-087a-473c-b0b6-44fad259d0b7 req-aea94a75-6402-491f-bb6c-24e8b3b5bd62 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received unexpected event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with vm_state building and task_state spawning.
Dec 06 07:14:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:14:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:04 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:14:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:14:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:05 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8b8eb320-6348-4038-a57e-02bf1e015174 is timed out.
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:05 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Successfully detached device vdb from instance 8b8eb320-6348-4038-a57e-02bf1e015174 from the live domain config.
Dec 06 07:14:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKpgnXhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:14:05 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cbf4bc-6cde-49db-b4c5-10d496b6271b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:14:05 user nova-compute[75021]: No targets found.
Dec 06 07:14:05 user nova-compute[75021]: iSNS:
Dec 06 07:14:05 user nova-compute[75021]: No targets found.
Dec 06 07:14:05 user nova-compute[75021]: STATIC:
Dec 06 07:14:05 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a
Dec 06 07:14:05 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:14:05 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:14:05 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:14:05 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:14:05 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:14:05 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30
Dec 06 07:14:05 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:14:05 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:14:05 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8
Dec 06 07:14:05 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:14:05 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:14:05 user nova-compute[75021]: FIRMWARE:
Dec 06 07:14:05 user nova-compute[75021]: No targets found.
Dec 06 07:14:05 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:14:05 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:14:05 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6455b4-2805-487f-a8ce-0bea06e6dd71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[131dbea9-21a6-4a47-a47b-b8e4147f8c49]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:14:05 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:14:05 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:14:05 user nova-compute[75021]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)
Dec 06 07:14:05 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:14:05 user nova-compute[75021]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 (non-flash)
Dec 06 07:14:05 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:14:05 user nova-compute[75021]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)
Dec 06 07:14:05 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d84220e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30'): ({'sde'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Removing single pathed devices sde {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[23517227-fbd3-4a94-b26f-2aa860c1389d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[57eb04a2-2433-4487-a0f0-60e6d722ed31]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Flushing IO for device /dev/sde {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1f7181-e730-4fdb-98e6-936323eb02ed]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd97aaf-42c6-4db6-b0a2-d7bbe8d419e2]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7690f6-fce6-494b-8797-ad5d12d26754]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:14:05 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Instance spawned successfully.
Dec 06 07:14:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a388bd-c24d-43e2-a706-48a27b5cf55f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30, portal: 172.16.0.220,3260]
Dec 06 07:14:05 user nova-compute[75021]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30, portal: 172.16.0.220,3260] successful.
Dec 06 07:14:05 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b160044-a407-4c86-8077-0e9284134d30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[709f63ab-f032-46a3-8d6c-71429f05f538]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] <== disconnect_volume: return (459ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:14:05 user nova-compute[75021]: INFO nova.compute.manager [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Took 8.96 seconds to spawn the instance on the hypervisor.
Dec 06 07:14:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:05 user nova-compute[75021]: INFO nova.compute.manager [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Took 9.78 seconds to build instance.
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-37690f5f-0a38-479f-80b1-54a28a12d43d tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.897s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-afa3f0ce-920e-4201-997f-a0ba36821c81 req-3d61456d-a192-462e-b68e-6155933946d5 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-afa3f0ce-920e-4201-997f-a0ba36821c81 req-3d61456d-a192-462e-b68e-6155933946d5 service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-afa3f0ce-920e-4201-997f-a0ba36821c81 req-3d61456d-a192-462e-b68e-6155933946d5 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-afa3f0ce-920e-4201-997f-a0ba36821c81 req-3d61456d-a192-462e-b68e-6155933946d5 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-afa3f0ce-920e-4201-997f-a0ba36821c81 req-3d61456d-a192-462e-b68e-6155933946d5 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:14:05 user nova-compute[75021]: WARNING nova.compute.manager [req-afa3f0ce-920e-4201-997f-a0ba36821c81 req-3d61456d-a192-462e-b68e-6155933946d5 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received unexpected event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with vm_state building and task_state spawning.
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:14:06 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Instance spawned successfully.
Dec 06 07:14:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:06 user nova-compute[75021]: INFO nova.compute.manager [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Took 7.65 seconds to spawn the instance on the hypervisor.
Dec 06 07:14:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:06 user nova-compute[75021]: INFO nova.compute.manager [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Took 8.60 seconds to build instance.
Dec 06 07:14:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b721a2c6-af99-40b7-b31e-e4158d554e56 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.734s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG nova.objects.instance [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'flavor' on Instance uuid 8b8eb320-6348-4038-a57e-02bf1e015174 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bfded2d-09fe-4f3c-b60d-c61763e1513b tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "8b8eb320-6348-4038-a57e-02bf1e015174" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.460s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.251s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:10 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:14:10 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7881MB free_disk=25.17089080810547GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 8b8eb320-6348-4038-a57e-02bf1e015174 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance c08cfdd8-44fc-4736-b5dd-d216c75afef6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 58ef39ae-4b66-42e6-ae22-5308a98eb55d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5c88eb99-a014-4ff2-86e7-2d34683cd67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:14:10 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:14:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:14:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.655s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:14:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:14:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:14:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:14:13 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:14:13 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Updating instance_info_cache with network_info: [{"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:14:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-a613e2d6-d3f6-4729-aef7-24714608acc9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:14:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:14:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:14:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:14:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:14:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:14:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:14:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:14:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:14:15 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:14:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:14:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:24 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 is timed out.
Dec 06 07:14:24 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Successfully detached device vdb from instance 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 from the live domain config.
Dec 06 07:14:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PadKuxpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:14:24 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2539b224-487f-419b-bc8b-a3dbbbbf821d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:14:24 user nova-compute[75021]: No targets found.
Dec 06 07:14:24 user nova-compute[75021]: iSNS:
Dec 06 07:14:24 user nova-compute[75021]: No targets found.
Dec 06 07:14:24 user nova-compute[75021]: STATIC:
Dec 06 07:14:24 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a
Dec 06 07:14:24 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:14:24 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:14:24 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:14:24 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:14:24 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:14:24 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8
Dec 06 07:14:24 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:14:24 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:14:24 user nova-compute[75021]: FIRMWARE:
Dec 06 07:14:24 user nova-compute[75021]: No targets found.
Dec 06 07:14:24 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:14:24 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:14:24 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fde003-59fc-4490-8ed4-9915b00c91c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4fa952-585b-4933-9a8e-e36172dbd6a4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:14:24 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:14:24 user nova-compute[75021]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)
Dec 06 07:14:24 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:14:24 user nova-compute[75021]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a (non-flash)
Dec 06 07:14:24 user nova-compute[75021]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)
Dec 06 07:14:24 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b476d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a'): ({'sdh'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Removing single pathed devices sdh {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[60555888-44c8-419b-8bd2-e28b8a971448]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[709cb737-fb0b-44d9-af1e-c0e0508c0460]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Flushing IO for device /dev/sdh {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc1607e-eb0e-4594-ad47-ae093f050991]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16085a9-8f3f-4fbe-b4df-3169faab420f]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] SCSI volumes sdh have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[da43e4d1-f52f-4634-98dc-88766f8fe0b4]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c17d3f-5af2-4c1d-8856-747e096868f7]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a, portal: 172.16.0.220,3260]
Dec 06 07:14:24 user nova-compute[75021]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a, portal: 172.16.0.220,3260] successful.
Dec 06 07:14:24 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a42734f-602c-419a-9043-d77143aec27a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef872ca-5994-4035-afde-e129b2918811]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] <== disconnect_volume: return (337ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:14:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:14:25 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'flavor' on Instance uuid 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:14:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b9520bca-d720-423c-9391-e398d6cf2fb9 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.730s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "8b8eb320-6348-4038-a57e-02bf1e015174" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:35 user nova-compute[75021]: INFO nova.compute.manager [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Terminating instance
Dec 06 07:14:35 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-3c33062f-66e2-4dc5-a726-dfc7a4a80e6f req-452120fc-7e51-4411-9c57-4414d2eafe19 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-vif-unplugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3c33062f-66e2-4dc5-a726-dfc7a4a80e6f req-452120fc-7e51-4411-9c57-4414d2eafe19 service nova] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3c33062f-66e2-4dc5-a726-dfc7a4a80e6f req-452120fc-7e51-4411-9c57-4414d2eafe19 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3c33062f-66e2-4dc5-a726-dfc7a4a80e6f req-452120fc-7e51-4411-9c57-4414d2eafe19 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-3c33062f-66e2-4dc5-a726-dfc7a4a80e6f req-452120fc-7e51-4411-9c57-4414d2eafe19 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] No waiting events found dispatching network-vif-unplugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-3c33062f-66e2-4dc5-a726-dfc7a4a80e6f req-452120fc-7e51-4411-9c57-4414d2eafe19 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-vif-unplugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:35 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Instance destroyed successfully.
Dec 06 07:14:35 user nova-compute[75021]: DEBUG nova.objects.instance [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'resources' on Instance uuid 8b8eb320-6348-4038-a57e-02bf1e015174 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-699999378',display_name='tempest-ServerRescueNegativeTestJSON-server-699999378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-699999378',id=25,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrrx+YwFNghcFUjqpJOY9cNZNxR7XuyO+lbBn8nBbazUK41wZJQ+nseUHYDKzbfDjsiE9koMmTXhvVI4jne/Z5jMNRtJnHZ99FwlNfe8/CQ9L6WSSjfybYcI9DYbCC3Tw==',key_name='tempest-keypair-835634634',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:10:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43d3fb6e885546bd9660c81fac9cfa12',ramdisk_id='',reservation_id='r-2ue4rtaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-674134420',owner_user_name='tempest-ServerRescueNegativeTestJSON-674134420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:11:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6d8114db9fa47c09bc9675da9e19a8c',uuid=8b8eb320-6348-4038-a57e-02bf1e015174,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converting VIF {"id": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "address": "fa:16:3e:86:90:87", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bc1b9-24", "ovs_interfaceid": "2d2bc1b9-24cd-4992-93a5-e3638e21a35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:90:87,bridge_name='br-int',has_traffic_filtering=True,id=2d2bc1b9-24cd-4992-93a5-e3638e21a35e,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bc1b9-24') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG os_vif [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:90:87,bridge_name='br-int',has_traffic_filtering=True,id=2d2bc1b9-24cd-4992-93a5-e3638e21a35e,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bc1b9-24') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d2bc1b9-24, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=906319af-ed63-4e68-b788-4a6da383352b) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:35 user nova-compute[75021]: INFO os_vif [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:90:87,bridge_name='br-int',has_traffic_filtering=True,id=2d2bc1b9-24cd-4992-93a5-e3638e21a35e,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bc1b9-24')
Dec 06 07:14:35 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Deleting instance files /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174_del
Dec 06 07:14:35 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Deletion of /opt/stack/data/nova/instances/8b8eb320-6348-4038-a57e-02bf1e015174_del complete
Dec 06 07:14:35 user nova-compute[75021]: INFO nova.compute.manager [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Took 0.89 seconds to destroy the instance on the hypervisor.
Dec 06 07:14:35 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:14:35 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:14:36 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:14:36 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Took 0.76 seconds to deallocate network for instance.
Dec 06 07:14:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:37 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:14:37 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:14:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:37 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Deleted allocations for instance 8b8eb320-6348-4038-a57e-02bf1e015174
Dec 06 07:14:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c94070f-8dfa-4a57-ad50-33e92ba1e588 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "8b8eb320-6348-4038-a57e-02bf1e015174" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.250s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-a8a7c1e5-e145-40cb-8686-49d506a302ae req-3113d1f5-2d94-44c1-b6fb-2bb247215de8 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a8a7c1e5-e145-40cb-8686-49d506a302ae req-3113d1f5-2d94-44c1-b6fb-2bb247215de8 service nova] Acquiring lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a8a7c1e5-e145-40cb-8686-49d506a302ae req-3113d1f5-2d94-44c1-b6fb-2bb247215de8 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a8a7c1e5-e145-40cb-8686-49d506a302ae req-3113d1f5-2d94-44c1-b6fb-2bb247215de8 service nova] Lock "8b8eb320-6348-4038-a57e-02bf1e015174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-a8a7c1e5-e145-40cb-8686-49d506a302ae req-3113d1f5-2d94-44c1-b6fb-2bb247215de8 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] No waiting events found dispatching network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:14:37 user nova-compute[75021]: WARNING nova.compute.manager [req-a8a7c1e5-e145-40cb-8686-49d506a302ae req-3113d1f5-2d94-44c1-b6fb-2bb247215de8 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received unexpected event network-vif-plugged-2d2bc1b9-24cd-4992-93a5-e3638e21a35e for instance with vm_state deleted and task_state None.
Dec 06 07:14:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-a8a7c1e5-e145-40cb-8686-49d506a302ae req-3113d1f5-2d94-44c1-b6fb-2bb247215de8 service nova] [instance: 8b8eb320-6348-4038-a57e-02bf1e015174] Received event network-vif-deleted-2d2bc1b9-24cd-4992-93a5-e3638e21a35e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "92c63579-741c-4daa-9568-f7ddf95e3729" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "92c63579-741c-4daa-9568-f7ddf95e3729" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:14:45 user nova-compute[75021]: INFO nova.compute.claims [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Claim successful on node user
Dec 06 07:14:45 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:14:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:14:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:14:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Creating image(s)
Dec 06 07:14:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "/opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "/opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "/opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG nova.policy [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fe3ee5eb8fd41b08a813b53c4e3ec23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f583c975ad5427f8a6ea845d0e22f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.170s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.167s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk 1073741824" returned: 0 in 0.048s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.167s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG nova.network.neutron [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Successfully created port: 5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Cannot resize image /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Ensure instance console log exists: /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Successfully updated port: 5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "refresh_cache-92c63579-741c-4daa-9568-f7ddf95e3729" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquired lock "refresh_cache-92c63579-741c-4daa-9568-f7ddf95e3729" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-f9a70dcc-1d3b-4530-b086-fdaf70022c14 req-cc728e1e-6f19-40c8-9320-ae9dcc117744 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Received event network-changed-5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-f9a70dcc-1d3b-4530-b086-fdaf70022c14 req-cc728e1e-6f19-40c8-9320-ae9dcc117744 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Refreshing instance network info cache due to event network-changed-5ddd7dff-61be-4d5a-9bc4-7242cb57920d. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f9a70dcc-1d3b-4530-b086-fdaf70022c14 req-cc728e1e-6f19-40c8-9320-ae9dcc117744 service nova] Acquiring lock "refresh_cache-92c63579-741c-4daa-9568-f7ddf95e3729" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Updating instance_info_cache with network_info: [{"id": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "address": "fa:16:3e:ab:18:19", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddd7dff-61", "ovs_interfaceid": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Releasing lock "refresh_cache-92c63579-741c-4daa-9568-f7ddf95e3729" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Instance network_info: |[{"id": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "address": "fa:16:3e:ab:18:19", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddd7dff-61", "ovs_interfaceid": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f9a70dcc-1d3b-4530-b086-fdaf70022c14 req-cc728e1e-6f19-40c8-9320-ae9dcc117744 service nova] Acquired lock "refresh_cache-92c63579-741c-4daa-9568-f7ddf95e3729" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.network.neutron [req-f9a70dcc-1d3b-4530-b086-fdaf70022c14 req-cc728e1e-6f19-40c8-9320-ae9dcc117744 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Refreshing network info cache for port 5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Start _get_guest_xml network_info=[{"id": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "address": "fa:16:3e:ab:18:19", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddd7dff-61", "ovs_interfaceid": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:14:47 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:14:47 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1415493547',display_name='tempest-TestStampPattern-server-1415493547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1415493547',id=34,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg8IGkXaXCpoLXuv1QgPTQlIboH6YGAoE4h1LpIm9THcogGNb2pCBJ53/n7DkXcaYeQRE+8kERBbD6EPJISjHNebvAB2igEJJMWl/apA8rqHLtvdqFZ90Vp+dBW6ln6vA==',key_name='tempest-TestStampPattern-2114891316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f583c975ad5427f8a6ea845d0e22f2e',ramdisk_id='',reservation_id='r-oojjzzbr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1309177845',owner_user_name='tempest-TestStampPattern-1309177845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:14:46Z,user_data=None,user_id='6fe3ee5eb8fd41b08a813b53c4e3ec23',uuid=92c63579-741c-4daa-9568-f7ddf95e3729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "address": "fa:16:3e:ab:18:19", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddd7dff-61", "ovs_interfaceid": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Converting VIF {"id": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "address": "fa:16:3e:ab:18:19", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddd7dff-61", "ovs_interfaceid": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:18:19,bridge_name='br-int',has_traffic_filtering=True,id=5ddd7dff-61be-4d5a-9bc4-7242cb57920d,network=Network(1392d2f0-29b7-4293-bf52-5e004250332f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ddd7dff-61') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.objects.instance [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lazy-loading 'pci_devices' on Instance uuid 92c63579-741c-4daa-9568-f7ddf95e3729 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:14:47 user nova-compute[75021]:   <uuid>92c63579-741c-4daa-9568-f7ddf95e3729</uuid>
Dec 06 07:14:47 user nova-compute[75021]:   <name>instance-00000022</name>
Dec 06 07:14:47 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:14:47 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:14:47 user nova-compute[75021]:   <metadata>
Dec 06 07:14:47 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:14:47 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:14:47 user nova-compute[75021]:       <nova:name>tempest-TestStampPattern-server-1415493547</nova:name>
Dec 06 07:14:47 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:14:47</nova:creationTime>
Dec 06 07:14:47 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:14:47 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:14:47 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:14:47 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:14:47 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:14:47 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:14:47 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:14:47 user nova-compute[75021]:       <nova:owner>
Dec 06 07:14:47 user nova-compute[75021]:         <nova:user uuid="6fe3ee5eb8fd41b08a813b53c4e3ec23">tempest-TestStampPattern-1309177845-project-member</nova:user>
Dec 06 07:14:47 user nova-compute[75021]:         <nova:project uuid="7f583c975ad5427f8a6ea845d0e22f2e">tempest-TestStampPattern-1309177845</nova:project>
Dec 06 07:14:47 user nova-compute[75021]:       </nova:owner>
Dec 06 07:14:47 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:14:47 user nova-compute[75021]:       <nova:ports>
Dec 06 07:14:47 user nova-compute[75021]:         <nova:port uuid="5ddd7dff-61be-4d5a-9bc4-7242cb57920d">
Dec 06 07:14:47 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 06 07:14:47 user nova-compute[75021]:         </nova:port>
Dec 06 07:14:47 user nova-compute[75021]:       </nova:ports>
Dec 06 07:14:47 user nova-compute[75021]:     </nova:instance>
Dec 06 07:14:47 user nova-compute[75021]:   </metadata>
Dec 06 07:14:47 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:14:47 user nova-compute[75021]:     <system>
Dec 06 07:14:47 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:14:47 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:14:47 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:14:47 user nova-compute[75021]:       <entry name="serial">92c63579-741c-4daa-9568-f7ddf95e3729</entry>
Dec 06 07:14:47 user nova-compute[75021]:       <entry name="uuid">92c63579-741c-4daa-9568-f7ddf95e3729</entry>
Dec 06 07:14:47 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:14:47 user nova-compute[75021]:     </system>
Dec 06 07:14:47 user nova-compute[75021]:   </sysinfo>
Dec 06 07:14:47 user nova-compute[75021]:   <os>
Dec 06 07:14:47 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:14:47 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:14:47 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:14:47 user nova-compute[75021]:   </os>
Dec 06 07:14:47 user nova-compute[75021]:   <features>
Dec 06 07:14:47 user nova-compute[75021]:     <acpi/>
Dec 06 07:14:47 user nova-compute[75021]:     <apic/>
Dec 06 07:14:47 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:14:47 user nova-compute[75021]:   </features>
Dec 06 07:14:47 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:14:47 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:14:47 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:14:47 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:14:47 user nova-compute[75021]:   </clock>
Dec 06 07:14:47 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:14:47 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:14:47 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:14:47 user nova-compute[75021]:   </cpu>
Dec 06 07:14:47 user nova-compute[75021]:   <devices>
Dec 06 07:14:47 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:14:47 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:14:47 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk"/>
Dec 06 07:14:47 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:14:47 user nova-compute[75021]:     </disk>
Dec 06 07:14:47 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:14:47 user nova-compute[75021]:       <mac address="fa:16:3e:ab:18:19"/>
Dec 06 07:14:47 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:14:47 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:14:47 user nova-compute[75021]:       <target dev="tap5ddd7dff-61"/>
Dec 06 07:14:47 user nova-compute[75021]:     </interface>
Dec 06 07:14:47 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:14:47 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/console.log" append="off"/>
Dec 06 07:14:47 user nova-compute[75021]:     </serial>
Dec 06 07:14:47 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:14:47 user nova-compute[75021]:     <video>
Dec 06 07:14:47 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:14:47 user nova-compute[75021]:     </video>
Dec 06 07:14:47 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:14:47 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:14:47 user nova-compute[75021]:     </rng>
Dec 06 07:14:47 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:14:47 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:14:47 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:14:47 user nova-compute[75021]:     </memballoon>
Dec 06 07:14:47 user nova-compute[75021]:   </devices>
Dec 06 07:14:47 user nova-compute[75021]: </domain>
Dec 06 07:14:47 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1415493547',display_name='tempest-TestStampPattern-server-1415493547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1415493547',id=34,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg8IGkXaXCpoLXuv1QgPTQlIboH6YGAoE4h1LpIm9THcogGNb2pCBJ53/n7DkXcaYeQRE+8kERBbD6EPJISjHNebvAB2igEJJMWl/apA8rqHLtvdqFZ90Vp+dBW6ln6vA==',key_name='tempest-TestStampPattern-2114891316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f583c975ad5427f8a6ea845d0e22f2e',ramdisk_id='',reservation_id='r-oojjzzbr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1309177845',owner_user_name='tempest-TestStampPattern-1309177845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:14:46Z,user_data=None,user_id='6fe3ee5eb8fd41b08a813b53c4e3ec23',uuid=92c63579-741c-4daa-9568-f7ddf95e3729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "address": "fa:16:3e:ab:18:19", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddd7dff-61", "ovs_interfaceid": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Converting VIF {"id": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "address": "fa:16:3e:ab:18:19", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddd7dff-61", "ovs_interfaceid": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:18:19,bridge_name='br-int',has_traffic_filtering=True,id=5ddd7dff-61be-4d5a-9bc4-7242cb57920d,network=Network(1392d2f0-29b7-4293-bf52-5e004250332f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ddd7dff-61') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG os_vif [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:18:19,bridge_name='br-int',has_traffic_filtering=True,id=5ddd7dff-61be-4d5a-9bc4-7242cb57920d,network=Network(1392d2f0-29b7-4293-bf52-5e004250332f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ddd7dff-61') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0230826-44e6-50a7-b3a7-fdc85c05be3f', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ddd7dff-61, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ddd7dff-61, col_values=(('qos', UUID('1732b861-487b-4011-bbdf-f05470c901ec')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ddd7dff-61, col_values=(('external_ids', {'iface-id': '5ddd7dff-61be-4d5a-9bc4-7242cb57920d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:18:19', 'vm-uuid': '92c63579-741c-4daa-9568-f7ddf95e3729'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:47 user nova-compute[75021]: INFO os_vif [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:18:19,bridge_name='br-int',has_traffic_filtering=True,id=5ddd7dff-61be-4d5a-9bc4-7242cb57920d,network=Network(1392d2f0-29b7-4293-bf52-5e004250332f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ddd7dff-61')
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] No VIF found with MAC fa:16:3e:ab:18:19, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.network.neutron [req-f9a70dcc-1d3b-4530-b086-fdaf70022c14 req-cc728e1e-6f19-40c8-9320-ae9dcc117744 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Updated VIF entry in instance network info cache for port 5ddd7dff-61be-4d5a-9bc4-7242cb57920d. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG nova.network.neutron [req-f9a70dcc-1d3b-4530-b086-fdaf70022c14 req-cc728e1e-6f19-40c8-9320-ae9dcc117744 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Updating instance_info_cache with network_info: [{"id": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "address": "fa:16:3e:ab:18:19", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddd7dff-61", "ovs_interfaceid": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:14:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f9a70dcc-1d3b-4530-b086-fdaf70022c14 req-cc728e1e-6f19-40c8-9320-ae9dcc117744 service nova] Releasing lock "refresh_cache-92c63579-741c-4daa-9568-f7ddf95e3729" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:14:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-925f65d6-a8b0-4747-ba2f-2829c42a3b2a req-16321971-3288-4ed5-8fb6-305aee555834 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Received event network-vif-plugged-5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-925f65d6-a8b0-4747-ba2f-2829c42a3b2a req-16321971-3288-4ed5-8fb6-305aee555834 service nova] Acquiring lock "92c63579-741c-4daa-9568-f7ddf95e3729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-925f65d6-a8b0-4747-ba2f-2829c42a3b2a req-16321971-3288-4ed5-8fb6-305aee555834 service nova] Lock "92c63579-741c-4daa-9568-f7ddf95e3729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-925f65d6-a8b0-4747-ba2f-2829c42a3b2a req-16321971-3288-4ed5-8fb6-305aee555834 service nova] Lock "92c63579-741c-4daa-9568-f7ddf95e3729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-925f65d6-a8b0-4747-ba2f-2829c42a3b2a req-16321971-3288-4ed5-8fb6-305aee555834 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] No waiting events found dispatching network-vif-plugged-5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:14:49 user nova-compute[75021]: WARNING nova.compute.manager [req-925f65d6-a8b0-4747-ba2f-2829c42a3b2a req-16321971-3288-4ed5-8fb6-305aee555834 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Received unexpected event network-vif-plugged-5ddd7dff-61be-4d5a-9bc4-7242cb57920d for instance with vm_state building and task_state spawning.
Dec 06 07:14:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:51 user nova-compute[75021]: DEBUG nova.compute.manager [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:14:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:14:51 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Instance spawned successfully.
Dec 06 07:14:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:14:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:14:51 user nova-compute[75021]: INFO nova.compute.manager [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Took 5.38 seconds to spawn the instance on the hypervisor.
Dec 06 07:14:51 user nova-compute[75021]: DEBUG nova.compute.manager [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:14:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-81d640ce-08c4-442d-9d96-65784b5dbf02 req-785dc9eb-e257-4cd2-a87b-61eb6557d0ec service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Received event network-vif-plugged-5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-81d640ce-08c4-442d-9d96-65784b5dbf02 req-785dc9eb-e257-4cd2-a87b-61eb6557d0ec service nova] Acquiring lock "92c63579-741c-4daa-9568-f7ddf95e3729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-81d640ce-08c4-442d-9d96-65784b5dbf02 req-785dc9eb-e257-4cd2-a87b-61eb6557d0ec service nova] Lock "92c63579-741c-4daa-9568-f7ddf95e3729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-81d640ce-08c4-442d-9d96-65784b5dbf02 req-785dc9eb-e257-4cd2-a87b-61eb6557d0ec service nova] Lock "92c63579-741c-4daa-9568-f7ddf95e3729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-81d640ce-08c4-442d-9d96-65784b5dbf02 req-785dc9eb-e257-4cd2-a87b-61eb6557d0ec service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] No waiting events found dispatching network-vif-plugged-5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:14:51 user nova-compute[75021]: WARNING nova.compute.manager [req-81d640ce-08c4-442d-9d96-65784b5dbf02 req-785dc9eb-e257-4cd2-a87b-61eb6557d0ec service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Received unexpected event network-vif-plugged-5ddd7dff-61be-4d5a-9bc4-7242cb57920d for instance with vm_state active and task_state None.
Dec 06 07:14:51 user nova-compute[75021]: INFO nova.compute.manager [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Took 6.17 seconds to build instance.
Dec 06 07:14:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76845880-b77e-4671-bd83-c028b0bd7b39 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "92c63579-741c-4daa-9568-f7ddf95e3729" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.276s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:14:53 user nova-compute[75021]: INFO nova.compute.manager [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] instance snapshotting
Dec 06 07:14:53 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Beginning live snapshot process
Dec 06 07:14:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json -f qcow2 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:53 user nova-compute[75021]: INFO nova.compute.manager [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Terminating instance
Dec 06 07:14:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json -f qcow2 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-a670efe4-48a8-41f1-9832-7e56e8d462b9 req-9612e8d7-973d-4c18-a22a-e07df6cb1153 service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Received event network-vif-unplugged-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a670efe4-48a8-41f1-9832-7e56e8d462b9 req-9612e8d7-973d-4c18-a22a-e07df6cb1153 service nova] Acquiring lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a670efe4-48a8-41f1-9832-7e56e8d462b9 req-9612e8d7-973d-4c18-a22a-e07df6cb1153 service nova] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a670efe4-48a8-41f1-9832-7e56e8d462b9 req-9612e8d7-973d-4c18-a22a-e07df6cb1153 service nova] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-a670efe4-48a8-41f1-9832-7e56e8d462b9 req-9612e8d7-973d-4c18-a22a-e07df6cb1153 service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] No waiting events found dispatching network-vif-unplugged-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-a670efe4-48a8-41f1-9832-7e56e8d462b9 req-9612e8d7-973d-4c18-a22a-e07df6cb1153 service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Received event network-vif-unplugged-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json -f qcow2" returned: 0 in 0.214s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.208s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7rk6x226/d3040d54d2c24079b32e1abb39187c54.delta 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7rk6x226/d3040d54d2c24079b32e1abb39187c54.delta 1073741824" returned: 0 in 0.057s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:54 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 06 07:14:54 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Instance destroyed successfully.
Dec 06 07:14:54 user nova-compute[75021]: DEBUG nova.objects.instance [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'resources' on Instance uuid 65e7540f-3e73-4d4c-8b8f-2a53dac610a0 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:14:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:09:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1215160675',display_name='tempest-AttachVolumeNegativeTest-server-1215160675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1215160675',id=26,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg03dlEtgAq6SdY8CQM6ZNpBjVxQTSTHpBd22Hsg5qQDoJ3Q8/C6zsQcBFZyzKwEIE6odg1yrNbJwjJ3LuBGrxzQAhiRUnwzKyyD9E34Q8OYleRZdC/h7amA7IzAR5d9g==',key_name='tempest-keypair-1698207691',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:09:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae65045cef754813bd33f68b9868dc9d',ramdisk_id='',reservation_id='r-3baipyid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-967416759',owner_user_name='tempest-AttachVolumeNegativeTest-967416759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:09:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e1155d2c304bdd8404712faf046b05',uuid=65e7540f-3e73-4d4c-8b8f-2a53dac610a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "address": "fa:16:3e:6d:44:f6", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177516ce-7e", "ovs_interfaceid": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:14:54 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converting VIF {"id": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "address": "fa:16:3e:6d:44:f6", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap177516ce-7e", "ovs_interfaceid": "177516ce-7e6c-4c3c-b2bf-d1c538d10f7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:14:54 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:44:f6,bridge_name='br-int',has_traffic_filtering=True,id=177516ce-7e6c-4c3c-b2bf-d1c538d10f7e,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap177516ce-7e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:14:54 user nova-compute[75021]: DEBUG os_vif [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:44:f6,bridge_name='br-int',has_traffic_filtering=True,id=177516ce-7e6c-4c3c-b2bf-d1c538d10f7e,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap177516ce-7e') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:14:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap177516ce-7e, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:14:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:14:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:14:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42def7f8-abc7-4ab9-a554-4b18cd6f62d2) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:14:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:14:54 user nova-compute[75021]: INFO os_vif [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:44:f6,bridge_name='br-int',has_traffic_filtering=True,id=177516ce-7e6c-4c3c-b2bf-d1c538d10f7e,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap177516ce-7e')
Dec 06 07:14:54 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Deleting instance files /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0_del
Dec 06 07:14:54 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Deletion of /opt/stack/data/nova/instances/65e7540f-3e73-4d4c-8b8f-2a53dac610a0_del complete
Dec 06 07:14:54 user nova-compute[75021]: INFO nova.compute.manager [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Took 1.56 seconds to destroy the instance on the hypervisor.
Dec 06 07:14:55 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:14:55 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:14:55 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:14:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] COPY block job progress, current cursor: 75366400 final cursor: 75497472 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:14:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-8a720467-b348-4417-92a9-06280d7c3915 req-d94eef94-3654-4050-8612-d74c19c5be27 service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Received event network-vif-plugged-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8a720467-b348-4417-92a9-06280d7c3915 req-d94eef94-3654-4050-8612-d74c19c5be27 service nova] Acquiring lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8a720467-b348-4417-92a9-06280d7c3915 req-d94eef94-3654-4050-8612-d74c19c5be27 service nova] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8a720467-b348-4417-92a9-06280d7c3915 req-d94eef94-3654-4050-8612-d74c19c5be27 service nova] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-8a720467-b348-4417-92a9-06280d7c3915 req-d94eef94-3654-4050-8612-d74c19c5be27 service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] No waiting events found dispatching network-vif-plugged-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:14:55 user nova-compute[75021]: WARNING nova.compute.manager [req-8a720467-b348-4417-92a9-06280d7c3915 req-d94eef94-3654-4050-8612-d74c19c5be27 service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Received unexpected event network-vif-plugged-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e for instance with vm_state active and task_state deleting.
Dec 06 07:14:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:14:55 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 06 07:14:55 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:14:55 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Took 0.95 seconds to deallocate network for instance.
Dec 06 07:14:55 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 07:14:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7rk6x226/d3040d54d2c24079b32e1abb39187c54.delta /opt/stack/data/nova/instances/snapshots/tmp7rk6x226/d3040d54d2c24079b32e1abb39187c54 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:14:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:14:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:14:56 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:14:56 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:14:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.576s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7rk6x226/d3040d54d2c24079b32e1abb39187c54.delta /opt/stack/data/nova/instances/snapshots/tmp7rk6x226/d3040d54d2c24079b32e1abb39187c54" returned: 0 in 0.628s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:14:56 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Snapshot extracted, beginning image upload
Dec 06 07:14:56 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Deleted allocations for instance 65e7540f-3e73-4d4c-8b8f-2a53dac610a0
Dec 06 07:14:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6032bd77-0562-460e-9899-5d4ff8bb7ad8 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "65e7540f-3e73-4d4c-8b8f-2a53dac610a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.305s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:14:57 user nova-compute[75021]: DEBUG nova.compute.manager [req-57b428c1-87fe-4f4c-bdda-a85663c036e3 req-af04f047-9c4d-45f2-88ab-573e66b345c7 service nova] [instance: 65e7540f-3e73-4d4c-8b8f-2a53dac610a0] Received event network-vif-deleted-177516ce-7e6c-4c3c-b2bf-d1c538d10f7e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:14:59 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Snapshot image upload complete
Dec 06 07:14:59 user nova-compute[75021]: INFO nova.compute.manager [None req-51105e78-6b77-4c86-87c3-117a68446505 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Took 5.98 seconds to snapshot the instance on the hypervisor.
Dec 06 07:14:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:02 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:15:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:04 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:15:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:04 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:15:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:15:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:15:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:08 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:15:08 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:15:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7673MB free_disk=25.117019653320312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:15:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a613e2d6-d3f6-4729-aef7-24714608acc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance c08cfdd8-44fc-4736-b5dd-d216c75afef6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 58ef39ae-4b66-42e6-ae22-5308a98eb55d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5c88eb99-a014-4ff2-86e7-2d34683cd67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 92c63579-741c-4daa-9568-f7ddf95e3729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.compute.manager [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:15:09 user nova-compute[75021]: INFO nova.compute.claims [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Claim successful on node user
Dec 06 07:15:10 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG nova.network.neutron [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:15:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:15:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG nova.policy [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3369c937ad24537a114a71eb4674750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f011c1a70ac1465d8eb31e20850fdbad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:15:10 user nova-compute[75021]: INFO nova.virt.block_device [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Booting with volume acb71e11-36d0-44fe-9fcd-d2c2652e38fc at /dev/vda
Dec 06 07:15:10 user nova-compute[75021]: DEBUG os_brick.utils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aabf82f-20f8-46f1-9aed-f86553f3db40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[209be9d3-6263-4286-9dda-2fad3e5f790e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[25692484-2707-44bc-82e1-c8b7717a0c49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e55dcc-02bd-471a-bc92-9b0c3364db42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:15:10 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:15:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf4a5dd-dc47-4927-8b04-491293fcd01c]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG os_brick.utils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:15:10 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Updating existing volume attachment record: ecadee4f-8b5a-4572-8898-72d53b9ef87d {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:15:11 user nova-compute[75021]: DEBUG nova.network.neutron [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Successfully created port: a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Successfully updated port: a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquired lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-191fbde4-8a74-41be-96da-7848ece1c7fe req-63b2c6b2-86b9-4796-9f93-be3ac68f2597 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received event network-changed-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-191fbde4-8a74-41be-96da-7848ece1c7fe req-63b2c6b2-86b9-4796-9f93-be3ac68f2597 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Refreshing instance network info cache due to event network-changed-a16e0c22-fbe2-4dff-87ed-813f89691a4f. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-191fbde4-8a74-41be-96da-7848ece1c7fe req-63b2c6b2-86b9-4796-9f93-be3ac68f2597 service nova] Acquiring lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Updating instance_info_cache with network_info: [{"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Releasing lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Instance network_info: |[{"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-191fbde4-8a74-41be-96da-7848ece1c7fe req-63b2c6b2-86b9-4796-9f93-be3ac68f2597 service nova] Acquired lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG nova.network.neutron [req-191fbde4-8a74-41be-96da-7848ece1c7fe req-63b2c6b2-86b9-4796-9f93-be3ac68f2597 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Refreshing network info cache for port a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:15:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Updating instance_info_cache with network_info: [{"id": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "address": "fa:16:3e:b7:f2:e4", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f43de0b-bf", "ovs_interfaceid": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:15:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:15:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:15:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:15:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:15:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:15:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:15:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:15:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:15:13 user nova-compute[75021]: DEBUG nova.network.neutron [req-191fbde4-8a74-41be-96da-7848ece1c7fe req-63b2c6b2-86b9-4796-9f93-be3ac68f2597 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Updated VIF entry in instance network info cache for port a16e0c22-fbe2-4dff-87ed-813f89691a4f. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:15:13 user nova-compute[75021]: DEBUG nova.network.neutron [req-191fbde4-8a74-41be-96da-7848ece1c7fe req-63b2c6b2-86b9-4796-9f93-be3ac68f2597 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Updating instance_info_cache with network_info: [{"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:15:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-191fbde4-8a74-41be-96da-7848ece1c7fe req-63b2c6b2-86b9-4796-9f93-be3ac68f2597 service nova] Releasing lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:15:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:14 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:15:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:15 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:15:17 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:15:18 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:15:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75021) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 07:15:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:15:19 user nova-compute[75021]: WARNING nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 4ffc6429-3f3c-4a7e-98e5-0db984266eae {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid a613e2d6-d3f6-4729-aef7-24714608acc9 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid cd198206-4476-4b87-8399-dd5cb38fd3b1 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid b9372825-c75d-45a3-a48c-e111869d97a5 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 828f5456-6310-4664-87b3-ee0ed6787d3f {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid c08cfdd8-44fc-4736-b5dd-d216c75afef6 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 58ef39ae-4b66-42e6-ae22-5308a98eb55d {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 5c88eb99-a014-4ff2-86e7-2d34683cd67c {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 92c63579-741c-4daa-9568-f7ddf95e3729 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid a31eae43-b01c-46cf-9c06-13e9242b5fe1 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "cd198206-4476-4b87-8399-dd5cb38fd3b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "b9372825-c75d-45a3-a48c-e111869d97a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "b9372825-c75d-45a3-a48c-e111869d97a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "92c63579-741c-4daa-9568-f7ddf95e3729" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "92c63579-741c-4daa-9568-f7ddf95e3729" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "b9372825-c75d-45a3-a48c-e111869d97a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "92c63579-741c-4daa-9568-f7ddf95e3729" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:15:19 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Creating image(s)
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Ensure instance console log exists: /opt/stack/data/nova/instances/a31eae43-b01c-46cf-9c06-13e9242b5fe1/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Start _get_guest_xml network_info=[{"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ecadee4f-8b5a-4572-8898-72d53b9ef87d', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfieSjZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a31eae43-b01c-46cf-9c06-13e9242b5fe1', 'attached_at': '', 'detached_at': '', 'volume_id': 'acb71e11-36d0-44fe-9fcd-d2c2652e38fc', 'serial': 'acb71e11-36d0-44fe-9fcd-d2c2652e38fc'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:15:19 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:15:19 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:15:19 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfieSjZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:15:20 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:15:20 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:15:20 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[749282a7-eb1c-4918-b5fd-a6a4c213dbcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:15:20 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaa379e-c938-4370-a881-567cf4e93eee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc] added
Dec 06 07:15:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f5b1d8-6b40-4256-8465-c1cdf25681ac]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ccff02-c033-4999-bfca-b7f7b8d21aa9]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lfieSjZO {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lfieSjZO" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4f4033-f573-4d39-88e0-bd0c221690f3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lfieSjZO'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faf9330-0d80-4264-bf14-e98552b72fbd]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f856d588-fbff-4f01-af27-5d2ebaec8327]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:15:20 user nova-compute[75021]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)
Dec 06 07:15:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:15:20 user nova-compute[75021]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)
Dec 06 07:15:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aed10f8-3d7e-4aca-8dbf-03c8f366f2d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260]
Dec 06 07:15:20 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260] successful.
Dec 06 07:15:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2bb927-b32f-48ae-a44d-85d9dc677807]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bc2fdb-a006-40a1-b469-dd702bc4338a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:15:20 user nova-compute[75021]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)
Dec 06 07:15:20 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:15:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:15:20 user nova-compute[75021]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)
Dec 06 07:15:20 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:15:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7405736-8f98-4007-af48-ee3e8571e04c]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:20 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] There are 0 instances to clean {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfieSjZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26136313431633330', 'path': '/dev/sdc'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136313431633330', 'path': '/dev/sdc'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:15:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1372424050',display_name='tempest-ServerActionsTestOtherA-server-1372424050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1372424050',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbe4qUdep78TgBLG29O7GMFI0uEKESU+Xx64Y2G0xkh2EtccpxwWlafCMPJHygmaEQbyUAtZjD22PTzS9xqolPPxgkkpdNuHJ15mMhGsezfXPp1cLkefmXHoF6E+QYoeA==',key_name='tempest-keypair-34997867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f011c1a70ac1465d8eb31e20850fdbad',ramdisk_id='',reservation_id='r-o2rbqj04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1761792884',owner_user_name='tempest-ServerActionsTestOtherA-1761792884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:15:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3369c937ad24537a114a71eb4674750',uuid=a31eae43-b01c-46cf-9c06-13e9242b5fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converting VIF {"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:38:94,bridge_name='br-int',has_traffic_filtering=True,id=a16e0c22-fbe2-4dff-87ed-813f89691a4f,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16e0c22-fb') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG nova.objects.instance [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lazy-loading 'pci_devices' on Instance uuid a31eae43-b01c-46cf-9c06-13e9242b5fe1 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:15:21 user nova-compute[75021]:   <uuid>a31eae43-b01c-46cf-9c06-13e9242b5fe1</uuid>
Dec 06 07:15:21 user nova-compute[75021]:   <name>instance-00000023</name>
Dec 06 07:15:21 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:15:21 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:15:21 user nova-compute[75021]:   <metadata>
Dec 06 07:15:21 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:15:21 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:15:21 user nova-compute[75021]:       <nova:name>tempest-ServerActionsTestOtherA-server-1372424050</nova:name>
Dec 06 07:15:21 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:15:19</nova:creationTime>
Dec 06 07:15:21 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:15:21 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:15:21 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:15:21 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:15:21 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:15:21 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:15:21 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:15:21 user nova-compute[75021]:       <nova:owner>
Dec 06 07:15:21 user nova-compute[75021]:         <nova:user uuid="e3369c937ad24537a114a71eb4674750">tempest-ServerActionsTestOtherA-1761792884-project-member</nova:user>
Dec 06 07:15:21 user nova-compute[75021]:         <nova:project uuid="f011c1a70ac1465d8eb31e20850fdbad">tempest-ServerActionsTestOtherA-1761792884</nova:project>
Dec 06 07:15:21 user nova-compute[75021]:       </nova:owner>
Dec 06 07:15:21 user nova-compute[75021]:       <nova:ports>
Dec 06 07:15:21 user nova-compute[75021]:         <nova:port uuid="a16e0c22-fbe2-4dff-87ed-813f89691a4f">
Dec 06 07:15:21 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 07:15:21 user nova-compute[75021]:         </nova:port>
Dec 06 07:15:21 user nova-compute[75021]:       </nova:ports>
Dec 06 07:15:21 user nova-compute[75021]:     </nova:instance>
Dec 06 07:15:21 user nova-compute[75021]:   </metadata>
Dec 06 07:15:21 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:15:21 user nova-compute[75021]:     <system>
Dec 06 07:15:21 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:15:21 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:15:21 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:15:21 user nova-compute[75021]:       <entry name="serial">a31eae43-b01c-46cf-9c06-13e9242b5fe1</entry>
Dec 06 07:15:21 user nova-compute[75021]:       <entry name="uuid">a31eae43-b01c-46cf-9c06-13e9242b5fe1</entry>
Dec 06 07:15:21 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:15:21 user nova-compute[75021]:     </system>
Dec 06 07:15:21 user nova-compute[75021]:   </sysinfo>
Dec 06 07:15:21 user nova-compute[75021]:   <os>
Dec 06 07:15:21 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:15:21 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:15:21 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:15:21 user nova-compute[75021]:   </os>
Dec 06 07:15:21 user nova-compute[75021]:   <features>
Dec 06 07:15:21 user nova-compute[75021]:     <acpi/>
Dec 06 07:15:21 user nova-compute[75021]:     <apic/>
Dec 06 07:15:21 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:15:21 user nova-compute[75021]:   </features>
Dec 06 07:15:21 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:15:21 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:15:21 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:15:21 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:15:21 user nova-compute[75021]:   </clock>
Dec 06 07:15:21 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:15:21 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:15:21 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:15:21 user nova-compute[75021]:   </cpu>
Dec 06 07:15:21 user nova-compute[75021]:   <devices>
Dec 06 07:15:21 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:15:21 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:15:21 user nova-compute[75021]:       <source dev="/dev/sdc"/>
Dec 06 07:15:21 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:15:21 user nova-compute[75021]:       <serial>acb71e11-36d0-44fe-9fcd-d2c2652e38fc</serial>
Dec 06 07:15:21 user nova-compute[75021]:     </disk>
Dec 06 07:15:21 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:15:21 user nova-compute[75021]:       <mac address="fa:16:3e:81:38:94"/>
Dec 06 07:15:21 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:15:21 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:15:21 user nova-compute[75021]:       <target dev="tapa16e0c22-fb"/>
Dec 06 07:15:21 user nova-compute[75021]:     </interface>
Dec 06 07:15:21 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:15:21 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/a31eae43-b01c-46cf-9c06-13e9242b5fe1/console.log" append="off"/>
Dec 06 07:15:21 user nova-compute[75021]:     </serial>
Dec 06 07:15:21 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:15:21 user nova-compute[75021]:     <video>
Dec 06 07:15:21 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:15:21 user nova-compute[75021]:     </video>
Dec 06 07:15:21 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:15:21 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:15:21 user nova-compute[75021]:     </rng>
Dec 06 07:15:21 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:15:21 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:15:21 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:15:21 user nova-compute[75021]:     </memballoon>
Dec 06 07:15:21 user nova-compute[75021]:   </devices>
Dec 06 07:15:21 user nova-compute[75021]: </domain>
Dec 06 07:15:21 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:15:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1372424050',display_name='tempest-ServerActionsTestOtherA-server-1372424050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1372424050',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbe4qUdep78TgBLG29O7GMFI0uEKESU+Xx64Y2G0xkh2EtccpxwWlafCMPJHygmaEQbyUAtZjD22PTzS9xqolPPxgkkpdNuHJ15mMhGsezfXPp1cLkefmXHoF6E+QYoeA==',key_name='tempest-keypair-34997867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f011c1a70ac1465d8eb31e20850fdbad',ramdisk_id='',reservation_id='r-o2rbqj04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1761792884',owner_user_name='tempest-ServerActionsTestOtherA-1761792884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:15:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3369c937ad24537a114a71eb4674750',uuid=a31eae43-b01c-46cf-9c06-13e9242b5fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converting VIF {"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:38:94,bridge_name='br-int',has_traffic_filtering=True,id=a16e0c22-fbe2-4dff-87ed-813f89691a4f,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16e0c22-fb') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG os_vif [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:38:94,bridge_name='br-int',has_traffic_filtering=True,id=a16e0c22-fbe2-4dff-87ed-813f89691a4f,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16e0c22-fb') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '616cec34-3b91-57a0-adca-8009eca8c20c', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa16e0c22-fb, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa16e0c22-fb, col_values=(('qos', UUID('7fd63f62-ba27-48af-b812-a0cbbc35a8bc')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa16e0c22-fb, col_values=(('external_ids', {'iface-id': 'a16e0c22-fbe2-4dff-87ed-813f89691a4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:38:94', 'vm-uuid': 'a31eae43-b01c-46cf-9c06-13e9242b5fe1'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:21 user nova-compute[75021]: INFO os_vif [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:38:94,bridge_name='br-int',has_traffic_filtering=True,id=a16e0c22-fbe2-4dff-87ed-813f89691a4f,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16e0c22-fb')
Dec 06 07:15:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:15:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] No VIF found with MAC fa:16:3e:81:38:94, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:15:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-0f7fbe1d-2369-47bc-9447-491b31799f65 req-89086c9e-7331-4893-a5b7-2b6133ffabf0 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received event network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:15:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0f7fbe1d-2369-47bc-9447-491b31799f65 req-89086c9e-7331-4893-a5b7-2b6133ffabf0 service nova] Acquiring lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0f7fbe1d-2369-47bc-9447-491b31799f65 req-89086c9e-7331-4893-a5b7-2b6133ffabf0 service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0f7fbe1d-2369-47bc-9447-491b31799f65 req-89086c9e-7331-4893-a5b7-2b6133ffabf0 service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-0f7fbe1d-2369-47bc-9447-491b31799f65 req-89086c9e-7331-4893-a5b7-2b6133ffabf0 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] No waiting events found dispatching network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:15:23 user nova-compute[75021]: WARNING nova.compute.manager [req-0f7fbe1d-2369-47bc-9447-491b31799f65 req-89086c9e-7331-4893-a5b7-2b6133ffabf0 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received unexpected event network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f for instance with vm_state building and task_state spawning.
Dec 06 07:15:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:15:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:15:24 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Instance spawned successfully.
Dec 06 07:15:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:15:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:15:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:15:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:15:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:15:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:15:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:15:25 user nova-compute[75021]: INFO nova.compute.manager [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Took 5.06 seconds to spawn the instance on the hypervisor.
Dec 06 07:15:25 user nova-compute[75021]: DEBUG nova.compute.manager [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:15:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-db0103f6-a9ed-4ade-970a-adfbe0ab3728 req-a76acd64-19ee-4327-a9ee-f2350c1e6ad1 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received event network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:15:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-db0103f6-a9ed-4ade-970a-adfbe0ab3728 req-a76acd64-19ee-4327-a9ee-f2350c1e6ad1 service nova] Acquiring lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-db0103f6-a9ed-4ade-970a-adfbe0ab3728 req-a76acd64-19ee-4327-a9ee-f2350c1e6ad1 service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-db0103f6-a9ed-4ade-970a-adfbe0ab3728 req-a76acd64-19ee-4327-a9ee-f2350c1e6ad1 service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-db0103f6-a9ed-4ade-970a-adfbe0ab3728 req-a76acd64-19ee-4327-a9ee-f2350c1e6ad1 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] No waiting events found dispatching network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:15:25 user nova-compute[75021]: WARNING nova.compute.manager [req-db0103f6-a9ed-4ade-970a-adfbe0ab3728 req-a76acd64-19ee-4327-a9ee-f2350c1e6ad1 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received unexpected event network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f for instance with vm_state building and task_state spawning.
Dec 06 07:15:25 user nova-compute[75021]: INFO nova.compute.manager [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Took 15.16 seconds to build instance.
Dec 06 07:15:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56e8bc8e-3e25-4cc2-82c6-ca5493f3b2ac tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.258s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.797s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:25 user nova-compute[75021]: INFO nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Dec 06 07:15:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:35 user nova-compute[75021]: INFO nova.compute.manager [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Terminating instance
Dec 06 07:15:35 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-9a1b7bb7-94c0-428f-a5e9-4f661e95210e req-d89ddd1a-dacd-4ad9-a8ce-0ba2f5a5b388 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received event network-vif-unplugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9a1b7bb7-94c0-428f-a5e9-4f661e95210e req-d89ddd1a-dacd-4ad9-a8ce-0ba2f5a5b388 service nova] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9a1b7bb7-94c0-428f-a5e9-4f661e95210e req-d89ddd1a-dacd-4ad9-a8ce-0ba2f5a5b388 service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9a1b7bb7-94c0-428f-a5e9-4f661e95210e req-d89ddd1a-dacd-4ad9-a8ce-0ba2f5a5b388 service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-9a1b7bb7-94c0-428f-a5e9-4f661e95210e req-d89ddd1a-dacd-4ad9-a8ce-0ba2f5a5b388 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] No waiting events found dispatching network-vif-unplugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-9a1b7bb7-94c0-428f-a5e9-4f661e95210e req-d89ddd1a-dacd-4ad9-a8ce-0ba2f5a5b388 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received event network-vif-unplugged-98cd38aa-33d7-4859-a2eb-5b76676e927b for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:15:35 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Instance destroyed successfully.
Dec 06 07:15:35 user nova-compute[75021]: DEBUG nova.objects.instance [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'resources' on Instance uuid a613e2d6-d3f6-4729-aef7-24714608acc9 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-119221818',display_name='tempest-ServerRescueNegativeTestJSON-server-119221818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-119221818',id=2,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:01:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43d3fb6e885546bd9660c81fac9cfa12',ramdisk_id='',reservation_id='r-1z4uta0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-674134420',owner_user_name='tempest-ServerRescueNegativeTestJSON-674134420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:01:09Z,user_data=None,user_id='e6d8114db9fa47c09bc9675da9e19a8c',uuid=a613e2d6-d3f6-4729-aef7-24714608acc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converting VIF {"id": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "address": "fa:16:3e:3a:ab:56", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98cd38aa-33", "ovs_interfaceid": "98cd38aa-33d7-4859-a2eb-5b76676e927b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ab:56,bridge_name='br-int',has_traffic_filtering=True,id=98cd38aa-33d7-4859-a2eb-5b76676e927b,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cd38aa-33') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG os_vif [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ab:56,bridge_name='br-int',has_traffic_filtering=True,id=98cd38aa-33d7-4859-a2eb-5b76676e927b,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cd38aa-33') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98cd38aa-33, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=780c1239-54b3-4199-aa5c-d145d91ae694) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:15:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:36 user nova-compute[75021]: INFO os_vif [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ab:56,bridge_name='br-int',has_traffic_filtering=True,id=98cd38aa-33d7-4859-a2eb-5b76676e927b,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98cd38aa-33')
Dec 06 07:15:36 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Deleting instance files /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9_del
Dec 06 07:15:36 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Deletion of /opt/stack/data/nova/instances/a613e2d6-d3f6-4729-aef7-24714608acc9_del complete
Dec 06 07:15:36 user nova-compute[75021]: INFO nova.compute.manager [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Took 0.69 seconds to destroy the instance on the hypervisor.
Dec 06 07:15:36 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:15:36 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:15:36 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:15:36 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:15:36 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Took 0.50 seconds to deallocate network for instance.
Dec 06 07:15:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-d0eed8be-080a-4856-a99a-8f940dc66560 req-c4cdd92a-061e-4d12-94c0-7c95f76ba483 service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received event network-vif-deleted-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:15:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:36 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Refreshing inventories for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 07:15:36 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Updating ProviderTree inventory for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 07:15:36 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Updating inventory in ProviderTree for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 07:15:36 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Refreshing aggregate associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, aggregates: None {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 07:15:36 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Refreshing trait associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, traits: HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 07:15:37 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:15:37 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:15:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.604s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:37 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Deleted allocations for instance a613e2d6-d3f6-4729-aef7-24714608acc9
Dec 06 07:15:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3f8ed26e-8277-4ae5-af3d-164731b3c951 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.011s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-1a2fd0fd-0da4-4c19-8f37-6c2c819dd781 req-3a9a995e-e73f-4c65-ae2f-32d0f9e1f82e service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:15:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1a2fd0fd-0da4-4c19-8f37-6c2c819dd781 req-3a9a995e-e73f-4c65-ae2f-32d0f9e1f82e service nova] Acquiring lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1a2fd0fd-0da4-4c19-8f37-6c2c819dd781 req-3a9a995e-e73f-4c65-ae2f-32d0f9e1f82e service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1a2fd0fd-0da4-4c19-8f37-6c2c819dd781 req-3a9a995e-e73f-4c65-ae2f-32d0f9e1f82e service nova] Lock "a613e2d6-d3f6-4729-aef7-24714608acc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-1a2fd0fd-0da4-4c19-8f37-6c2c819dd781 req-3a9a995e-e73f-4c65-ae2f-32d0f9e1f82e service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] No waiting events found dispatching network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:15:37 user nova-compute[75021]: WARNING nova.compute.manager [req-1a2fd0fd-0da4-4c19-8f37-6c2c819dd781 req-3a9a995e-e73f-4c65-ae2f-32d0f9e1f82e service nova] [instance: a613e2d6-d3f6-4729-aef7-24714608acc9] Received unexpected event network-vif-plugged-98cd38aa-33d7-4859-a2eb-5b76676e927b for instance with vm_state deleted and task_state None.
Dec 06 07:15:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-8babed1a-30f8-481a-aeba-e6a1502de5be req-c405e17d-9402-470b-ac74-f14f2154536c service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received event network-changed-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:15:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-8babed1a-30f8-481a-aeba-e6a1502de5be req-c405e17d-9402-470b-ac74-f14f2154536c service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Refreshing instance network info cache due to event network-changed-1edcce6c-0464-4647-acec-43b63a19fec3. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:15:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8babed1a-30f8-481a-aeba-e6a1502de5be req-c405e17d-9402-470b-ac74-f14f2154536c service nova] Acquiring lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:15:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8babed1a-30f8-481a-aeba-e6a1502de5be req-c405e17d-9402-470b-ac74-f14f2154536c service nova] Acquired lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:15:45 user nova-compute[75021]: DEBUG nova.network.neutron [req-8babed1a-30f8-481a-aeba-e6a1502de5be req-c405e17d-9402-470b-ac74-f14f2154536c service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Refreshing network info cache for port 1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:15:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Acquiring lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Acquiring lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:46 user nova-compute[75021]: INFO nova.compute.manager [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Terminating instance
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.network.neutron [req-8babed1a-30f8-481a-aeba-e6a1502de5be req-c405e17d-9402-470b-ac74-f14f2154536c service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Updated VIF entry in instance network info cache for port 1edcce6c-0464-4647-acec-43b63a19fec3. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.network.neutron [req-8babed1a-30f8-481a-aeba-e6a1502de5be req-c405e17d-9402-470b-ac74-f14f2154536c service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Updating instance_info_cache with network_info: [{"id": "1edcce6c-0464-4647-acec-43b63a19fec3", "address": "fa:16:3e:39:da:e2", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1edcce6c-04", "ovs_interfaceid": "1edcce6c-0464-4647-acec-43b63a19fec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8babed1a-30f8-481a-aeba-e6a1502de5be req-c405e17d-9402-470b-ac74-f14f2154536c service nova] Releasing lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-b3da12cc-a5b2-4403-b905-555eb70d4d38 req-1b7437d3-ec49-4a6f-abc5-a0087c94b120 service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Received event network-vif-unplugged-15808503-611b-40de-a90c-0275293306ff {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b3da12cc-a5b2-4403-b905-555eb70d4d38 req-1b7437d3-ec49-4a6f-abc5-a0087c94b120 service nova] Acquiring lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b3da12cc-a5b2-4403-b905-555eb70d4d38 req-1b7437d3-ec49-4a6f-abc5-a0087c94b120 service nova] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b3da12cc-a5b2-4403-b905-555eb70d4d38 req-1b7437d3-ec49-4a6f-abc5-a0087c94b120 service nova] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-b3da12cc-a5b2-4403-b905-555eb70d4d38 req-1b7437d3-ec49-4a6f-abc5-a0087c94b120 service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] No waiting events found dispatching network-vif-unplugged-15808503-611b-40de-a90c-0275293306ff {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-b3da12cc-a5b2-4403-b905-555eb70d4d38 req-1b7437d3-ec49-4a6f-abc5-a0087c94b120 service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Received event network-vif-unplugged-15808503-611b-40de-a90c-0275293306ff for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:46 user nova-compute[75021]: INFO nova.compute.manager [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Detaching volume a8d959d0-5cf0-41ee-bfd5-1341589a9ee8
Dec 06 07:15:46 user nova-compute[75021]: INFO nova.virt.block_device [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Attempting to driver detach volume a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 from mountpoint /dev/vdb
Dec 06 07:15:46 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Instance destroyed successfully.
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lazy-loading 'resources' on Instance uuid 5c88eb99-a014-4ff2-86e7-2d34683cd67c {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Attempting to detach device vdb from instance c08cfdd8-44fc-4736-b5dd-d216c75afef6 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:15:46 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:15:46 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:15:46 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:15:46 user nova-compute[75021]:   <serial>a8d959d0-5cf0-41ee-bfd5-1341589a9ee8</serial>
Dec 06 07:15:46 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:15:46 user nova-compute[75021]: </disk>
Dec 06 07:15:46 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:15:46 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Successfully detached device vdb from instance c08cfdd8-44fc-4736-b5dd-d216c75afef6 from the persistent domain config.
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c08cfdd8-44fc-4736-b5dd-d216c75afef6 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:15:46 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:15:46 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:15:46 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:15:46 user nova-compute[75021]:   <serial>a8d959d0-5cf0-41ee-bfd5-1341589a9ee8</serial>
Dec 06 07:15:46 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:15:46 user nova-compute[75021]: </disk>
Dec 06 07:15:46 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1581071268',display_name='tempest-VolumesNegativeTest-instance-1581071268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1581071268',id=32,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:14:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f091460ed1e440eb8a804df83ceb0f43',ramdisk_id='',reservation_id='r-kyqjbkde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1729588497',owner_user_name='tempest-VolumesNegativeTest-1729588497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:14:06Z,user_data=None,user_id='9dd157c8c515451e8c42bf3f680e06e2',uuid=5c88eb99-a014-4ff2-86e7-2d34683cd67c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15808503-611b-40de-a90c-0275293306ff", "address": "fa:16:3e:d0:b0:31", "network": {"id": "fd50bddc-4523-4213-9284-9c538352a85b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4d272cf95f0431d87ca72a2872f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15808503-61", "ovs_interfaceid": "15808503-611b-40de-a90c-0275293306ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Converting VIF {"id": "15808503-611b-40de-a90c-0275293306ff", "address": "fa:16:3e:d0:b0:31", "network": {"id": "fd50bddc-4523-4213-9284-9c538352a85b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4d272cf95f0431d87ca72a2872f0124", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15808503-61", "ovs_interfaceid": "15808503-611b-40de-a90c-0275293306ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b0:31,bridge_name='br-int',has_traffic_filtering=True,id=15808503-611b-40de-a90c-0275293306ff,network=Network(fd50bddc-4523-4213-9284-9c538352a85b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15808503-61') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG os_vif [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b0:31,bridge_name='br-int',has_traffic_filtering=True,id=15808503-611b-40de-a90c-0275293306ff,network=Network(fd50bddc-4523-4213-9284-9c538352a85b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15808503-61') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15808503-61, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f4f2403-6202-4819-b5cf-1bc69a3cbdd5) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "2696d783-bb1e-4709-9683-c8ad1ffc627f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:15:46 user nova-compute[75021]: INFO os_vif [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b0:31,bridge_name='br-int',has_traffic_filtering=True,id=15808503-611b-40de-a90c-0275293306ff,network=Network(fd50bddc-4523-4213-9284-9c538352a85b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15808503-61')
Dec 06 07:15:46 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Deleting instance files /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c_del
Dec 06 07:15:46 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Deletion of /opt/stack/data/nova/instances/5c88eb99-a014-4ff2-86e7-2d34683cd67c_del complete
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:15:46 user nova-compute[75021]: INFO nova.compute.manager [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Took 0.93 seconds to destroy the instance on the hypervisor.
Dec 06 07:15:46 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:15:46 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:15:47 user nova-compute[75021]: INFO nova.compute.claims [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Claim successful on node user
Dec 06 07:15:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c08cfdd8-44fc-4736-b5dd-d216c75afef6 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:15:47 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Took 0.56 seconds to deallocate network for instance.
Dec 06 07:15:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:47 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:15:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG nova.policy [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5e1155d2c304bdd8404712faf046b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae65045cef754813bd33f68b9868dc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:15:47 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Creating image(s)
Dec 06 07:15:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "/opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "/opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "/opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-6ab0d445-167a-46d3-be09-29bad5a229d9 req-01d2eec0-1541-44d6-b89f-70ce581ee574 service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Received event network-vif-deleted-15808503-611b-40de-a90c-0275293306ff {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:48 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Deleted allocations for instance 5c88eb99-a014-4ff2-86e7-2d34683cd67c
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.187s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk 1073741824" returned: 0 in 0.061s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b06f7397-dc6d-4d4c-a622-2989710d5c01 tempest-VolumesNegativeTest-1729588497 tempest-VolumesNegativeTest-1729588497-project-member] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.229s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-0f869667-79ff-430f-98ab-6d16e57b47a7 req-2232b66e-92c9-41ba-b3bb-1366fb27cccf service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received event network-changed-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-0f869667-79ff-430f-98ab-6d16e57b47a7 req-2232b66e-92c9-41ba-b3bb-1366fb27cccf service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Refreshing instance network info cache due to event network-changed-1edcce6c-0464-4647-acec-43b63a19fec3. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0f869667-79ff-430f-98ab-6d16e57b47a7 req-2232b66e-92c9-41ba-b3bb-1366fb27cccf service nova] Acquiring lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0f869667-79ff-430f-98ab-6d16e57b47a7 req-2232b66e-92c9-41ba-b3bb-1366fb27cccf service nova] Acquired lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.network.neutron [req-0f869667-79ff-430f-98ab-6d16e57b47a7 req-2232b66e-92c9-41ba-b3bb-1366fb27cccf service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Refreshing network info cache for port 1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Cannot resize image /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Ensure instance console log exists: /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-b4e3cc56-33f3-461f-91aa-b5111f7ad9af req-14e82197-45a3-4b22-8429-58d638685dcd service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-changed-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-b4e3cc56-33f3-461f-91aa-b5111f7ad9af req-14e82197-45a3-4b22-8429-58d638685dcd service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Refreshing instance network info cache due to event network-changed-ac69c289-818f-48bb-a95e-2e72646ef67e. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b4e3cc56-33f3-461f-91aa-b5111f7ad9af req-14e82197-45a3-4b22-8429-58d638685dcd service nova] Acquiring lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b4e3cc56-33f3-461f-91aa-b5111f7ad9af req-14e82197-45a3-4b22-8429-58d638685dcd service nova] Acquired lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.network.neutron [req-b4e3cc56-33f3-461f-91aa-b5111f7ad9af req-14e82197-45a3-4b22-8429-58d638685dcd service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Refreshing network info cache for port ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.network.neutron [req-0f869667-79ff-430f-98ab-6d16e57b47a7 req-2232b66e-92c9-41ba-b3bb-1366fb27cccf service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Updated VIF entry in instance network info cache for port 1edcce6c-0464-4647-acec-43b63a19fec3. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.network.neutron [req-0f869667-79ff-430f-98ab-6d16e57b47a7 req-2232b66e-92c9-41ba-b3bb-1366fb27cccf service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Updating instance_info_cache with network_info: [{"id": "1edcce6c-0464-4647-acec-43b63a19fec3", "address": "fa:16:3e:39:da:e2", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1edcce6c-04", "ovs_interfaceid": "1edcce6c-0464-4647-acec-43b63a19fec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0f869667-79ff-430f-98ab-6d16e57b47a7 req-2232b66e-92c9-41ba-b3bb-1366fb27cccf service nova] Releasing lock "refresh_cache-c08cfdd8-44fc-4736-b5dd-d216c75afef6" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-0f869667-79ff-430f-98ab-6d16e57b47a7 req-2232b66e-92c9-41ba-b3bb-1366fb27cccf service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Received event network-vif-plugged-15808503-611b-40de-a90c-0275293306ff {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0f869667-79ff-430f-98ab-6d16e57b47a7 req-2232b66e-92c9-41ba-b3bb-1366fb27cccf service nova] Acquiring lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0f869667-79ff-430f-98ab-6d16e57b47a7 req-2232b66e-92c9-41ba-b3bb-1366fb27cccf service nova] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0f869667-79ff-430f-98ab-6d16e57b47a7 req-2232b66e-92c9-41ba-b3bb-1366fb27cccf service nova] Lock "5c88eb99-a014-4ff2-86e7-2d34683cd67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-0f869667-79ff-430f-98ab-6d16e57b47a7 req-2232b66e-92c9-41ba-b3bb-1366fb27cccf service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] No waiting events found dispatching network-vif-plugged-15808503-611b-40de-a90c-0275293306ff {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:15:48 user nova-compute[75021]: WARNING nova.compute.manager [req-0f869667-79ff-430f-98ab-6d16e57b47a7 req-2232b66e-92c9-41ba-b3bb-1366fb27cccf service nova] [instance: 5c88eb99-a014-4ff2-86e7-2d34683cd67c] Received unexpected event network-vif-plugged-15808503-611b-40de-a90c-0275293306ff for instance with vm_state deleted and task_state None.
Dec 06 07:15:48 user nova-compute[75021]: DEBUG nova.network.neutron [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Successfully created port: 27433f1d-9497-4e66-8303-57382337858b {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-b4e3cc56-33f3-461f-91aa-b5111f7ad9af req-14e82197-45a3-4b22-8429-58d638685dcd service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Updated VIF entry in instance network info cache for port ac69c289-818f-48bb-a95e-2e72646ef67e. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-b4e3cc56-33f3-461f-91aa-b5111f7ad9af req-14e82197-45a3-4b22-8429-58d638685dcd service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Updating instance_info_cache with network_info: [{"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b4e3cc56-33f3-461f-91aa-b5111f7ad9af req-14e82197-45a3-4b22-8429-58d638685dcd service nova] Releasing lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.network.neutron [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Successfully updated port: 27433f1d-9497-4e66-8303-57382337858b {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "refresh_cache-2696d783-bb1e-4709-9683-c8ad1ffc627f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquired lock "refresh_cache-2696d783-bb1e-4709-9683-c8ad1ffc627f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.network.neutron [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.network.neutron [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-e8fec154-71d4-4132-842a-afaf0e0544d9 req-2a352a84-f166-4667-b305-5ac452cebde3 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Received event network-changed-27433f1d-9497-4e66-8303-57382337858b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-e8fec154-71d4-4132-842a-afaf0e0544d9 req-2a352a84-f166-4667-b305-5ac452cebde3 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Refreshing instance network info cache due to event network-changed-27433f1d-9497-4e66-8303-57382337858b. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e8fec154-71d4-4132-842a-afaf0e0544d9 req-2a352a84-f166-4667-b305-5ac452cebde3 service nova] Acquiring lock "refresh_cache-2696d783-bb1e-4709-9683-c8ad1ffc627f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.network.neutron [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Updating instance_info_cache with network_info: [{"id": "27433f1d-9497-4e66-8303-57382337858b", "address": "fa:16:3e:88:5a:01", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27433f1d-94", "ovs_interfaceid": "27433f1d-9497-4e66-8303-57382337858b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Releasing lock "refresh_cache-2696d783-bb1e-4709-9683-c8ad1ffc627f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Instance network_info: |[{"id": "27433f1d-9497-4e66-8303-57382337858b", "address": "fa:16:3e:88:5a:01", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27433f1d-94", "ovs_interfaceid": "27433f1d-9497-4e66-8303-57382337858b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e8fec154-71d4-4132-842a-afaf0e0544d9 req-2a352a84-f166-4667-b305-5ac452cebde3 service nova] Acquired lock "refresh_cache-2696d783-bb1e-4709-9683-c8ad1ffc627f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-e8fec154-71d4-4132-842a-afaf0e0544d9 req-2a352a84-f166-4667-b305-5ac452cebde3 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Refreshing network info cache for port 27433f1d-9497-4e66-8303-57382337858b {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Start _get_guest_xml network_info=[{"id": "27433f1d-9497-4e66-8303-57382337858b", "address": "fa:16:3e:88:5a:01", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27433f1d-94", "ovs_interfaceid": "27433f1d-9497-4e66-8303-57382337858b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:15:49 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:15:49 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1634997589',display_name='tempest-AttachVolumeNegativeTest-server-1634997589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1634997589',id=36,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9e4V3nlf8sH5b/RhgHKYvcpls42DkvshkjSLuywJkvLpIsyIsMYhSc22mwBYhF8RtvBtFcIPB86AAY6M+acFNG//GF2CYwCR71xi0XRMFexZMeWL1G1SV44TafftB+5Q==',key_name='tempest-keypair-393715469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae65045cef754813bd33f68b9868dc9d',ramdisk_id='',reservation_id='r-183i0u7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-967416759',owner_user_name='tempest-AttachVolumeNegativeTest-967416759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:15:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e1155d2c304bdd8404712faf046b05',uuid=2696d783-bb1e-4709-9683-c8ad1ffc627f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27433f1d-9497-4e66-8303-57382337858b", "address": "fa:16:3e:88:5a:01", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27433f1d-94", "ovs_interfaceid": "27433f1d-9497-4e66-8303-57382337858b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converting VIF {"id": "27433f1d-9497-4e66-8303-57382337858b", "address": "fa:16:3e:88:5a:01", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27433f1d-94", "ovs_interfaceid": "27433f1d-9497-4e66-8303-57382337858b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:5a:01,bridge_name='br-int',has_traffic_filtering=True,id=27433f1d-9497-4e66-8303-57382337858b,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27433f1d-94') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:15:49 user nova-compute[75021]: DEBUG nova.objects.instance [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'pci_devices' on Instance uuid 2696d783-bb1e-4709-9683-c8ad1ffc627f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:15:50 user nova-compute[75021]:   <uuid>2696d783-bb1e-4709-9683-c8ad1ffc627f</uuid>
Dec 06 07:15:50 user nova-compute[75021]:   <name>instance-00000024</name>
Dec 06 07:15:50 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:15:50 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:15:50 user nova-compute[75021]:   <metadata>
Dec 06 07:15:50 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:15:50 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:15:50 user nova-compute[75021]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1634997589</nova:name>
Dec 06 07:15:50 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:15:49</nova:creationTime>
Dec 06 07:15:50 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:15:50 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:15:50 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:15:50 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:15:50 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:15:50 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:15:50 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:15:50 user nova-compute[75021]:       <nova:owner>
Dec 06 07:15:50 user nova-compute[75021]:         <nova:user uuid="c5e1155d2c304bdd8404712faf046b05">tempest-AttachVolumeNegativeTest-967416759-project-member</nova:user>
Dec 06 07:15:50 user nova-compute[75021]:         <nova:project uuid="ae65045cef754813bd33f68b9868dc9d">tempest-AttachVolumeNegativeTest-967416759</nova:project>
Dec 06 07:15:50 user nova-compute[75021]:       </nova:owner>
Dec 06 07:15:50 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:15:50 user nova-compute[75021]:       <nova:ports>
Dec 06 07:15:50 user nova-compute[75021]:         <nova:port uuid="27433f1d-9497-4e66-8303-57382337858b">
Dec 06 07:15:50 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 07:15:50 user nova-compute[75021]:         </nova:port>
Dec 06 07:15:50 user nova-compute[75021]:       </nova:ports>
Dec 06 07:15:50 user nova-compute[75021]:     </nova:instance>
Dec 06 07:15:50 user nova-compute[75021]:   </metadata>
Dec 06 07:15:50 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:15:50 user nova-compute[75021]:     <system>
Dec 06 07:15:50 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:15:50 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:15:50 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:15:50 user nova-compute[75021]:       <entry name="serial">2696d783-bb1e-4709-9683-c8ad1ffc627f</entry>
Dec 06 07:15:50 user nova-compute[75021]:       <entry name="uuid">2696d783-bb1e-4709-9683-c8ad1ffc627f</entry>
Dec 06 07:15:50 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:15:50 user nova-compute[75021]:     </system>
Dec 06 07:15:50 user nova-compute[75021]:   </sysinfo>
Dec 06 07:15:50 user nova-compute[75021]:   <os>
Dec 06 07:15:50 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:15:50 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:15:50 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:15:50 user nova-compute[75021]:   </os>
Dec 06 07:15:50 user nova-compute[75021]:   <features>
Dec 06 07:15:50 user nova-compute[75021]:     <acpi/>
Dec 06 07:15:50 user nova-compute[75021]:     <apic/>
Dec 06 07:15:50 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:15:50 user nova-compute[75021]:   </features>
Dec 06 07:15:50 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:15:50 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:15:50 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:15:50 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:15:50 user nova-compute[75021]:   </clock>
Dec 06 07:15:50 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:15:50 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:15:50 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:15:50 user nova-compute[75021]:   </cpu>
Dec 06 07:15:50 user nova-compute[75021]:   <devices>
Dec 06 07:15:50 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:15:50 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:15:50 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk"/>
Dec 06 07:15:50 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:15:50 user nova-compute[75021]:     </disk>
Dec 06 07:15:50 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:15:50 user nova-compute[75021]:       <mac address="fa:16:3e:88:5a:01"/>
Dec 06 07:15:50 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:15:50 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:15:50 user nova-compute[75021]:       <target dev="tap27433f1d-94"/>
Dec 06 07:15:50 user nova-compute[75021]:     </interface>
Dec 06 07:15:50 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:15:50 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/console.log" append="off"/>
Dec 06 07:15:50 user nova-compute[75021]:     </serial>
Dec 06 07:15:50 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:15:50 user nova-compute[75021]:     <video>
Dec 06 07:15:50 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:15:50 user nova-compute[75021]:     </video>
Dec 06 07:15:50 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:15:50 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:15:50 user nova-compute[75021]:     </rng>
Dec 06 07:15:50 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:15:50 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:15:50 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:15:50 user nova-compute[75021]:     </memballoon>
Dec 06 07:15:50 user nova-compute[75021]:   </devices>
Dec 06 07:15:50 user nova-compute[75021]: </domain>
Dec 06 07:15:50 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1634997589',display_name='tempest-AttachVolumeNegativeTest-server-1634997589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1634997589',id=36,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9e4V3nlf8sH5b/RhgHKYvcpls42DkvshkjSLuywJkvLpIsyIsMYhSc22mwBYhF8RtvBtFcIPB86AAY6M+acFNG//GF2CYwCR71xi0XRMFexZMeWL1G1SV44TafftB+5Q==',key_name='tempest-keypair-393715469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae65045cef754813bd33f68b9868dc9d',ramdisk_id='',reservation_id='r-183i0u7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-967416759',owner_user_name='tempest-AttachVolumeNegativeTest-967416759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:15:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e1155d2c304bdd8404712faf046b05',uuid=2696d783-bb1e-4709-9683-c8ad1ffc627f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27433f1d-9497-4e66-8303-57382337858b", "address": "fa:16:3e:88:5a:01", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27433f1d-94", "ovs_interfaceid": "27433f1d-9497-4e66-8303-57382337858b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converting VIF {"id": "27433f1d-9497-4e66-8303-57382337858b", "address": "fa:16:3e:88:5a:01", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27433f1d-94", "ovs_interfaceid": "27433f1d-9497-4e66-8303-57382337858b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:5a:01,bridge_name='br-int',has_traffic_filtering=True,id=27433f1d-9497-4e66-8303-57382337858b,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27433f1d-94') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG os_vif [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5a:01,bridge_name='br-int',has_traffic_filtering=True,id=27433f1d-9497-4e66-8303-57382337858b,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27433f1d-94') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '978bf54e-1c99-5ae1-bffa-183fd7ceecc2', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27433f1d-94, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27433f1d-94, col_values=(('qos', UUID('d1c9d1aa-8905-414d-9e66-4523ab042b9d')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27433f1d-94, col_values=(('external_ids', {'iface-id': '27433f1d-9497-4e66-8303-57382337858b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:5a:01', 'vm-uuid': '2696d783-bb1e-4709-9683-c8ad1ffc627f'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:50 user nova-compute[75021]: INFO os_vif [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5a:01,bridge_name='br-int',has_traffic_filtering=True,id=27433f1d-9497-4e66-8303-57382337858b,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27433f1d-94')
Dec 06 07:15:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No VIF found with MAC fa:16:3e:88:5a:01, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG nova.network.neutron [req-e8fec154-71d4-4132-842a-afaf0e0544d9 req-2a352a84-f166-4667-b305-5ac452cebde3 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Updated VIF entry in instance network info cache for port 27433f1d-9497-4e66-8303-57382337858b. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG nova.network.neutron [req-e8fec154-71d4-4132-842a-afaf0e0544d9 req-2a352a84-f166-4667-b305-5ac452cebde3 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Updating instance_info_cache with network_info: [{"id": "27433f1d-9497-4e66-8303-57382337858b", "address": "fa:16:3e:88:5a:01", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27433f1d-94", "ovs_interfaceid": "27433f1d-9497-4e66-8303-57382337858b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:15:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e8fec154-71d4-4132-842a-afaf0e0544d9 req-2a352a84-f166-4667-b305-5ac452cebde3 service nova] Releasing lock "refresh_cache-2696d783-bb1e-4709-9683-c8ad1ffc627f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:15:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-0d80400b-70ac-4107-9002-d58fa68ae6f9 req-9272305f-b182-4466-83a4-56d5538b5cef service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Received event network-vif-plugged-27433f1d-9497-4e66-8303-57382337858b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:15:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0d80400b-70ac-4107-9002-d58fa68ae6f9 req-9272305f-b182-4466-83a4-56d5538b5cef service nova] Acquiring lock "2696d783-bb1e-4709-9683-c8ad1ffc627f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0d80400b-70ac-4107-9002-d58fa68ae6f9 req-9272305f-b182-4466-83a4-56d5538b5cef service nova] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0d80400b-70ac-4107-9002-d58fa68ae6f9 req-9272305f-b182-4466-83a4-56d5538b5cef service nova] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-0d80400b-70ac-4107-9002-d58fa68ae6f9 req-9272305f-b182-4466-83a4-56d5538b5cef service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] No waiting events found dispatching network-vif-plugged-27433f1d-9497-4e66-8303-57382337858b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:15:51 user nova-compute[75021]: WARNING nova.compute.manager [req-0d80400b-70ac-4107-9002-d58fa68ae6f9 req-9272305f-b182-4466-83a4-56d5538b5cef service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Received unexpected event network-vif-plugged-27433f1d-9497-4e66-8303-57382337858b for instance with vm_state building and task_state spawning.
Dec 06 07:15:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:52 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'flavor' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:15:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:52 user nova-compute[75021]: INFO nova.compute.manager [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Attaching volume 894f0d86-2788-4a34-83db-84324142d4a8 to /dev/vdb
Dec 06 07:15:53 user nova-compute[75021]: DEBUG os_brick.utils [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b173c-731e-4f2d-aec2-4c294218b790]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fb7bfe-b16a-41a1-aa97-610f0e5badf7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b72522-38e0-4abb-bd72-a0fbe78fb130]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb0e61e-170c-4c21-a8e6-76a61f18b376]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:15:53 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[485c5f0c-55df-4c28-a3e0-1f63dc745774]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG os_brick.utils [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Updating existing volume attachment record: 050a4958-c294-405a-abbf-67e33555214e {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:15:53 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Instance spawned successfully.
Dec 06 07:15:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-8b9c9852-af8c-40a5-9f94-b5a8e265a423 req-18bb5e89-5e0f-4930-909e-307030c207cc service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Received event network-vif-plugged-27433f1d-9497-4e66-8303-57382337858b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8b9c9852-af8c-40a5-9f94-b5a8e265a423 req-18bb5e89-5e0f-4930-909e-307030c207cc service nova] Acquiring lock "2696d783-bb1e-4709-9683-c8ad1ffc627f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8b9c9852-af8c-40a5-9f94-b5a8e265a423 req-18bb5e89-5e0f-4930-909e-307030c207cc service nova] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8b9c9852-af8c-40a5-9f94-b5a8e265a423 req-18bb5e89-5e0f-4930-909e-307030c207cc service nova] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-8b9c9852-af8c-40a5-9f94-b5a8e265a423 req-18bb5e89-5e0f-4930-909e-307030c207cc service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] No waiting events found dispatching network-vif-plugged-27433f1d-9497-4e66-8303-57382337858b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:15:53 user nova-compute[75021]: WARNING nova.compute.manager [req-8b9c9852-af8c-40a5-9f94-b5a8e265a423 req-18bb5e89-5e0f-4930-909e-307030c207cc service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Received unexpected event network-vif-plugged-27433f1d-9497-4e66-8303-57382337858b for instance with vm_state building and task_state spawning.
Dec 06 07:15:54 user nova-compute[75021]: INFO nova.compute.manager [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Took 6.24 seconds to spawn the instance on the hypervisor.
Dec 06 07:15:54 user nova-compute[75021]: DEBUG nova.compute.manager [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:15:54 user nova-compute[75021]: INFO nova.compute.manager [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Took 7.07 seconds to build instance.
Dec 06 07:15:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-736c17f4-1100-48df-b0ec-130d40ff0288 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.192s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:15:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:15:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "2064385e-a37f-468e-bed6-129eb54295ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "2064385e-a37f-468e-bed6-129eb54295ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:16:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:16:01 user nova-compute[75021]: INFO nova.compute.claims [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Claim successful on node user
Dec 06 07:16:01 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:16:01 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:16:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:16:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:16:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:16:01 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:16:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:16:01 user nova-compute[75021]: INFO nova.virt.block_device [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Booting with volume-backed-image a0676e02-e61a-446d-aeb1-22dc06cf490d at /dev/vda
Dec 06 07:16:01 user nova-compute[75021]: DEBUG nova.policy [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0774aa1e3ee4b69b195b575d116ee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9895e43bf76d4760a26a5e64ea6d4e14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:16:02 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Successfully created port: 19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:16:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Successfully updated port: 19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:16:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "refresh_cache-2064385e-a37f-468e-bed6-129eb54295ae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:16:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquired lock "refresh_cache-2064385e-a37f-468e-bed6-129eb54295ae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:16:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:16:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-b2227243-2813-4b94-93cf-7eba3900d7ff req-251a7a1c-68bb-498f-9bae-81bfca71e6b6 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received event network-changed-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:16:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-b2227243-2813-4b94-93cf-7eba3900d7ff req-251a7a1c-68bb-498f-9bae-81bfca71e6b6 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Refreshing instance network info cache due to event network-changed-19f8ce24-a977-46ee-a878-728ddc13a4e0. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:16:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b2227243-2813-4b94-93cf-7eba3900d7ff req-251a7a1c-68bb-498f-9bae-81bfca71e6b6 service nova] Acquiring lock "refresh_cache-2064385e-a37f-468e-bed6-129eb54295ae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:16:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:16:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Updating instance_info_cache with network_info: [{"id": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "address": "fa:16:3e:d4:2a:27", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f8ce24-a9", "ovs_interfaceid": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:16:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Releasing lock "refresh_cache-2064385e-a37f-468e-bed6-129eb54295ae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:16:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Instance network_info: |[{"id": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "address": "fa:16:3e:d4:2a:27", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f8ce24-a9", "ovs_interfaceid": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:16:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b2227243-2813-4b94-93cf-7eba3900d7ff req-251a7a1c-68bb-498f-9bae-81bfca71e6b6 service nova] Acquired lock "refresh_cache-2064385e-a37f-468e-bed6-129eb54295ae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:16:03 user nova-compute[75021]: DEBUG nova.network.neutron [req-b2227243-2813-4b94-93cf-7eba3900d7ff req-251a7a1c-68bb-498f-9bae-81bfca71e6b6 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Refreshing network info cache for port 19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:16:04 user nova-compute[75021]: DEBUG nova.network.neutron [req-b2227243-2813-4b94-93cf-7eba3900d7ff req-251a7a1c-68bb-498f-9bae-81bfca71e6b6 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Updated VIF entry in instance network info cache for port 19f8ce24-a977-46ee-a878-728ddc13a4e0. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:16:04 user nova-compute[75021]: DEBUG nova.network.neutron [req-b2227243-2813-4b94-93cf-7eba3900d7ff req-251a7a1c-68bb-498f-9bae-81bfca71e6b6 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Updating instance_info_cache with network_info: [{"id": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "address": "fa:16:3e:d4:2a:27", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f8ce24-a9", "ovs_interfaceid": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:16:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b2227243-2813-4b94-93cf-7eba3900d7ff req-251a7a1c-68bb-498f-9bae-81bfca71e6b6 service nova] Releasing lock "refresh_cache-2064385e-a37f-468e-bed6-129eb54295ae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:16:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:06 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:16:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:06 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:16:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:07 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c08cfdd8-44fc-4736-b5dd-d216c75afef6 is timed out.
Dec 06 07:16:07 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Successfully detached device vdb from instance c08cfdd8-44fc-4736-b5dd-d216c75afef6 from the live domain config.
Dec 06 07:16:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGMRQwfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:16:07 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[771710d6-6d68-4ae6-89c7-b823e7c994e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:16:07 user nova-compute[75021]: No targets found.
Dec 06 07:16:07 user nova-compute[75021]: iSNS:
Dec 06 07:16:07 user nova-compute[75021]: No targets found.
Dec 06 07:16:07 user nova-compute[75021]: STATIC:
Dec 06 07:16:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:16:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:16:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:16:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc
Dec 06 07:16:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:16:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:16:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8
Dec 06 07:16:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:16:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:16:07 user nova-compute[75021]: FIRMWARE:
Dec 06 07:16:07 user nova-compute[75021]: No targets found.
Dec 06 07:16:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:16:07 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:16:07 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[244dc974-ef34-43ff-b3e6-01a539d18cc5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad07c038-39f5-4d1c-8993-601abd024262]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:16:07 user nova-compute[75021]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)
Dec 06 07:16:07 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:16:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:16:07 user nova-compute[75021]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 (non-flash)
Dec 06 07:16:07 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:16:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d87e2d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bdc3b4-46b4-4efa-82d8-af0d4da9b453]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6e6d52-cdfb-4f86-88c4-1884ccea52a3]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8781f73b-f0f1-42c6-abd1-23fec7693b55]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.209s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc0db20-aa88-4aef-93a8-ee632ff70f8d]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1036e8-4bd6-4728-a3cb-398c62e5e18e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d708bb22-96a7-4ff8-b7f1-b347d29d5871]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8, portal: 172.16.0.220,3260]
Dec 06 07:16:07 user nova-compute[75021]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8, portal: 172.16.0.220,3260] successful.
Dec 06 07:16:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d959d0-5cf0-41ee-bfd5-1341589a9ee8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f5afa2-9225-4de5-ab48-66e590b9c380]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.554s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] <== disconnect_volume: return (556ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:16:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:08 user nova-compute[75021]: DEBUG nova.objects.instance [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lazy-loading 'flavor' on Instance uuid c08cfdd8-44fc-4736-b5dd-d216c75afef6 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:16:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c7c4dfef-f8de-4df7-abf2-ad451f3006f2 tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.208s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvwfnuhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:16:09 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:16:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:16:09 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:16:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:16:09 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3cc60f-809c-4f28-b4a6-759a8bd76731]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:16:09 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd6a7a1-d17c-4dfa-a580-a44520c59025]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8] added
Dec 06 07:16:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d817c3-200e-44c5-983a-da8321e3815d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19eba47-5861-4b62-8b52-8b4eb428b91d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OvwfnuhH {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OvwfnuhH" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[041148c9-feab-487d-ad02-43c75e0e8baf]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OvwfnuhH'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[237320e4-fe1d-47f4-aa27-adbb305389eb]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2810919-960c-483f-8294-90f12b59275b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:16:09 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:16:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:16:09 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:16:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ff77c6-f8df-4dbc-8242-622021a3495b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260]
Dec 06 07:16:09 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260] successful.
Dec 06 07:16:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f644ad10-1455-41f3-a276-44e0151b62a6]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:10 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:16:10 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7725MB free_disk=25.13318634033203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffea6277-7bd5-4ddf-9c0d-282aeda07f89]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:16:10 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:16:10 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:16:10 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:16:10 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:16:10 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:16:10 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.676s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b615766-5b1d-48e2-93db-fe60dcad3f11]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvwfnuhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance c08cfdd8-44fc-4736-b5dd-d216c75afef6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 58ef39ae-4b66-42e6-ae22-5308a98eb55d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 92c63579-741c-4daa-9568-f7ddf95e3729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a31eae43-b01c-46cf-9c06-13e9242b5fe1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2696d783-bb1e-4709-9683-c8ad1ffc627f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2064385e-a37f-468e-bed6-129eb54295ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:16:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:11 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.712s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:16:11 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] <== connect_volume: return (1714ms) {'type': 'block', 'scsi_wwn': '23138376365636265', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:16:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138376365636265', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:16:11 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'flavor' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:16:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:16:11 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:16:11 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:16:11 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:16:11 user nova-compute[75021]:   <serial>894f0d86-2788-4a34-83db-84324142d4a8</serial>
Dec 06 07:16:11 user nova-compute[75021]: </disk>
Dec 06 07:16:11 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:16:11 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:16:11 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:16:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:16:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:16:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] No VIF found with MAC fa:16:3e:4f:e9:89, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:16:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-b9372825-c75d-45a3-a48c-e111869d97a5" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:16:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-b9372825-c75d-45a3-a48c-e111869d97a5" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:16:11 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:16:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9e912954-46da-4337-9627-183ca3c19bd9 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.813s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Updating instance_info_cache with network_info: [{"id": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "address": "fa:16:3e:fb:4a:05", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c8a95e-1a", "ovs_interfaceid": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-b9372825-c75d-45a3-a48c-e111869d97a5" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e95b28cc-e293-4ee4-bb7f-ad5efbfdc77b tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e95b28cc-e293-4ee4-bb7f-ad5efbfdc77b tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e95b28cc-e293-4ee4-bb7f-ad5efbfdc77b tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e95b28cc-e293-4ee4-bb7f-ad5efbfdc77b tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75021) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e95b28cc-e293-4ee4-bb7f-ad5efbfdc77b tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'flavor' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG os_brick.utils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea45094f-cfc4-4783-8f56-6228a2bbc38a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fef0ef-8092-470e-b0df-f8ebb7373a4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd0f649-f401-4b1f-9343-b24d024dc8cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ba73b9-2555-44db-86bc-820df2d8eed5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:16:12 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d31c03-116e-4cc1-9244-8a9ca2b5f29c]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG os_brick.utils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Updating existing volume attachment record: 404ef3ae-db6d-420a-a512-f60d615cb9ad {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-fa1b4c18-6495-4660-97c6-9296a0dd0785 req-3eba45cb-783c-467a-9755-6642d43f082b service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-unplugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fa1b4c18-6495-4660-97c6-9296a0dd0785 req-3eba45cb-783c-467a-9755-6642d43f082b service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fa1b4c18-6495-4660-97c6-9296a0dd0785 req-3eba45cb-783c-467a-9755-6642d43f082b service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fa1b4c18-6495-4660-97c6-9296a0dd0785 req-3eba45cb-783c-467a-9755-6642d43f082b service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-fa1b4c18-6495-4660-97c6-9296a0dd0785 req-3eba45cb-783c-467a-9755-6642d43f082b service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-unplugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:16:12 user nova-compute[75021]: WARNING nova.compute.manager [req-fa1b4c18-6495-4660-97c6-9296a0dd0785 req-3eba45cb-783c-467a-9755-6642d43f082b service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received unexpected event network-vif-unplugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with vm_state active and task_state powering-off.
Dec 06 07:16:13 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Instance destroyed successfully.
Dec 06 07:16:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e95b28cc-e293-4ee4-bb7f-ad5efbfdc77b tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:16:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e95b28cc-e293-4ee4-bb7f-ad5efbfdc77b tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.901s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:14 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:16:14 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:16:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-a7436d44-ab9f-4e6e-9ae6-b7d6fc0ffe9e req-a6551259-5d0e-41b3-bc41-b1a510613c9e service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:16:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a7436d44-ab9f-4e6e-9ae6-b7d6fc0ffe9e req-a6551259-5d0e-41b3-bc41-b1a510613c9e service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a7436d44-ab9f-4e6e-9ae6-b7d6fc0ffe9e req-a6551259-5d0e-41b3-bc41-b1a510613c9e service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a7436d44-ab9f-4e6e-9ae6-b7d6fc0ffe9e req-a6551259-5d0e-41b3-bc41-b1a510613c9e service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-a7436d44-ab9f-4e6e-9ae6-b7d6fc0ffe9e req-a6551259-5d0e-41b3-bc41-b1a510613c9e service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:16:14 user nova-compute[75021]: WARNING nova.compute.manager [req-a7436d44-ab9f-4e6e-9ae6-b7d6fc0ffe9e req-a6551259-5d0e-41b3-bc41-b1a510613c9e service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received unexpected event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with vm_state stopped and task_state None.
Dec 06 07:16:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:16 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:16:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:16:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Creating image(s)
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Ensure instance console log exists: /opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Start _get_guest_xml network_info=[{"id": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "address": "fa:16:3e:d4:2a:27", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f8ce24-a9", "ovs_interfaceid": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '404ef3ae-db6d-420a-a512-f60d615cb9ad', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZAMnyFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2064385e-a37f-468e-bed6-129eb54295ae', 'attached_at': '', 'detached_at': '', 'volume_id': '98bfe29a-a367-4b70-9d31-877ed682847c', 'serial': '98bfe29a-a367-4b70-9d31-877ed682847c'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:16:22 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:16:22 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZAMnyFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:16:22 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:16:22 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:16:22 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1e437a-b124-42d0-b95a-68511754b5b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:16:22 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[631d0d0c-0941-4e61-8dbb-9cc461861c3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c] added
Dec 06 07:16:22 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2e01f7-2a23-4d8c-a5b8-b9a50070db6b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7eb1ed-fab4-45c9-83d4-e35e547e7d26]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZAMnyFp {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZAMnyFp" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c010df-35f4-403f-b694-fb862548857c]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gZAMnyFp'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d57d8ea-3b7c-46f2-b26e-6daed746476e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5e1983-ff9b-480c-8b91-c4801f28bc51]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:16:22 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:16:22 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:16:22 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:16:22 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:16:22 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:16:22 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ef5a21-ca43-46d9-ba1d-bd7d1cd8365f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c, portal: 172.16.0.220,3260]
Dec 06 07:16:22 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c, portal: 172.16.0.220,3260] successful.
Dec 06 07:16:22 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae809c34-ae1d-426e-87b5-abaf8dfb26d4]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb62721-7efb-4c70-bcb2-db411c9b4f13]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:16:22 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:16:22 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:16:22 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:16:22 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:16:22 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:16:22 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:16:22 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:16:22 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9ba959-dbb8-4c22-8ba3-1ad82883e07c]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:16:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZAMnyFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:16:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:16:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26634393464306133', 'path': '/dev/sde'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:16:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634393464306133', 'path': '/dev/sde'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1457326660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1457326660',id=37,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9895e43bf76d4760a26a5e64ea6d4e14',ramdisk_id='',reservation_id='r-b1vuxe2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:16:02Z,user_data=None,user_id='c0774aa1e3ee4b69b195b575d116ee96',uuid=2064385e-a37f-468e-bed6-129eb54295ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "address": "fa:16:3e:d4:2a:27", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f8ce24-a9", "ovs_interfaceid": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converting VIF {"id": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "address": "fa:16:3e:d4:2a:27", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f8ce24-a9", "ovs_interfaceid": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2a:27,bridge_name='br-int',has_traffic_filtering=True,id=19f8ce24-a977-46ee-a878-728ddc13a4e0,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f8ce24-a9') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'pci_devices' on Instance uuid 2064385e-a37f-468e-bed6-129eb54295ae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:16:24 user nova-compute[75021]:   <uuid>2064385e-a37f-468e-bed6-129eb54295ae</uuid>
Dec 06 07:16:24 user nova-compute[75021]:   <name>instance-00000025</name>
Dec 06 07:16:24 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:16:24 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:16:24 user nova-compute[75021]:   <metadata>
Dec 06 07:16:24 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:16:24 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:16:24 user nova-compute[75021]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1457326660</nova:name>
Dec 06 07:16:24 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:16:22</nova:creationTime>
Dec 06 07:16:24 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:16:24 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:16:24 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:16:24 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:16:24 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:16:24 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:16:24 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:16:24 user nova-compute[75021]:       <nova:owner>
Dec 06 07:16:24 user nova-compute[75021]:         <nova:user uuid="c0774aa1e3ee4b69b195b575d116ee96">tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member</nova:user>
Dec 06 07:16:24 user nova-compute[75021]:         <nova:project uuid="9895e43bf76d4760a26a5e64ea6d4e14">tempest-ServerBootFromVolumeStableRescueTest-1272250883</nova:project>
Dec 06 07:16:24 user nova-compute[75021]:       </nova:owner>
Dec 06 07:16:24 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:16:24 user nova-compute[75021]:       <nova:ports>
Dec 06 07:16:24 user nova-compute[75021]:         <nova:port uuid="19f8ce24-a977-46ee-a878-728ddc13a4e0">
Dec 06 07:16:24 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 07:16:24 user nova-compute[75021]:         </nova:port>
Dec 06 07:16:24 user nova-compute[75021]:       </nova:ports>
Dec 06 07:16:24 user nova-compute[75021]:     </nova:instance>
Dec 06 07:16:24 user nova-compute[75021]:   </metadata>
Dec 06 07:16:24 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:16:24 user nova-compute[75021]:     <system>
Dec 06 07:16:24 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:16:24 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:16:24 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:16:24 user nova-compute[75021]:       <entry name="serial">2064385e-a37f-468e-bed6-129eb54295ae</entry>
Dec 06 07:16:24 user nova-compute[75021]:       <entry name="uuid">2064385e-a37f-468e-bed6-129eb54295ae</entry>
Dec 06 07:16:24 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:16:24 user nova-compute[75021]:     </system>
Dec 06 07:16:24 user nova-compute[75021]:   </sysinfo>
Dec 06 07:16:24 user nova-compute[75021]:   <os>
Dec 06 07:16:24 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:16:24 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:16:24 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:16:24 user nova-compute[75021]:   </os>
Dec 06 07:16:24 user nova-compute[75021]:   <features>
Dec 06 07:16:24 user nova-compute[75021]:     <acpi/>
Dec 06 07:16:24 user nova-compute[75021]:     <apic/>
Dec 06 07:16:24 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:16:24 user nova-compute[75021]:   </features>
Dec 06 07:16:24 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:16:24 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:16:24 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:16:24 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:16:24 user nova-compute[75021]:   </clock>
Dec 06 07:16:24 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:16:24 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:16:24 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:16:24 user nova-compute[75021]:   </cpu>
Dec 06 07:16:24 user nova-compute[75021]:   <devices>
Dec 06 07:16:24 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:16:24 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:16:24 user nova-compute[75021]:       <source dev="/dev/sde"/>
Dec 06 07:16:24 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:16:24 user nova-compute[75021]:       <serial>98bfe29a-a367-4b70-9d31-877ed682847c</serial>
Dec 06 07:16:24 user nova-compute[75021]:     </disk>
Dec 06 07:16:24 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:16:24 user nova-compute[75021]:       <mac address="fa:16:3e:d4:2a:27"/>
Dec 06 07:16:24 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:16:24 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:16:24 user nova-compute[75021]:       <target dev="tap19f8ce24-a9"/>
Dec 06 07:16:24 user nova-compute[75021]:     </interface>
Dec 06 07:16:24 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:16:24 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/console.log" append="off"/>
Dec 06 07:16:24 user nova-compute[75021]:     </serial>
Dec 06 07:16:24 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:16:24 user nova-compute[75021]:     <video>
Dec 06 07:16:24 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:16:24 user nova-compute[75021]:     </video>
Dec 06 07:16:24 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:16:24 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:16:24 user nova-compute[75021]:     </rng>
Dec 06 07:16:24 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:16:24 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:16:24 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:16:24 user nova-compute[75021]:     </memballoon>
Dec 06 07:16:24 user nova-compute[75021]:   </devices>
Dec 06 07:16:24 user nova-compute[75021]: </domain>
Dec 06 07:16:24 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1457326660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1457326660',id=37,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9895e43bf76d4760a26a5e64ea6d4e14',ramdisk_id='',reservation_id='r-b1vuxe2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:16:02Z,user_data=None,user_id='c0774aa1e3ee4b69b195b575d116ee96',uuid=2064385e-a37f-468e-bed6-129eb54295ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "address": "fa:16:3e:d4:2a:27", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f8ce24-a9", "ovs_interfaceid": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converting VIF {"id": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "address": "fa:16:3e:d4:2a:27", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f8ce24-a9", "ovs_interfaceid": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2a:27,bridge_name='br-int',has_traffic_filtering=True,id=19f8ce24-a977-46ee-a878-728ddc13a4e0,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f8ce24-a9') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG os_vif [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2a:27,bridge_name='br-int',has_traffic_filtering=True,id=19f8ce24-a977-46ee-a878-728ddc13a4e0,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f8ce24-a9') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f786d0bf-0a8a-542e-bee9-e2c2d69223f9', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19f8ce24-a9, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19f8ce24-a9, col_values=(('qos', UUID('a830e35a-190a-43a4-949c-41b0beffacd7')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19f8ce24-a9, col_values=(('external_ids', {'iface-id': '19f8ce24-a977-46ee-a878-728ddc13a4e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:2a:27', 'vm-uuid': '2064385e-a37f-468e-bed6-129eb54295ae'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:24 user nova-compute[75021]: INFO os_vif [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2a:27,bridge_name='br-int',has_traffic_filtering=True,id=19f8ce24-a977-46ee-a878-728ddc13a4e0,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f8ce24-a9')
Dec 06 07:16:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:16:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] No VIF found with MAC fa:16:3e:d4:2a:27, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:16:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-d2629d03-0d73-4819-bc9a-a4a9eed2970c req-6a544722-2a87-458d-bc53-97cbc2462e27 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:16:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d2629d03-0d73-4819-bc9a-a4a9eed2970c req-6a544722-2a87-458d-bc53-97cbc2462e27 service nova] Acquiring lock "2064385e-a37f-468e-bed6-129eb54295ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d2629d03-0d73-4819-bc9a-a4a9eed2970c req-6a544722-2a87-458d-bc53-97cbc2462e27 service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d2629d03-0d73-4819-bc9a-a4a9eed2970c req-6a544722-2a87-458d-bc53-97cbc2462e27 service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-d2629d03-0d73-4819-bc9a-a4a9eed2970c req-6a544722-2a87-458d-bc53-97cbc2462e27 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] No waiting events found dispatching network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:16:25 user nova-compute[75021]: WARNING nova.compute.manager [req-d2629d03-0d73-4819-bc9a-a4a9eed2970c req-6a544722-2a87-458d-bc53-97cbc2462e27 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received unexpected event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 for instance with vm_state building and task_state spawning.
Dec 06 07:16:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:25 user nova-compute[75021]: INFO nova.compute.manager [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Terminating instance
Dec 06 07:16:25 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-94ebeae5-d302-406a-ab64-a75aa41a4971 req-09a63d2a-23a4-4453-a614-29febb2ee907 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received event network-vif-unplugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-94ebeae5-d302-406a-ab64-a75aa41a4971 req-09a63d2a-23a4-4453-a614-29febb2ee907 service nova] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-94ebeae5-d302-406a-ab64-a75aa41a4971 req-09a63d2a-23a4-4453-a614-29febb2ee907 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-94ebeae5-d302-406a-ab64-a75aa41a4971 req-09a63d2a-23a4-4453-a614-29febb2ee907 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-94ebeae5-d302-406a-ab64-a75aa41a4971 req-09a63d2a-23a4-4453-a614-29febb2ee907 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] No waiting events found dispatching network-vif-unplugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-94ebeae5-d302-406a-ab64-a75aa41a4971 req-09a63d2a-23a4-4453-a614-29febb2ee907 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received event network-vif-unplugged-0b799ddb-c34b-457f-9412-d09c3ab04806 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:16:26 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Instance destroyed successfully.
Dec 06 07:16:26 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lazy-loading 'resources' on Instance uuid 4ffc6429-3f3c-4a7e-98e5-0db984266eae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T06:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1331447466',display_name='tempest-ServerRescueNegativeTestJSON-server-1331447466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1331447466',id=1,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:04:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43d3fb6e885546bd9660c81fac9cfa12',ramdisk_id='',reservation_id='r-degm1zig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-674134420',owner_user_name='tempest-ServerRescueNegativeTestJSON-674134420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:05:54Z,user_data=None,user_id='e6d8114db9fa47c09bc9675da9e19a8c',uuid=4ffc6429-3f3c-4a7e-98e5-0db984266eae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converting VIF {"id": "0b799ddb-c34b-457f-9412-d09c3ab04806", "address": "fa:16:3e:7a:2d:18", "network": {"id": "e37b52c9-a15a-4973-8648-e394abba8e74", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-775451938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43d3fb6e885546bd9660c81fac9cfa12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b799ddb-c3", "ovs_interfaceid": "0b799ddb-c34b-457f-9412-d09c3ab04806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:2d:18,bridge_name='br-int',has_traffic_filtering=True,id=0b799ddb-c34b-457f-9412-d09c3ab04806,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b799ddb-c3') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG os_vif [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:2d:18,bridge_name='br-int',has_traffic_filtering=True,id=0b799ddb-c34b-457f-9412-d09c3ab04806,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b799ddb-c3') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b799ddb-c3, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba5286a6-af82-400d-8883-189be80f1a0f) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:26 user nova-compute[75021]: INFO os_vif [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:2d:18,bridge_name='br-int',has_traffic_filtering=True,id=0b799ddb-c34b-457f-9412-d09c3ab04806,network=Network(e37b52c9-a15a-4973-8648-e394abba8e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b799ddb-c3')
Dec 06 07:16:26 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Deleting instance files /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae_del
Dec 06 07:16:26 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Deletion of /opt/stack/data/nova/instances/4ffc6429-3f3c-4a7e-98e5-0db984266eae_del complete
Dec 06 07:16:26 user nova-compute[75021]: INFO nova.compute.manager [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Took 0.72 seconds to destroy the instance on the hypervisor.
Dec 06 07:16:26 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:16:26 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:16:27 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Took 0.40 seconds to deallocate network for instance.
Dec 06 07:16:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:27 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Deleted allocations for instance 4ffc6429-3f3c-4a7e-98e5-0db984266eae
Dec 06 07:16:27 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:16:27 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Instance spawned successfully.
Dec 06 07:16:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d3f3608f-c71d-44e3-bdb4-b8f9b1958782 tempest-ServerRescueNegativeTestJSON-674134420 tempest-ServerRescueNegativeTestJSON-674134420-project-member] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.688s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:16:27 user nova-compute[75021]: INFO nova.compute.manager [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Took 5.12 seconds to spawn the instance on the hypervisor.
Dec 06 07:16:27 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-72555d99-0dc4-40ca-9f68-53aa3809f614 req-4c7abc0f-3d8b-4b8b-8e33-c90a22ebd662 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-72555d99-0dc4-40ca-9f68-53aa3809f614 req-4c7abc0f-3d8b-4b8b-8e33-c90a22ebd662 service nova] Acquiring lock "2064385e-a37f-468e-bed6-129eb54295ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-72555d99-0dc4-40ca-9f68-53aa3809f614 req-4c7abc0f-3d8b-4b8b-8e33-c90a22ebd662 service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-72555d99-0dc4-40ca-9f68-53aa3809f614 req-4c7abc0f-3d8b-4b8b-8e33-c90a22ebd662 service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-72555d99-0dc4-40ca-9f68-53aa3809f614 req-4c7abc0f-3d8b-4b8b-8e33-c90a22ebd662 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] No waiting events found dispatching network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:16:27 user nova-compute[75021]: WARNING nova.compute.manager [req-72555d99-0dc4-40ca-9f68-53aa3809f614 req-4c7abc0f-3d8b-4b8b-8e33-c90a22ebd662 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received unexpected event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 for instance with vm_state building and task_state spawning.
Dec 06 07:16:27 user nova-compute[75021]: INFO nova.compute.manager [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Took 26.70 seconds to build instance.
Dec 06 07:16:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e2915ae8-b965-4353-88f2-d4f108e0625d tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "2064385e-a37f-468e-bed6-129eb54295ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.922s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-b25ee880-7c3d-4267-afe6-354c8a78ce8a req-819eb765-ff18-4990-bf05-52624c584927 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:16:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b25ee880-7c3d-4267-afe6-354c8a78ce8a req-819eb765-ff18-4990-bf05-52624c584927 service nova] Acquiring lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b25ee880-7c3d-4267-afe6-354c8a78ce8a req-819eb765-ff18-4990-bf05-52624c584927 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b25ee880-7c3d-4267-afe6-354c8a78ce8a req-819eb765-ff18-4990-bf05-52624c584927 service nova] Lock "4ffc6429-3f3c-4a7e-98e5-0db984266eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-b25ee880-7c3d-4267-afe6-354c8a78ce8a req-819eb765-ff18-4990-bf05-52624c584927 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] No waiting events found dispatching network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:16:28 user nova-compute[75021]: WARNING nova.compute.manager [req-b25ee880-7c3d-4267-afe6-354c8a78ce8a req-819eb765-ff18-4990-bf05-52624c584927 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received unexpected event network-vif-plugged-0b799ddb-c34b-457f-9412-d09c3ab04806 for instance with vm_state deleted and task_state None.
Dec 06 07:16:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-b25ee880-7c3d-4267-afe6-354c8a78ce8a req-819eb765-ff18-4990-bf05-52624c584927 service nova] [instance: 4ffc6429-3f3c-4a7e-98e5-0db984266eae] Received event network-vif-deleted-0b799ddb-c34b-457f-9412-d09c3ab04806 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:16:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-433ac71c-e13f-4ad3-958e-786c690a3e4d req-f9b77664-751c-407f-ab6d-e9314fe62b7d service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Received event network-changed-5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:16:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-433ac71c-e13f-4ad3-958e-786c690a3e4d req-f9b77664-751c-407f-ab6d-e9314fe62b7d service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Refreshing instance network info cache due to event network-changed-5ddd7dff-61be-4d5a-9bc4-7242cb57920d. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:16:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-433ac71c-e13f-4ad3-958e-786c690a3e4d req-f9b77664-751c-407f-ab6d-e9314fe62b7d service nova] Acquiring lock "refresh_cache-92c63579-741c-4daa-9568-f7ddf95e3729" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:16:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-433ac71c-e13f-4ad3-958e-786c690a3e4d req-f9b77664-751c-407f-ab6d-e9314fe62b7d service nova] Acquired lock "refresh_cache-92c63579-741c-4daa-9568-f7ddf95e3729" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:16:36 user nova-compute[75021]: DEBUG nova.network.neutron [req-433ac71c-e13f-4ad3-958e-786c690a3e4d req-f9b77664-751c-407f-ab6d-e9314fe62b7d service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Refreshing network info cache for port 5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG nova.network.neutron [req-433ac71c-e13f-4ad3-958e-786c690a3e4d req-f9b77664-751c-407f-ab6d-e9314fe62b7d service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Updated VIF entry in instance network info cache for port 5ddd7dff-61be-4d5a-9bc4-7242cb57920d. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG nova.network.neutron [req-433ac71c-e13f-4ad3-958e-786c690a3e4d req-f9b77664-751c-407f-ab6d-e9314fe62b7d service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Updating instance_info_cache with network_info: [{"id": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "address": "fa:16:3e:ab:18:19", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddd7dff-61", "ovs_interfaceid": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-433ac71c-e13f-4ad3-958e-786c690a3e4d req-f9b77664-751c-407f-ab6d-e9314fe62b7d service nova] Releasing lock "refresh_cache-92c63579-741c-4daa-9568-f7ddf95e3729" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "92c63579-741c-4daa-9568-f7ddf95e3729" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "92c63579-741c-4daa-9568-f7ddf95e3729" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG nova.objects.instance [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lazy-loading 'flavor' on Instance uuid 92c63579-741c-4daa-9568-f7ddf95e3729 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "92c63579-741c-4daa-9568-f7ddf95e3729" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "92c63579-741c-4daa-9568-f7ddf95e3729" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "92c63579-741c-4daa-9568-f7ddf95e3729" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:37 user nova-compute[75021]: INFO nova.compute.manager [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Attaching volume 819e5213-d8c6-4506-a46c-dfec28538f5c to /dev/vdb
Dec 06 07:16:37 user nova-compute[75021]: DEBUG os_brick.utils [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3259c110-f3e4-4cde-a83d-32728b901ffd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c524956-d839-460c-ac52-ff18c1837f02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[95748c6d-03f7-411d-9324-4c8c0fbefeb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[773825f3-db7c-4d0c-b962-aa0525567dba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:16:37 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:16:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8413b3-a915-48f7-b2a1-84da8031440f]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG os_brick.utils [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:16:37 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Updating existing volume attachment record: 97ae1e20-ddb6-40cd-8585-d3aeb7cb2ccc {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:16:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:42 user nova-compute[75021]: INFO nova.compute.manager [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Terminating instance
Dec 06 07:16:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG nova.compute.manager [req-8e4e59ee-2eb1-40c5-9fd9-2e6c2da08282 req-d3d9da46-8991-42f4-b049-33f80b016fce service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received event network-vif-unplugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8e4e59ee-2eb1-40c5-9fd9-2e6c2da08282 req-d3d9da46-8991-42f4-b049-33f80b016fce service nova] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8e4e59ee-2eb1-40c5-9fd9-2e6c2da08282 req-d3d9da46-8991-42f4-b049-33f80b016fce service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8e4e59ee-2eb1-40c5-9fd9-2e6c2da08282 req-d3d9da46-8991-42f4-b049-33f80b016fce service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG nova.compute.manager [req-8e4e59ee-2eb1-40c5-9fd9-2e6c2da08282 req-d3d9da46-8991-42f4-b049-33f80b016fce service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] No waiting events found dispatching network-vif-unplugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:16:42 user nova-compute[75021]: DEBUG nova.compute.manager [req-8e4e59ee-2eb1-40c5-9fd9-2e6c2da08282 req-d3d9da46-8991-42f4-b049-33f80b016fce service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received event network-vif-unplugged-1edcce6c-0464-4647-acec-43b63a19fec3 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:16:43 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Instance destroyed successfully.
Dec 06 07:16:43 user nova-compute[75021]: DEBUG nova.objects.instance [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lazy-loading 'resources' on Instance uuid c08cfdd8-44fc-4736-b5dd-d216c75afef6 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1755716713',display_name='tempest-TestMinimumBasicScenario-server-1755716713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1755716713',id=30,image_ref='a7a58751-9b36-4563-ad03-1e65e6a63091',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzFEXjZqYWN/VOrm0W/J/e8cauXWobaJeUOp7fEDeV6rTUnqHDRo9pCOhEKAWGMF1UAWts7NnR1enZvWdPqSbV7BHLfp7tXkCiWtrMCpbrxftL6id6Sn9hR+52ZFifAJg==',key_name='tempest-TestMinimumBasicScenario-1108525570',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:11:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78e36b4acada439db308e5e816dbf9a7',ramdisk_id='',reservation_id='r-agf1s9cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a7a58751-9b36-4563-ad03-1e65e6a63091',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-757290889',owner_user_name='tempest-TestMinimumBasicScenario-757290889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:14:02Z,user_data=None,user_id='24f231f563c345b48a998200dbf1384a',uuid=c08cfdd8-44fc-4736-b5dd-d216c75afef6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1edcce6c-0464-4647-acec-43b63a19fec3", "address": "fa:16:3e:39:da:e2", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1edcce6c-04", "ovs_interfaceid": "1edcce6c-0464-4647-acec-43b63a19fec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converting VIF {"id": "1edcce6c-0464-4647-acec-43b63a19fec3", "address": "fa:16:3e:39:da:e2", "network": {"id": "83cfa6b6-2546-4e5e-b46b-37fb56811928", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2140791344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78e36b4acada439db308e5e816dbf9a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1edcce6c-04", "ovs_interfaceid": "1edcce6c-0464-4647-acec-43b63a19fec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:da:e2,bridge_name='br-int',has_traffic_filtering=True,id=1edcce6c-0464-4647-acec-43b63a19fec3,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1edcce6c-04') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG os_vif [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:da:e2,bridge_name='br-int',has_traffic_filtering=True,id=1edcce6c-0464-4647-acec-43b63a19fec3,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1edcce6c-04') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1edcce6c-04, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de7ce347-09d1-4970-b898-e3c44c267e61) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:43 user nova-compute[75021]: INFO os_vif [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:da:e2,bridge_name='br-int',has_traffic_filtering=True,id=1edcce6c-0464-4647-acec-43b63a19fec3,network=Network(83cfa6b6-2546-4e5e-b46b-37fb56811928),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1edcce6c-04')
Dec 06 07:16:43 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Deleting instance files /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6_del
Dec 06 07:16:43 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Deletion of /opt/stack/data/nova/instances/c08cfdd8-44fc-4736-b5dd-d216c75afef6_del complete
Dec 06 07:16:43 user nova-compute[75021]: INFO nova.compute.manager [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Took 0.89 seconds to destroy the instance on the hypervisor.
Dec 06 07:16:43 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:16:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:44 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:16:44 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Took 0.83 seconds to deallocate network for instance.
Dec 06 07:16:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-2ecbc3b6-aec5-433e-88f6-31fa8efb47b3 req-eb6bdc28-5cc5-455d-bbf8-b64b096dd9b8 service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received event network-vif-deleted-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:16:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:44 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:16:44 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:16:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:44 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Deleted allocations for instance c08cfdd8-44fc-4736-b5dd-d216c75afef6
Dec 06 07:16:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-20eaa5dc-d713-4fae-af5f-4e366ceac79b tempest-TestMinimumBasicScenario-757290889 tempest-TestMinimumBasicScenario-757290889-project-member] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.349s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-07538c22-d069-4393-9115-1e5cd5a8e8e9 req-ca34d712-8c9d-41f7-a7e6-ae3432a1c3ab service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received event network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:16:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-07538c22-d069-4393-9115-1e5cd5a8e8e9 req-ca34d712-8c9d-41f7-a7e6-ae3432a1c3ab service nova] Acquiring lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-07538c22-d069-4393-9115-1e5cd5a8e8e9 req-ca34d712-8c9d-41f7-a7e6-ae3432a1c3ab service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-07538c22-d069-4393-9115-1e5cd5a8e8e9 req-ca34d712-8c9d-41f7-a7e6-ae3432a1c3ab service nova] Lock "c08cfdd8-44fc-4736-b5dd-d216c75afef6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-07538c22-d069-4393-9115-1e5cd5a8e8e9 req-ca34d712-8c9d-41f7-a7e6-ae3432a1c3ab service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] No waiting events found dispatching network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:16:45 user nova-compute[75021]: WARNING nova.compute.manager [req-07538c22-d069-4393-9115-1e5cd5a8e8e9 req-ca34d712-8c9d-41f7-a7e6-ae3432a1c3ab service nova] [instance: c08cfdd8-44fc-4736-b5dd-d216c75afef6] Received unexpected event network-vif-plugged-1edcce6c-0464-4647-acec-43b63a19fec3 for instance with vm_state deleted and task_state None.
Dec 06 07:16:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaILuOXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:16:48 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:16:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:16:48 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:16:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:16:48 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c3c2b3-f688-4878-8901-6c5e930ca7e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:16:48 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e6d050-6271-40d3-8917-1cd9532788b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c] added
Dec 06 07:16:48 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd81786e-4cdb-4024-82f6-e75f082469cd]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0028b966-5291-4b3b-915f-565bfef9b712]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaILuOXv {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaILuOXv" returned: 0 in 0.033s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7be378-661a-48eb-870b-a4901b9047e0]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YaILuOXv'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c173f1e-b13b-4e35-a35f-a0df467e16a6]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a148e322-8f52-4d3f-bd02-43c71f0931bb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:16:48 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:16:48 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:16:48 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:16:48 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:16:48 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:16:48 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:16:48 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:16:48 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9d2b73-5ab5-4a93-887b-a1ee3b3f9609]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c, portal: 172.16.0.220,3260]
Dec 06 07:16:48 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c, portal: 172.16.0.220,3260] successful.
Dec 06 07:16:48 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:48 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7727237-523b-4a15-b98d-e0b4007c10a9]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[707dd94c-da65-4c01-ba09-6542a5c17bc2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:16:49 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:16:49 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:16:49 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:16:49 user nova-compute[75021]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c (non-flash)
Dec 06 07:16:49 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:16:49 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:16:49 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:16:49 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:16:49 user nova-compute[75021]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c (non-flash)
Dec 06 07:16:49 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d5aecd-2a23-4188-88e5-6960c87e0d59]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:16:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaILuOXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:16:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:16:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23234343334373631', 'path': '/dev/sdf'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:16:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234343334373631', 'path': '/dev/sdf'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:16:50 user nova-compute[75021]: DEBUG nova.objects.instance [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lazy-loading 'flavor' on Instance uuid 92c63579-741c-4daa-9568-f7ddf95e3729 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:16:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:16:50 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:16:50 user nova-compute[75021]:   <source dev="/dev/sdf"/>
Dec 06 07:16:50 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:16:50 user nova-compute[75021]:   <serial>819e5213-d8c6-4506-a46c-dfec28538f5c</serial>
Dec 06 07:16:50 user nova-compute[75021]: </disk>
Dec 06 07:16:50 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:16:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:16:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:16:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] No VIF found with MAC fa:16:3e:ab:18:19, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:16:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ae4c646b-99b0-46ef-a856-5cacd8dda2a8 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "92c63579-741c-4daa-9568-f7ddf95e3729" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.209s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:16:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "92c63579-741c-4daa-9568-f7ddf95e3729" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:16:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "92c63579-741c-4daa-9568-f7ddf95e3729" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:16:53 user nova-compute[75021]: INFO nova.compute.manager [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Detaching volume 819e5213-d8c6-4506-a46c-dfec28538f5c
Dec 06 07:16:53 user nova-compute[75021]: INFO nova.virt.block_device [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Attempting to driver detach volume 819e5213-d8c6-4506-a46c-dfec28538f5c from mountpoint /dev/vdb
Dec 06 07:16:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Attempting to detach device vdb from instance 92c63579-741c-4daa-9568-f7ddf95e3729 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:16:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:16:53 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:16:53 user nova-compute[75021]:   <source dev="/dev/sdf"/>
Dec 06 07:16:53 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:16:53 user nova-compute[75021]:   <serial>819e5213-d8c6-4506-a46c-dfec28538f5c</serial>
Dec 06 07:16:53 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:16:53 user nova-compute[75021]: </disk>
Dec 06 07:16:53 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:16:53 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Successfully detached device vdb from instance 92c63579-741c-4daa-9568-f7ddf95e3729 from the persistent domain config.
Dec 06 07:16:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92c63579-741c-4daa-9568-f7ddf95e3729 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:16:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:16:53 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:16:53 user nova-compute[75021]:   <source dev="/dev/sdf"/>
Dec 06 07:16:53 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:16:53 user nova-compute[75021]:   <serial>819e5213-d8c6-4506-a46c-dfec28538f5c</serial>
Dec 06 07:16:53 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:16:53 user nova-compute[75021]: </disk>
Dec 06 07:16:53 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:16:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92c63579-741c-4daa-9568-f7ddf95e3729 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:16:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:16:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-27076b16-4939-4f87-8aa3-6d3415d9f242 req-70e69a76-3cc3-40c0-a06f-4fae9d5afca5 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Received event network-changed-1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:17:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-27076b16-4939-4f87-8aa3-6d3415d9f242 req-70e69a76-3cc3-40c0-a06f-4fae9d5afca5 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Refreshing instance network info cache due to event network-changed-1f43de0b-bfae-4359-9a48-56a43f5dbdbf. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:17:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-27076b16-4939-4f87-8aa3-6d3415d9f242 req-70e69a76-3cc3-40c0-a06f-4fae9d5afca5 service nova] Acquiring lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:17:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-27076b16-4939-4f87-8aa3-6d3415d9f242 req-70e69a76-3cc3-40c0-a06f-4fae9d5afca5 service nova] Acquired lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:17:00 user nova-compute[75021]: DEBUG nova.network.neutron [req-27076b16-4939-4f87-8aa3-6d3415d9f242 req-70e69a76-3cc3-40c0-a06f-4fae9d5afca5 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Refreshing network info cache for port 1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:17:01 user nova-compute[75021]: DEBUG nova.network.neutron [req-27076b16-4939-4f87-8aa3-6d3415d9f242 req-70e69a76-3cc3-40c0-a06f-4fae9d5afca5 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Updated VIF entry in instance network info cache for port 1f43de0b-bfae-4359-9a48-56a43f5dbdbf. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:17:01 user nova-compute[75021]: DEBUG nova.network.neutron [req-27076b16-4939-4f87-8aa3-6d3415d9f242 req-70e69a76-3cc3-40c0-a06f-4fae9d5afca5 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Updating instance_info_cache with network_info: [{"id": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "address": "fa:16:3e:b7:f2:e4", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f43de0b-bf", "ovs_interfaceid": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:17:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-27076b16-4939-4f87-8aa3-6d3415d9f242 req-70e69a76-3cc3-40c0-a06f-4fae9d5afca5 service nova] Releasing lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:17:02 user nova-compute[75021]: DEBUG nova.compute.manager [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Stashing vm_state: active {{(pid=75021) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 06 07:17:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:02 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:17:02 user nova-compute[75021]: INFO nova.compute.claims [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Claim successful on node user
Dec 06 07:17:02 user nova-compute[75021]: INFO nova.compute.resource_tracker [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Updating resource usage from migration e03bb2de-3fdd-4e74-a159-853ceff47a16
Dec 06 07:17:02 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:17:02 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:17:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-e8cf1ad1-f179-4eab-b197-c682331c8fd9 req-ce69d4a4-90d3-46a2-a3ef-cae1364dd4db service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received event network-changed-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:17:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-e8cf1ad1-f179-4eab-b197-c682331c8fd9 req-ce69d4a4-90d3-46a2-a3ef-cae1364dd4db service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Refreshing instance network info cache due to event network-changed-a16e0c22-fbe2-4dff-87ed-813f89691a4f. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:17:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e8cf1ad1-f179-4eab-b197-c682331c8fd9 req-ce69d4a4-90d3-46a2-a3ef-cae1364dd4db service nova] Acquiring lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:17:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e8cf1ad1-f179-4eab-b197-c682331c8fd9 req-ce69d4a4-90d3-46a2-a3ef-cae1364dd4db service nova] Acquired lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:17:02 user nova-compute[75021]: DEBUG nova.network.neutron [req-e8cf1ad1-f179-4eab-b197-c682331c8fd9 req-ce69d4a4-90d3-46a2-a3ef-cae1364dd4db service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Refreshing network info cache for port a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:17:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.448s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:02 user nova-compute[75021]: INFO nova.compute.manager [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Migrating
Dec 06 07:17:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:17:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:03 user nova-compute[75021]: DEBUG nova.network.neutron [req-e8cf1ad1-f179-4eab-b197-c682331c8fd9 req-ce69d4a4-90d3-46a2-a3ef-cae1364dd4db service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Updated VIF entry in instance network info cache for port a16e0c22-fbe2-4dff-87ed-813f89691a4f. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:17:03 user nova-compute[75021]: DEBUG nova.network.neutron [req-e8cf1ad1-f179-4eab-b197-c682331c8fd9 req-ce69d4a4-90d3-46a2-a3ef-cae1364dd4db service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Updating instance_info_cache with network_info: [{"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:17:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e8cf1ad1-f179-4eab-b197-c682331c8fd9 req-ce69d4a4-90d3-46a2-a3ef-cae1364dd4db service nova] Releasing lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:17:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquired lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:17:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:17:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Updating instance_info_cache with network_info: [{"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:17:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Releasing lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:17:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Starting migrate_disk_and_power_off {{(pid=75021) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11490}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-dcadee8a-3e5a-40f0-95c6-5fa09a894906 req-8ae70149-44a9-4870-a455-5bb6839d212b service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received event network-vif-unplugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dcadee8a-3e5a-40f0-95c6-5fa09a894906 req-8ae70149-44a9-4870-a455-5bb6839d212b service nova] Acquiring lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dcadee8a-3e5a-40f0-95c6-5fa09a894906 req-8ae70149-44a9-4870-a455-5bb6839d212b service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dcadee8a-3e5a-40f0-95c6-5fa09a894906 req-8ae70149-44a9-4870-a455-5bb6839d212b service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-dcadee8a-3e5a-40f0-95c6-5fa09a894906 req-8ae70149-44a9-4870-a455-5bb6839d212b service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] No waiting events found dispatching network-vif-unplugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:17:04 user nova-compute[75021]: WARNING nova.compute.manager [req-dcadee8a-3e5a-40f0-95c6-5fa09a894906 req-8ae70149-44a9-4870-a455-5bb6839d212b service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received unexpected event network-vif-unplugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f for instance with vm_state active and task_state resize_migrating.
Dec 06 07:17:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:04 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Instance destroyed successfully.
Dec 06 07:17:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:15:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1372424050',display_name='tempest-ServerActionsTestOtherA-server-1372424050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1372424050',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbe4qUdep78TgBLG29O7GMFI0uEKESU+Xx64Y2G0xkh2EtccpxwWlafCMPJHygmaEQbyUAtZjD22PTzS9xqolPPxgkkpdNuHJ15mMhGsezfXPp1cLkefmXHoF6E+QYoeA==',key_name='tempest-keypair-34997867',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:15:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f011c1a70ac1465d8eb31e20850fdbad',ramdisk_id='',reservation_id='r-o2rbqj04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1761792884',owner_user_name='tempest-ServerActionsTestOtherA-1761792884-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3369c937ad24537a114a71eb4674750',uuid=a31eae43-b01c-46cf-9c06-13e9242b5fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-538526069-network", "vif_mac": "fa:16:3e:81:38:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converting VIF {"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-538526069-network", "vif_mac": "fa:16:3e:81:38:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:38:94,bridge_name='br-int',has_traffic_filtering=True,id=a16e0c22-fbe2-4dff-87ed-813f89691a4f,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16e0c22-fb') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_vif [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:38:94,bridge_name='br-int',has_traffic_filtering=True,id=a16e0c22-fbe2-4dff-87ed-813f89691a4f,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16e0c22-fb') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa16e0c22-fb, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fd63f62-ba27-48af-b812-a0cbbc35a8bc) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:04 user nova-compute[75021]: INFO os_vif [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:38:94,bridge_name='br-int',has_traffic_filtering=True,id=a16e0c22-fbe2-4dff-87ed-813f89691a4f,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16e0c22-fb')
Dec 06 07:17:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfieSjZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:17:04 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa52fa9e-e0ff-41e2-8462-98c10e0f4d6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:17:04 user nova-compute[75021]: No targets found.
Dec 06 07:17:04 user nova-compute[75021]: iSNS:
Dec 06 07:17:04 user nova-compute[75021]: No targets found.
Dec 06 07:17:04 user nova-compute[75021]: STATIC:
Dec 06 07:17:04 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c
Dec 06 07:17:04 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:17:04 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:17:04 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8
Dec 06 07:17:04 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:17:04 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:17:04 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:17:04 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:17:04 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:17:04 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c
Dec 06 07:17:04 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:17:04 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:17:04 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc
Dec 06 07:17:04 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:17:04 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:17:04 user nova-compute[75021]: FIRMWARE:
Dec 06 07:17:04 user nova-compute[75021]: No targets found.
Dec 06 07:17:04 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:17:04 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:17:04 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50f0da8-d50d-475a-a545-41bc4e12b66e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdbb828-f754-4b3b-980e-2fe7a6584eac]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:17:04 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:17:04 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:17:04 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:17:04 user nova-compute[75021]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c (non-flash)
Dec 06 07:17:04 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:17:04 user nova-compute[75021]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:17:04 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:17:04 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:17:04 user nova-compute[75021]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c (non-flash)
Dec 06 07:17:04 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b46e43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc'): ({'sdc'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Removing single pathed devices sdc {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a5bf8c-8b9d-41fb-9ea5-8fa6d3d51640]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5fb804-9599-49a0-b1bd-3a389554d7bf]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Flushing IO for device /dev/sdc {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[129f721c-e464-45f4-9f60-2434de74c000]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1e6765-197a-41fe-bd18-2eb73dcb0901]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4ab77986-a6141c304cd7e113', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4ab77986', '/dev/disk/by-id/scsi-26136313431633330') {{(pid=86148) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5aec9b-8da1-4be6-8141-f0b9c702d525]: (4, None) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8413f5-c077-4566-b50b-ba292fbd6c2c]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e08e22-f2d4-4934-b966-ad259862c63a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260]
Dec 06 07:17:05 user nova-compute[75021]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260] successful.
Dec 06 07:17:05 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8714bb03-d6c5-4c48-a145-3e782cfe6ada]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:17:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] <== disconnect_volume: return (346ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:17:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:17:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:17:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-251ddbc0-8cfc-4420-b804-25d9573d0a62 req-74bb529c-4370-4240-a6e1-bbf16fc20ffd service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received event network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:17:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-251ddbc0-8cfc-4420-b804-25d9573d0a62 req-74bb529c-4370-4240-a6e1-bbf16fc20ffd service nova] Acquiring lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-251ddbc0-8cfc-4420-b804-25d9573d0a62 req-74bb529c-4370-4240-a6e1-bbf16fc20ffd service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-251ddbc0-8cfc-4420-b804-25d9573d0a62 req-74bb529c-4370-4240-a6e1-bbf16fc20ffd service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-251ddbc0-8cfc-4420-b804-25d9573d0a62 req-74bb529c-4370-4240-a6e1-bbf16fc20ffd service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] No waiting events found dispatching network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:17:06 user nova-compute[75021]: WARNING nova.compute.manager [req-251ddbc0-8cfc-4420-b804-25d9573d0a62 req-74bb529c-4370-4240-a6e1-bbf16fc20ffd service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received unexpected event network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f for instance with vm_state active and task_state resize_migrating.
Dec 06 07:17:06 user nova-compute[75021]: DEBUG nova.network.neutron [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Port a16e0c22-fbe2-4dff-87ed-813f89691a4f binding to destination host user is already ACTIVE {{(pid=75021) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 06 07:17:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:17:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquired lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:17:06 user nova-compute[75021]: DEBUG nova.network.neutron [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:17:06 user nova-compute[75021]: DEBUG nova.network.neutron [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Updating instance_info_cache with network_info: [{"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:17:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Releasing lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG os_brick.utils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac7cae2-b992-418c-89e7-008c3c7ba7ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[610dabde-c364-4fc1-b5c4-924b57f742f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9ab163-6042-44e4-a051-5d14b3fe6856]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d3fdcb-8c24-4502-80a1-c05bef53549a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:17:07 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:17:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce260dc7-d428-411c-890e-cf62259c4b46]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:17:07 user nova-compute[75021]: DEBUG os_brick.utils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:17:08 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:17:08 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:17:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:08 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:17:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:17:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:17:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:17:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:17:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:10 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:10 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:17:11 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8069MB free_disk=25.142024993896484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Applying migration context for instance a31eae43-b01c-46cf-9c06-13e9242b5fe1 as it has an incoming, in-progress migration e03bb2de-3fdd-4e74-a159-853ceff47a16. Migration status is post-migrating {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 06 07:17:11 user nova-compute[75021]: INFO nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Updating resource usage from migration e03bb2de-3fdd-4e74-a159-853ceff47a16
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 58ef39ae-4b66-42e6-ae22-5308a98eb55d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 92c63579-741c-4daa-9568-f7ddf95e3729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2696d783-bb1e-4709-9683-c8ad1ffc627f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2064385e-a37f-468e-bed6-129eb54295ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Migration e03bb2de-3fdd-4e74-a159-853ceff47a16 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a31eae43-b01c-46cf-9c06-13e9242b5fe1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:17:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:17:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:17:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:17:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:17:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:17:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Updating instance_info_cache with network_info: [{"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:17:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:17:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:17:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:17:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:17:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:17:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:17:13 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 92c63579-741c-4daa-9568-f7ddf95e3729 is timed out.
Dec 06 07:17:13 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Successfully detached device vdb from instance 92c63579-741c-4daa-9568-f7ddf95e3729 from the live domain config.
Dec 06 07:17:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaILuOXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:17:13 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:17:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[489a32a9-f024-4546-b147-a0bdbb8e0041]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:17:13 user nova-compute[75021]: No targets found.
Dec 06 07:17:13 user nova-compute[75021]: iSNS:
Dec 06 07:17:13 user nova-compute[75021]: No targets found.
Dec 06 07:17:13 user nova-compute[75021]: STATIC:
Dec 06 07:17:13 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c
Dec 06 07:17:13 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:17:13 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:17:13 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8
Dec 06 07:17:13 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:17:13 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:17:13 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:17:13 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:17:13 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:17:13 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c
Dec 06 07:17:13 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:17:13 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:17:13 user nova-compute[75021]: FIRMWARE:
Dec 06 07:17:13 user nova-compute[75021]: No targets found.
Dec 06 07:17:13 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:17:13 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:17:13 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9be48bb-164f-457a-9cae-6376f7acf035]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3aa913-9848-40dd-a884-8817c3f16e0b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:17:13 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:17:13 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:17:13 user nova-compute[75021]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c (non-flash)
Dec 06 07:17:13 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:17:13 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:17:13 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:17:13 user nova-compute[75021]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c (non-flash)
Dec 06 07:17:13 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b46e7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c'): ({'sdf'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Removing single pathed devices sdf {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c72ac36-a832-42f3-a34f-dd62e9b393b0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f85736-aa8c-4751-a665-89357b3dc9df]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Flushing IO for device /dev/sdf {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af304ae-615f-4853-a3e4-7b3d4569045b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[262689df-0ae6-4463-98d3-1904dfc456c6]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:17:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b843ce86-f37f-47d6-be50-934f6fc9b922]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b214d330-9c18-49eb-b16a-d19f7aea025e]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c, portal: 172.16.0.220,3260]
Dec 06 07:17:14 user nova-compute[75021]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c, portal: 172.16.0.220,3260] successful.
Dec 06 07:17:14 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819e5213-d8c6-4506-a46c-dfec28538f5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[854b303c-cda4-4a9e-80cb-3e01871a9880]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] <== disconnect_volume: return (323ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG nova.objects.instance [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lazy-loading 'flavor' on Instance uuid 92c63579-741c-4daa-9568-f7ddf95e3729 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:17:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2b0b0e35-22d7-435d-88fe-60127fbd2bc5 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "92c63579-741c-4daa-9568-f7ddf95e3729" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.764s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:15 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:17:16 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:17:16 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Starting finish_migration {{(pid=75021) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11677}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Instance directory exists: not creating {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 07:17:17 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Creating image(s)
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Ensure instance console log exists: /opt/stack/data/nova/instances/a31eae43-b01c-46cf-9c06-13e9242b5fe1/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Start _get_guest_xml network_info=[{"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-538526069-network", "vif_mac": "fa:16:3e:81:38:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2da8e014-1648-4cbd-914e-773745b8ab59', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfieSjZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a31eae43-b01c-46cf-9c06-13e9242b5fe1', 'attached_at': '2023-12-06T07:17:17.000000', 'detached_at': '', 'volume_id': 'acb71e11-36d0-44fe-9fcd-d2c2652e38fc', 'serial': 'acb71e11-36d0-44fe-9fcd-d2c2652e38fc'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:17:17 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:17:17 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfieSjZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:17:17 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:17:17 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:17:17 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9755b3d5-b902-417e-874a-28968fcac3d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:17:17 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c382300-d69d-4186-86f9-47cb00bfba94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc] added
Dec 06 07:17:17 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d785fb9-cfd5-42c0-b414-b7dfea7fe4b3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0998cb1e-700d-470e-bba4-c4fa0c6674f0]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lfieSjZO {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lfieSjZO" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a71394-44c6-4697-95d9-00c8133a483c]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lfieSjZO'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e647403-1b9e-42c5-aa3f-9087f50abb48]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6366f8-4a65-4472-a480-c914caf09c17]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:17:17 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:17:17 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:17:17 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:17:17 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:17:17 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:17:17 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8239d27a-abd4-4b16-8c97-0fc621850317]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260]
Dec 06 07:17:17 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260] successful.
Dec 06 07:17:17 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdea5571-5984-46c5-a6a0-44044f63d92c]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b8f4d0-340e-4272-924b-f1ff5d77f9bc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:17:17 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:17:17 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:17:17 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:17:17 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:17:17 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:17:17 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:17:17 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:17:17 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9b9083-ea42-4f80-a4ae-9cae2c3279dd]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:17:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfieSjZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26136313431633330', 'path': '/dev/sdc'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136313431633330', 'path': '/dev/sdc'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:15:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1372424050',display_name='tempest-ServerActionsTestOtherA-server-1372424050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1372424050',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbe4qUdep78TgBLG29O7GMFI0uEKESU+Xx64Y2G0xkh2EtccpxwWlafCMPJHygmaEQbyUAtZjD22PTzS9xqolPPxgkkpdNuHJ15mMhGsezfXPp1cLkefmXHoF6E+QYoeA==',key_name='tempest-keypair-34997867',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:15:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f011c1a70ac1465d8eb31e20850fdbad',ramdisk_id='',reservation_id='r-o2rbqj04',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1761792884',owner_user_name='tempest-ServerActionsTestOtherA-1761792884-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:17:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3369c937ad24537a114a71eb4674750',uuid=a31eae43-b01c-46cf-9c06-13e9242b5fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-538526069-network", "vif_mac": "fa:16:3e:81:38:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converting VIF {"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-538526069-network", "vif_mac": "fa:16:3e:81:38:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:38:94,bridge_name='br-int',has_traffic_filtering=True,id=a16e0c22-fbe2-4dff-87ed-813f89691a4f,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16e0c22-fb') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:17:18 user nova-compute[75021]:   <uuid>a31eae43-b01c-46cf-9c06-13e9242b5fe1</uuid>
Dec 06 07:17:18 user nova-compute[75021]:   <name>instance-00000023</name>
Dec 06 07:17:18 user nova-compute[75021]:   <memory>2097152</memory>
Dec 06 07:17:18 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:17:18 user nova-compute[75021]:   <metadata>
Dec 06 07:17:18 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:17:18 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:17:18 user nova-compute[75021]:       <nova:name>tempest-ServerActionsTestOtherA-server-1372424050</nova:name>
Dec 06 07:17:18 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:17:17</nova:creationTime>
Dec 06 07:17:18 user nova-compute[75021]:       <nova:flavor name="m1.small">
Dec 06 07:17:18 user nova-compute[75021]:         <nova:memory>2048</nova:memory>
Dec 06 07:17:18 user nova-compute[75021]:         <nova:disk>20</nova:disk>
Dec 06 07:17:18 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:17:18 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:17:18 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:17:18 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:17:18 user nova-compute[75021]:       <nova:owner>
Dec 06 07:17:18 user nova-compute[75021]:         <nova:user uuid="e3369c937ad24537a114a71eb4674750">tempest-ServerActionsTestOtherA-1761792884-project-member</nova:user>
Dec 06 07:17:18 user nova-compute[75021]:         <nova:project uuid="f011c1a70ac1465d8eb31e20850fdbad">tempest-ServerActionsTestOtherA-1761792884</nova:project>
Dec 06 07:17:18 user nova-compute[75021]:       </nova:owner>
Dec 06 07:17:18 user nova-compute[75021]:       <nova:ports>
Dec 06 07:17:18 user nova-compute[75021]:         <nova:port uuid="a16e0c22-fbe2-4dff-87ed-813f89691a4f">
Dec 06 07:17:18 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 07:17:18 user nova-compute[75021]:         </nova:port>
Dec 06 07:17:18 user nova-compute[75021]:       </nova:ports>
Dec 06 07:17:18 user nova-compute[75021]:     </nova:instance>
Dec 06 07:17:18 user nova-compute[75021]:   </metadata>
Dec 06 07:17:18 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:17:18 user nova-compute[75021]:     <system>
Dec 06 07:17:18 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:17:18 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:17:18 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:17:18 user nova-compute[75021]:       <entry name="serial">a31eae43-b01c-46cf-9c06-13e9242b5fe1</entry>
Dec 06 07:17:18 user nova-compute[75021]:       <entry name="uuid">a31eae43-b01c-46cf-9c06-13e9242b5fe1</entry>
Dec 06 07:17:18 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:17:18 user nova-compute[75021]:     </system>
Dec 06 07:17:18 user nova-compute[75021]:   </sysinfo>
Dec 06 07:17:18 user nova-compute[75021]:   <os>
Dec 06 07:17:18 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:17:18 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:17:18 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:17:18 user nova-compute[75021]:   </os>
Dec 06 07:17:18 user nova-compute[75021]:   <features>
Dec 06 07:17:18 user nova-compute[75021]:     <acpi/>
Dec 06 07:17:18 user nova-compute[75021]:     <apic/>
Dec 06 07:17:18 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:17:18 user nova-compute[75021]:   </features>
Dec 06 07:17:18 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:17:18 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:17:18 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:17:18 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:17:18 user nova-compute[75021]:   </clock>
Dec 06 07:17:18 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:17:18 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:17:18 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:17:18 user nova-compute[75021]:   </cpu>
Dec 06 07:17:18 user nova-compute[75021]:   <devices>
Dec 06 07:17:18 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:17:18 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:17:18 user nova-compute[75021]:       <source dev="/dev/sdc"/>
Dec 06 07:17:18 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:17:18 user nova-compute[75021]:       <serial>acb71e11-36d0-44fe-9fcd-d2c2652e38fc</serial>
Dec 06 07:17:18 user nova-compute[75021]:     </disk>
Dec 06 07:17:18 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:17:18 user nova-compute[75021]:       <mac address="fa:16:3e:81:38:94"/>
Dec 06 07:17:18 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:17:18 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:17:18 user nova-compute[75021]:       <target dev="tapa16e0c22-fb"/>
Dec 06 07:17:18 user nova-compute[75021]:     </interface>
Dec 06 07:17:18 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:17:18 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/a31eae43-b01c-46cf-9c06-13e9242b5fe1/console.log" append="off"/>
Dec 06 07:17:18 user nova-compute[75021]:     </serial>
Dec 06 07:17:18 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:17:18 user nova-compute[75021]:     <video>
Dec 06 07:17:18 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:17:18 user nova-compute[75021]:     </video>
Dec 06 07:17:18 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:17:18 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:17:18 user nova-compute[75021]:     </rng>
Dec 06 07:17:18 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:17:18 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:17:18 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:17:18 user nova-compute[75021]:     </memballoon>
Dec 06 07:17:18 user nova-compute[75021]:   </devices>
Dec 06 07:17:18 user nova-compute[75021]: </domain>
Dec 06 07:17:18 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:15:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1372424050',display_name='tempest-ServerActionsTestOtherA-server-1372424050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1372424050',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbe4qUdep78TgBLG29O7GMFI0uEKESU+Xx64Y2G0xkh2EtccpxwWlafCMPJHygmaEQbyUAtZjD22PTzS9xqolPPxgkkpdNuHJ15mMhGsezfXPp1cLkefmXHoF6E+QYoeA==',key_name='tempest-keypair-34997867',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:15:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f011c1a70ac1465d8eb31e20850fdbad',ramdisk_id='',reservation_id='r-o2rbqj04',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1761792884',owner_user_name='tempest-ServerActionsTestOtherA-1761792884-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:17:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3369c937ad24537a114a71eb4674750',uuid=a31eae43-b01c-46cf-9c06-13e9242b5fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-538526069-network", "vif_mac": "fa:16:3e:81:38:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converting VIF {"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-538526069-network", "vif_mac": "fa:16:3e:81:38:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:38:94,bridge_name='br-int',has_traffic_filtering=True,id=a16e0c22-fbe2-4dff-87ed-813f89691a4f,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16e0c22-fb') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG os_vif [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:38:94,bridge_name='br-int',has_traffic_filtering=True,id=a16e0c22-fbe2-4dff-87ed-813f89691a4f,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16e0c22-fb') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '616cec34-3b91-57a0-adca-8009eca8c20c', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa16e0c22-fb, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa16e0c22-fb, col_values=(('qos', UUID('9b97fd02-5262-4b97-a39c-3cd31d93ec7a')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa16e0c22-fb, col_values=(('external_ids', {'iface-id': 'a16e0c22-fbe2-4dff-87ed-813f89691a4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:38:94', 'vm-uuid': 'a31eae43-b01c-46cf-9c06-13e9242b5fe1'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:18 user nova-compute[75021]: INFO os_vif [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:38:94,bridge_name='br-int',has_traffic_filtering=True,id=a16e0c22-fbe2-4dff-87ed-813f89691a4f,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16e0c22-fb')
Dec 06 07:17:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] No VIF found with MAC fa:16:3e:81:38:94, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:17:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:17:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-045a4ca6-7479-4bd9-abe1-0d050da1c536 req-59449817-befb-4115-a80a-de510e2afd3d service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received event network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:17:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-045a4ca6-7479-4bd9-abe1-0d050da1c536 req-59449817-befb-4115-a80a-de510e2afd3d service nova] Acquiring lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-045a4ca6-7479-4bd9-abe1-0d050da1c536 req-59449817-befb-4115-a80a-de510e2afd3d service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-045a4ca6-7479-4bd9-abe1-0d050da1c536 req-59449817-befb-4115-a80a-de510e2afd3d service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-045a4ca6-7479-4bd9-abe1-0d050da1c536 req-59449817-befb-4115-a80a-de510e2afd3d service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] No waiting events found dispatching network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:17:20 user nova-compute[75021]: WARNING nova.compute.manager [req-045a4ca6-7479-4bd9-abe1-0d050da1c536 req-59449817-befb-4115-a80a-de510e2afd3d service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received unexpected event network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f for instance with vm_state active and task_state resize_finish.
Dec 06 07:17:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:17:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Instance running successfully.
Dec 06 07:17:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Failed to set time: agent not configured {{(pid=75021) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 06 07:17:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-1c2a3ab7-492c-4944-8382-d16af19731a3 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] finish_migration finished successfully. {{(pid=75021) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11772}}
Dec 06 07:17:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-971f3bf6-b583-4722-95ae-b880f7162df3 req-b52499d8-526d-4ecb-b56d-e641b712a111 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received event network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:17:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-971f3bf6-b583-4722-95ae-b880f7162df3 req-b52499d8-526d-4ecb-b56d-e641b712a111 service nova] Acquiring lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-971f3bf6-b583-4722-95ae-b880f7162df3 req-b52499d8-526d-4ecb-b56d-e641b712a111 service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-971f3bf6-b583-4722-95ae-b880f7162df3 req-b52499d8-526d-4ecb-b56d-e641b712a111 service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-971f3bf6-b583-4722-95ae-b880f7162df3 req-b52499d8-526d-4ecb-b56d-e641b712a111 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] No waiting events found dispatching network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:17:22 user nova-compute[75021]: WARNING nova.compute.manager [req-971f3bf6-b583-4722-95ae-b880f7162df3 req-b52499d8-526d-4ecb-b56d-e641b712a111 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received unexpected event network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f for instance with vm_state active and task_state resize_finish.
Dec 06 07:17:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-e5bc9584-0a74-46dc-9fd2-dfce021827bd req-b3d51096-7798-469b-8575-6f0042954144 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Received event network-changed-27433f1d-9497-4e66-8303-57382337858b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:17:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-e5bc9584-0a74-46dc-9fd2-dfce021827bd req-b3d51096-7798-469b-8575-6f0042954144 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Refreshing instance network info cache due to event network-changed-27433f1d-9497-4e66-8303-57382337858b. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:17:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e5bc9584-0a74-46dc-9fd2-dfce021827bd req-b3d51096-7798-469b-8575-6f0042954144 service nova] Acquiring lock "refresh_cache-2696d783-bb1e-4709-9683-c8ad1ffc627f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:17:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e5bc9584-0a74-46dc-9fd2-dfce021827bd req-b3d51096-7798-469b-8575-6f0042954144 service nova] Acquired lock "refresh_cache-2696d783-bb1e-4709-9683-c8ad1ffc627f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:17:38 user nova-compute[75021]: DEBUG nova.network.neutron [req-e5bc9584-0a74-46dc-9fd2-dfce021827bd req-b3d51096-7798-469b-8575-6f0042954144 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Refreshing network info cache for port 27433f1d-9497-4e66-8303-57382337858b {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:17:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:39 user nova-compute[75021]: DEBUG nova.network.neutron [req-e5bc9584-0a74-46dc-9fd2-dfce021827bd req-b3d51096-7798-469b-8575-6f0042954144 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Updated VIF entry in instance network info cache for port 27433f1d-9497-4e66-8303-57382337858b. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:17:39 user nova-compute[75021]: DEBUG nova.network.neutron [req-e5bc9584-0a74-46dc-9fd2-dfce021827bd req-b3d51096-7798-469b-8575-6f0042954144 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Updating instance_info_cache with network_info: [{"id": "27433f1d-9497-4e66-8303-57382337858b", "address": "fa:16:3e:88:5a:01", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27433f1d-94", "ovs_interfaceid": "27433f1d-9497-4e66-8303-57382337858b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:17:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e5bc9584-0a74-46dc-9fd2-dfce021827bd req-b3d51096-7798-469b-8575-6f0042954144 service nova] Releasing lock "refresh_cache-2696d783-bb1e-4709-9683-c8ad1ffc627f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:17:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "2696d783-bb1e-4709-9683-c8ad1ffc627f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'flavor' on Instance uuid 2696d783-bb1e-4709-9683-c8ad1ffc627f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "2696d783-bb1e-4709-9683-c8ad1ffc627f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:41 user nova-compute[75021]: INFO nova.compute.manager [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Attaching volume 20755113-4e50-4da7-b5af-83bc6d35ad19 to /dev/vdb
Dec 06 07:17:41 user nova-compute[75021]: DEBUG os_brick.utils [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[07337857-1b5b-4141-975b-54c04333c047]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b655680d-dabf-463a-bfc4-11627e355840]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ef35f4-e49f-4d49-b5b4-b8535a6c79c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9902d272-f5e4-4216-b172-b3e1eea068e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:17:41 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:17:41 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b234b481-734b-4b08-b273-a0e9b846e27b]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG os_brick.utils [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:17:41 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Updating existing volume attachment record: 93e185ee-d6f5-4464-8f23-7ec508255a75 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:17:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:51 user nova-compute[75021]: DEBUG nova.compute.manager [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:17:51 user nova-compute[75021]: INFO nova.compute.manager [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] instance snapshotting
Dec 06 07:17:51 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Beginning live snapshot process
Dec 06 07:17:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json -f qcow2 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json -f qcow2" returned: 0 in 0.211s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:51 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json -f qcow2 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:52 user nova-compute[75021]: INFO nova.compute.manager [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Rescuing
Dec 06 07:17:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "refresh_cache-2064385e-a37f-468e-bed6-129eb54295ae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:17:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquired lock "refresh_cache-2064385e-a37f-468e-bed6-129eb54295ae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:17:52 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:17:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl2xej2il/f62c0813e0d64aad8d0c3b6d8a94d620.delta 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl2xej2il/f62c0813e0d64aad8d0c3b6d8a94d620.delta 1073741824" returned: 0 in 0.083s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:52 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 06 07:17:53 user nova-compute[75021]: DEBUG nova.network.neutron [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Updating instance_info_cache with network_info: [{"id": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "address": "fa:16:3e:d4:2a:27", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f8ce24-a9", "ovs_interfaceid": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:17:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Releasing lock "refresh_cache-2064385e-a37f-468e-bed6-129eb54295ae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:17:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:17:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-9d74e108-f7c4-4738-9168-60db1cfa5420 req-5c5d5d4c-e9da-4021-b8ac-5d353dc3ee8a service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received event network-vif-unplugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:17:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9d74e108-f7c4-4738-9168-60db1cfa5420 req-5c5d5d4c-e9da-4021-b8ac-5d353dc3ee8a service nova] Acquiring lock "2064385e-a37f-468e-bed6-129eb54295ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9d74e108-f7c4-4738-9168-60db1cfa5420 req-5c5d5d4c-e9da-4021-b8ac-5d353dc3ee8a service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9d74e108-f7c4-4738-9168-60db1cfa5420 req-5c5d5d4c-e9da-4021-b8ac-5d353dc3ee8a service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-9d74e108-f7c4-4738-9168-60db1cfa5420 req-5c5d5d4c-e9da-4021-b8ac-5d353dc3ee8a service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] No waiting events found dispatching network-vif-unplugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:17:53 user nova-compute[75021]: WARNING nova.compute.manager [req-9d74e108-f7c4-4738-9168-60db1cfa5420 req-5c5d5d4c-e9da-4021-b8ac-5d353dc3ee8a service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received unexpected event network-vif-unplugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 for instance with vm_state active and task_state rescuing.
Dec 06 07:17:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:17:53 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 06 07:17:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:54 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Instance destroyed successfully.
Dec 06 07:17:54 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Attempting a stable device rescue
Dec 06 07:17:54 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 07:17:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl2xej2il/f62c0813e0d64aad8d0c3b6d8a94d620.delta /opt/stack/data/nova/instances/snapshots/tmpl2xej2il/f62c0813e0d64aad8d0c3b6d8a94d620 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75021) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 07:17:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Instance directory exists: not creating {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 07:17:54 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Creating image(s)
Dec 06 07:17:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "/opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "/opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "/opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:54 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2064385e-a37f-468e-bed6-129eb54295ae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:17:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "b1dbf32e356372527665b8d54c855a85afabc471" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "b1dbf32e356372527665b8d54c855a85afabc471" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1dbf32e356372527665b8d54c855a85afabc471.part --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl2xej2il/f62c0813e0d64aad8d0c3b6d8a94d620.delta /opt/stack/data/nova/instances/snapshots/tmpl2xej2il/f62c0813e0d64aad8d0c3b6d8a94d620" returned: 0 in 1.256s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:55 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Snapshot extracted, beginning image upload
Dec 06 07:17:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1dbf32e356372527665b8d54c855a85afabc471.part --force-share --output=json" returned: 0 in 0.228s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:55 user nova-compute[75021]: DEBUG nova.virt.images [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] d15e0404-26d2-4053-ba40-298cb14992a3 was qcow2, converting to raw {{(pid=75021) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 07:17:55 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 07:17:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b1dbf32e356372527665b8d54c855a85afabc471.part /opt/stack/data/nova/instances/_base/b1dbf32e356372527665b8d54c855a85afabc471.converted {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-acb64457-3fda-429b-96be-2458d5358f7e req-341bb5de-de02-4f6c-8b09-b78d2e807288 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:17:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-acb64457-3fda-429b-96be-2458d5358f7e req-341bb5de-de02-4f6c-8b09-b78d2e807288 service nova] Acquiring lock "2064385e-a37f-468e-bed6-129eb54295ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-acb64457-3fda-429b-96be-2458d5358f7e req-341bb5de-de02-4f6c-8b09-b78d2e807288 service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-acb64457-3fda-429b-96be-2458d5358f7e req-341bb5de-de02-4f6c-8b09-b78d2e807288 service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-acb64457-3fda-429b-96be-2458d5358f7e req-341bb5de-de02-4f6c-8b09-b78d2e807288 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] No waiting events found dispatching network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:17:55 user nova-compute[75021]: WARNING nova.compute.manager [req-acb64457-3fda-429b-96be-2458d5358f7e req-341bb5de-de02-4f6c-8b09-b78d2e807288 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received unexpected event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 for instance with vm_state active and task_state rescuing.
Dec 06 07:17:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b1dbf32e356372527665b8d54c855a85afabc471.part /opt/stack/data/nova/instances/_base/b1dbf32e356372527665b8d54c855a85afabc471.converted" returned: 0 in 0.294s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1dbf32e356372527665b8d54c855a85afabc471.converted --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1dbf32e356372527665b8d54c855a85afabc471.converted --force-share --output=json" returned: 0 in 0.242s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "b1dbf32e356372527665b8d54c855a85afabc471" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.781s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "b1dbf32e356372527665b8d54c855a85afabc471" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "b1dbf32e356372527665b8d54c855a85afabc471" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1dbf32e356372527665b8d54c855a85afabc471 --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1dbf32e356372527665b8d54c855a85afabc471 --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b1dbf32e356372527665b8d54c855a85afabc471,backing_fmt=raw /opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/disk.rescue {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b1dbf32e356372527665b8d54c855a85afabc471,backing_fmt=raw /opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/disk.rescue" returned: 0 in 0.059s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "b1dbf32e356372527665b8d54c855a85afabc471" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'migration_context' on Instance uuid 2064385e-a37f-468e-bed6-129eb54295ae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.objects.base [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Object Instance<2064385e-a37f-468e-bed6-129eb54295ae> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Start _get_guest_xml network_info=[{"id": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "address": "fa:16:3e:d4:2a:27", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "vif_mac": "fa:16:3e:d4:2a:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f8ce24-a9", "ovs_interfaceid": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd15e0404-26d2-4053-ba40-298cb14992a3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '404ef3ae-db6d-420a-a512-f60d615cb9ad', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZAMnyFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '2064385e-a37f-468e-bed6-129eb54295ae', 'attached_at': '', 'detached_at': '', 'volume_id': '98bfe29a-a367-4b70-9d31-877ed682847c', 'serial': '98bfe29a-a367-4b70-9d31-877ed682847c'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'resources' on Instance uuid 2064385e-a37f-468e-bed6-129eb54295ae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.objects.base [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Object Instance<2064385e-a37f-468e-bed6-129eb54295ae> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'numa_topology' on Instance uuid 2064385e-a37f-468e-bed6-129eb54295ae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.objects.base [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Object Instance<2064385e-a37f-468e-bed6-129eb54295ae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:17:56 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:17:56 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2064385e-a37f-468e-bed6-129eb54295ae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.objects.base [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Object Instance<2064385e-a37f-468e-bed6-129eb54295ae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZAMnyFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:17:56 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:17:56 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:17:56 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaa8e73-b53f-43e0-87e6-9350f5c6837f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gZAMnyFp\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 06 07:17:56 user nova-compute[75021]: node.name = iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c
Dec 06 07:17:56 user nova-compute[75021]: node.tpgt = -1
Dec 06 07:17:56 user nova-compute[75021]: node.startup = automatic
Dec 06 07:17:56 user nova-compute[75021]: node.leading_login = No
Dec 06 07:17:56 user nova-compute[75021]: iface.iscsi_ifacename = default
Dec 06 07:17:56 user nova-compute[75021]: iface.net_ifacename = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.ipaddress = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.prefix_len = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.hwaddress = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.transport_name = tcp
Dec 06 07:17:56 user nova-compute[75021]: iface.initiatorname = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.state = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.vlan_id = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.vlan_priority = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.vlan_state = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.iface_num = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.mtu = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.port = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.bootproto = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.subnet_mask = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.gateway = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.dhcp_alt_client_id_state = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.dhcp_alt_client_id = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.dhcp_dns = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.dhcp_learn_iqn = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.dhcp_req_vendor_id_state = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.dhcp_vendor_id_state = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.dhcp_vendor_id = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.dhcp_slp_da = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.fragmentation = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.gratuitous_arp = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.incoming_forwarding = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.tos_state = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.tos = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.ttl = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.delayed_ack = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.tcp_nagle = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.tcp_wsf_state = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.tcp_wsf = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.tcp_timer_scale = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.tcp_timestamp = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.redirect = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.def_task_mgmt_timeout = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.header_digest = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.data_digest = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.immediate_data = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.initial_r2t = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.data_seq_inorder = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.data_pdu_inorder = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.erl = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.max_receive_data_len = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.first_burst_len = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.max_outstanding_r2t = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.max_burst_len = 0
Dec 06 07:17:56 user nova-compute[75021]: iface.chap_auth = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.bidi_chap = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.strict_login_compliance = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.discovery_auth = <empty>
Dec 06 07:17:56 user nova-compute[75021]: iface.discovery_logout = <empty>
Dec 06 07:17:56 user nova-compute[75021]: node.discovery_address = <empty>
Dec 06 07:17:56 user nova-compute[75021]: node.discovery_port = 0
Dec 06 07:17:56 user nova-compute[75021]: node.discovery_type = static
Dec 06 07:17:56 user nova-compute[75021]: node.session.initial_cmdsn = 0
Dec 06 07:17:56 user nova-compute[75021]: node.session.initial_login_retry_max = 8
Dec 06 07:17:56 user nova-compute[75021]: node.session.xmit_thread_priority = -20
Dec 06 07:17:56 user nova-compute[75021]: node.session.cmds_max = 128
Dec 06 07:17:56 user nova-compute[75021]: node.session.queue_depth = 32
Dec 06 07:17:56 user nova-compute[75021]: node.session.nr_sessions = 1
Dec 06 07:17:56 user nova-compute[75021]: node.session.auth.authmethod = CHAP
Dec 06 07:17:56 user nova-compute[75021]: node.session.auth.username = gZAMnyFp
Dec 06 07:17:56 user nova-compute[75021]: node.session.auth.password = ***
Dec 06 07:17:56 user nova-compute[75021]: node.session.auth.username_in = <empty>
Dec 06 07:17:56 user nova-compute[75021]: node.session.auth.password_in = <empty>
Dec 06 07:17:56 user nova-compute[75021]: node.session.auth.chap_algs = MD5
Dec 06 07:17:56 user nova-compute[75021]: node.session.timeo.replacement_timeout = 120
Dec 06 07:17:56 user nova-compute[75021]: node.session.err_timeo.abort_timeout = 15
Dec 06 07:17:56 user nova-compute[75021]: node.session.err_timeo.lu_reset_timeout = 30
Dec 06 07:17:56 user nova-compute[75021]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 06 07:17:56 user nova-compute[75021]: node.session.err_timeo.host_reset_timeout = 60
Dec 06 07:17:56 user nova-compute[75021]: node.session.iscsi.FastAbort = Yes
Dec 06 07:17:56 user nova-compute[75021]: node.session.iscsi.InitialR2T = No
Dec 06 07:17:56 user nova-compute[75021]: node.session.iscsi.ImmediateData = Yes
Dec 06 07:17:56 user nova-compute[75021]: node.session.iscsi.FirstBurstLength = 262144
Dec 06 07:17:56 user nova-compute[75021]: node.session.iscsi.MaxBurstLength = 16776192
Dec 06 07:17:56 user nova-compute[75021]: node.session.iscsi.DefaultTime2Retain = 0
Dec 06 07:17:56 user nova-compute[75021]: node.session.iscsi.DefaultTime2Wait = 2
Dec 06 07:17:56 user nova-compute[75021]: node.session.iscsi.MaxConnections = 1
Dec 06 07:17:56 user nova-compute[75021]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 06 07:17:56 user nova-compute[75021]: node.session.iscsi.ERL = 0
Dec 06 07:17:56 user nova-compute[75021]: node.session.scan = manual
Dec 06 07:17:56 user nova-compute[75021]: node.session.reopen_max = 0
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].address = 172.16.0.220
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].port = 3260
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].startup = manual
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].tcp.window_size = 524288
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].tcp.type_of_service = 0
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].timeo.logout_timeout = 15
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].timeo.login_timeout = 15
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].timeo.auth_timeout = 45
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].timeo.noop_out_interval = 5
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].timeo.noop_out_timeout = 5
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].iscsi.HeaderDigest = None
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].iscsi.DataDigest = None
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].iscsi.IFMarker = No
Dec 06 07:17:56 user nova-compute[75021]: node.conn[0].iscsi.OFMarker = No
Dec 06 07:17:56 user nova-compute[75021]: # END RECORD
Dec 06 07:17:56 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[831da443-c94d-4d74-af6d-e8dde84d4840]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[39060089-ae92-46de-8187-e29565c85b9c]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZAMnyFp {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZAMnyFp" returned: 0 in 0.035s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed4d4c1-befb-42ff-9fd4-d83b72e5f3ce]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gZAMnyFp'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[38df74b6-1a7f-4ac0-8791-125eebe2641d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a922462c-438e-4e54-b8c2-08484e7a4b88]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:17:56 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:17:56 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:17:56 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:17:56 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:17:56 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:17:56 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:17:56 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:17:56 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.185s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] HCTL ('36', '0', '0', 0) found on session 42 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c775f26-dbec-4af3-ba5b-21d8e8b93894]: (4, ('0 0 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Searching for a device in session 42 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZAMnyFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.212s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] <== connect_volume: return (213ms) {'type': 'block', 'scsi_wwn': '26634393464306133', 'path': '/dev/sde'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634393464306133', 'path': '/dev/sde'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1457326660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1457326660',id=37,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:16:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9895e43bf76d4760a26a5e64ea6d4e14',ramdisk_id='',reservation_id='r-b1vuxe2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:16:28Z,user_data=None,user_id='c0774aa1e3ee4b69b195b575d116ee96',uuid=2064385e-a37f-468e-bed6-129eb54295ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "address": "fa:16:3e:d4:2a:27", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "vif_mac": "fa:16:3e:d4:2a:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f8ce24-a9", "ovs_interfaceid": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converting VIF {"id": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "address": "fa:16:3e:d4:2a:27", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "vif_mac": "fa:16:3e:d4:2a:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f8ce24-a9", "ovs_interfaceid": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:2a:27,bridge_name='br-int',has_traffic_filtering=True,id=19f8ce24-a977-46ee-a878-728ddc13a4e0,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f8ce24-a9') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'pci_devices' on Instance uuid 2064385e-a37f-468e-bed6-129eb54295ae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.objects.base [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Object Instance<2064385e-a37f-468e-bed6-129eb54295ae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:17:56 user nova-compute[75021]:   <uuid>2064385e-a37f-468e-bed6-129eb54295ae</uuid>
Dec 06 07:17:56 user nova-compute[75021]:   <name>instance-00000025</name>
Dec 06 07:17:56 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:17:56 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:17:56 user nova-compute[75021]:   <metadata>
Dec 06 07:17:56 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:17:56 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:17:56 user nova-compute[75021]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1457326660</nova:name>
Dec 06 07:17:56 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:17:56</nova:creationTime>
Dec 06 07:17:56 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:17:56 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:17:56 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:17:56 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:17:56 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:17:56 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:17:56 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:17:56 user nova-compute[75021]:       <nova:owner>
Dec 06 07:17:56 user nova-compute[75021]:         <nova:user uuid="c0774aa1e3ee4b69b195b575d116ee96">tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member</nova:user>
Dec 06 07:17:56 user nova-compute[75021]:         <nova:project uuid="9895e43bf76d4760a26a5e64ea6d4e14">tempest-ServerBootFromVolumeStableRescueTest-1272250883</nova:project>
Dec 06 07:17:56 user nova-compute[75021]:       </nova:owner>
Dec 06 07:17:56 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:17:56 user nova-compute[75021]:       <nova:ports>
Dec 06 07:17:56 user nova-compute[75021]:         <nova:port uuid="19f8ce24-a977-46ee-a878-728ddc13a4e0">
Dec 06 07:17:56 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 07:17:56 user nova-compute[75021]:         </nova:port>
Dec 06 07:17:56 user nova-compute[75021]:       </nova:ports>
Dec 06 07:17:56 user nova-compute[75021]:     </nova:instance>
Dec 06 07:17:56 user nova-compute[75021]:   </metadata>
Dec 06 07:17:56 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:17:56 user nova-compute[75021]:     <system>
Dec 06 07:17:56 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:17:56 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:17:56 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:17:56 user nova-compute[75021]:       <entry name="serial">2064385e-a37f-468e-bed6-129eb54295ae</entry>
Dec 06 07:17:56 user nova-compute[75021]:       <entry name="uuid">2064385e-a37f-468e-bed6-129eb54295ae</entry>
Dec 06 07:17:56 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:17:56 user nova-compute[75021]:     </system>
Dec 06 07:17:56 user nova-compute[75021]:   </sysinfo>
Dec 06 07:17:56 user nova-compute[75021]:   <os>
Dec 06 07:17:56 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:17:56 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:17:56 user nova-compute[75021]:   </os>
Dec 06 07:17:56 user nova-compute[75021]:   <features>
Dec 06 07:17:56 user nova-compute[75021]:     <acpi/>
Dec 06 07:17:56 user nova-compute[75021]:     <apic/>
Dec 06 07:17:56 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:17:56 user nova-compute[75021]:   </features>
Dec 06 07:17:56 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:17:56 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:17:56 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:17:56 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:17:56 user nova-compute[75021]:   </clock>
Dec 06 07:17:56 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:17:56 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:17:56 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:17:56 user nova-compute[75021]:   </cpu>
Dec 06 07:17:56 user nova-compute[75021]:   <devices>
Dec 06 07:17:56 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:17:56 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:17:56 user nova-compute[75021]:       <source dev="/dev/sde"/>
Dec 06 07:17:56 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:17:56 user nova-compute[75021]:       <serial>98bfe29a-a367-4b70-9d31-877ed682847c</serial>
Dec 06 07:17:56 user nova-compute[75021]:     </disk>
Dec 06 07:17:56 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:17:56 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:17:56 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/disk.rescue"/>
Dec 06 07:17:56 user nova-compute[75021]:       <target dev="vdb" bus="virtio"/>
Dec 06 07:17:56 user nova-compute[75021]:       <boot order="1"/>
Dec 06 07:17:56 user nova-compute[75021]:     </disk>
Dec 06 07:17:56 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:17:56 user nova-compute[75021]:       <mac address="fa:16:3e:d4:2a:27"/>
Dec 06 07:17:56 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:17:56 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:17:56 user nova-compute[75021]:       <target dev="tap19f8ce24-a9"/>
Dec 06 07:17:56 user nova-compute[75021]:     </interface>
Dec 06 07:17:56 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:17:56 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/console.log" append="off"/>
Dec 06 07:17:56 user nova-compute[75021]:     </serial>
Dec 06 07:17:56 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:17:56 user nova-compute[75021]:     <video>
Dec 06 07:17:56 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:17:56 user nova-compute[75021]:     </video>
Dec 06 07:17:56 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:17:56 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:17:56 user nova-compute[75021]:     </rng>
Dec 06 07:17:56 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:17:56 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:17:56 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:17:56 user nova-compute[75021]:     </memballoon>
Dec 06 07:17:56 user nova-compute[75021]:   </devices>
Dec 06 07:17:56 user nova-compute[75021]: </domain>
Dec 06 07:17:56 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:17:56 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Instance destroyed successfully.
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:17:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] No VIF found with MAC fa:16:3e:d4:2a:27, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:17:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:58 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Snapshot image upload complete
Dec 06 07:17:58 user nova-compute[75021]: INFO nova.compute.manager [None req-66d12337-3bf6-4eb1-b292-09884f6814b6 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Took 7.32 seconds to snapshot the instance on the hypervisor.
Dec 06 07:17:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-d8ae33b2-eb28-4cea-b3e3-29f523050aaa req-8b0e08a0-2590-46f3-83c3-063d5a61a030 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:17:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d8ae33b2-eb28-4cea-b3e3-29f523050aaa req-8b0e08a0-2590-46f3-83c3-063d5a61a030 service nova] Acquiring lock "2064385e-a37f-468e-bed6-129eb54295ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:17:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d8ae33b2-eb28-4cea-b3e3-29f523050aaa req-8b0e08a0-2590-46f3-83c3-063d5a61a030 service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:17:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d8ae33b2-eb28-4cea-b3e3-29f523050aaa req-8b0e08a0-2590-46f3-83c3-063d5a61a030 service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:17:58 user nova-compute[75021]: DEBUG nova.compute.manager [req-d8ae33b2-eb28-4cea-b3e3-29f523050aaa req-8b0e08a0-2590-46f3-83c3-063d5a61a030 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] No waiting events found dispatching network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:17:58 user nova-compute[75021]: WARNING nova.compute.manager [req-d8ae33b2-eb28-4cea-b3e3-29f523050aaa req-8b0e08a0-2590-46f3-83c3-063d5a61a030 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received unexpected event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 for instance with vm_state active and task_state rescuing.
Dec 06 07:17:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:17:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:18:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-38221e1b-5357-478d-bb2f-e8e0ba97afc1 req-bf57e21c-1bb3-417f-9591-17ef245cc2df service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:18:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-38221e1b-5357-478d-bb2f-e8e0ba97afc1 req-bf57e21c-1bb3-417f-9591-17ef245cc2df service nova] Acquiring lock "2064385e-a37f-468e-bed6-129eb54295ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-38221e1b-5357-478d-bb2f-e8e0ba97afc1 req-bf57e21c-1bb3-417f-9591-17ef245cc2df service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-38221e1b-5357-478d-bb2f-e8e0ba97afc1 req-bf57e21c-1bb3-417f-9591-17ef245cc2df service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-38221e1b-5357-478d-bb2f-e8e0ba97afc1 req-bf57e21c-1bb3-417f-9591-17ef245cc2df service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] No waiting events found dispatching network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:18:00 user nova-compute[75021]: WARNING nova.compute.manager [req-38221e1b-5357-478d-bb2f-e8e0ba97afc1 req-bf57e21c-1bb3-417f-9591-17ef245cc2df service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received unexpected event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 for instance with vm_state active and task_state rescuing.
Dec 06 07:18:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:00 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:18:00 user nova-compute[75021]: INFO nova.compute.claims [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Claim successful on node user
Dec 06 07:18:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-e06b9e8b-4bcf-494b-84ed-7ad130cea94e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "1045c42c-85e8-46b9-ad58-124004244545" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:18:01 user nova-compute[75021]: INFO nova.compute.claims [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Claim successful on node user
Dec 06 07:18:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:18:01 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:18:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG nova.policy [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fe3ee5eb8fd41b08a813b53c4e3ec23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f583c975ad5427f8a6ea845d0e22f2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:18:01 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Creating image(s)
Dec 06 07:18:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "/opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "/opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "/opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "bd50aeab4a3797cd8395dc356902a3f79e792381" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "bd50aeab4a3797cd8395dc356902a3f79e792381" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381.part --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Successfully created port: c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YUpHhLSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:18:02 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:18:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:18:02 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:18:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:18:02 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2239ec4-4879-4cef-9367-f4cbe4b38b7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:18:02 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ed9069-2ba7-4ad7-8757-cab8c04c9697]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19] added
Dec 06 07:18:02 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e5874a-d579-4ab1-86be-ac2d148021f0]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[33800031-812b-492d-8ea1-70f5c8c85850]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YUpHhLSu {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381.part --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG nova.virt.images [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] 1f2040dd-0102-481e-8a11-7975d01c9e01 was qcow2, converting to raw {{(pid=75021) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381.part /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381.converted {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YUpHhLSu" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a41926e-10ff-4225-bea4-90879dee9921]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YUpHhLSu'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f81a313-3d39-412f-bfb8-3a4b7d76b7b4]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.540s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3108de-e002-4da1-bb5a-ea053a095453]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:18:03 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:18:03 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:18:03 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:18:03 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:18:03 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:18:03 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:18:03 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:18:03 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:18:03 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:18:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381.part /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381.converted" returned: 0 in 0.490s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381.converted --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG nova.policy [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40060f0208274a93a4b51d49ea49b0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23503d0dbe8d4fecb75c457a20a5909d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG nova.objects.instance [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'flavor' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquired lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG nova.network.neutron [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG nova.objects.instance [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'info_cache' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:18:03 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Creating image(s)
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "/opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "/opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "/opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG nova.objects.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Object Instance<0dc18c93-5a40-4c98-a6bf-7422e45b245d> lazy-loaded attributes: flavor,info_cache {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381.converted --force-share --output=json" returned: 0 in 0.268s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "bd50aeab4a3797cd8395dc356902a3f79e792381" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.915s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381 --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.208s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381 --force-share --output=json" returned: 0 in 0.229s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "bd50aeab4a3797cd8395dc356902a3f79e792381" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "bd50aeab4a3797cd8395dc356902a3f79e792381" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381 --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Successfully updated port: c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "refresh_cache-65977b9a-f812-44b8-b8dc-95c12e2f8a6d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquired lock "refresh_cache-65977b9a-f812-44b8-b8dc-95c12e2f8a6d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.200s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-c376fa55-35fc-4e22-9f75-ffd7feaf6bba req-dd55ba69-c974-49ff-803c-73c261a2a98a service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Received event network-changed-c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-c376fa55-35fc-4e22-9f75-ffd7feaf6bba req-dd55ba69-c974-49ff-803c-73c261a2a98a service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Refreshing instance network info cache due to event network-changed-c40da641-e0b5-4077-959e-cd325f6475be. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c376fa55-35fc-4e22-9f75-ffd7feaf6bba req-dd55ba69-c974-49ff-803c-73c261a2a98a service nova] Acquiring lock "refresh_cache-65977b9a-f812-44b8-b8dc-95c12e2f8a6d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk 1073741824" returned: 0 in 0.074s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381 --force-share --output=json" returned: 0 in 0.260s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381,backing_fmt=raw /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --login" returned: 0 in 1.143s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[048ff1ca-2ea3-483d-bcfb-e0991c88761e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19, portal: 172.16.0.220,3260]
Dec 06 07:18:04 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19, portal: 172.16.0.220,3260] successful.
Dec 06 07:18:04 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381,backing_fmt=raw /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk 1073741824" returned: 0 in 0.059s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "bd50aeab4a3797cd8395dc356902a3f79e792381" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381 --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9467a223-6522-42e4-bfa1-0fee40b60115]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Successfully created port: 17d6b8c2-69b7-43de-b142-6a5015d774ef {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.227s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c66270-f6e6-40b4-a904-10580d85f2f6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:18:04 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:18:04 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:18:04 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:18:04 user nova-compute[75021]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 (non-flash)
Dec 06 07:18:04 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:18:04 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:18:04 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:18:04 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:18:04 user nova-compute[75021]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 (non-flash)
Dec 06 07:18:04 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.647s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98eccbc-be8a-4725-a8e5-8b8dee09c407]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YUpHhLSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381 --force-share --output=json" returned: 0 in 0.233s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Ensure instance console log exists: /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.network.neutron [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Updating instance_info_cache with network_info: [{"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Releasing lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:18:04 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Instance destroyed successfully.
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.objects.instance [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'resources' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.objects.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Object Instance<0dc18c93-5a40-4c98-a6bf-7422e45b245d> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-964895959',display_name='tempest-AttachVolumeTestJSON-server-964895959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-964895959',id=33,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXnsp33Va88K9HMduz0isu8LdTEYh6ifTevR8F0QY6TmOty18bkV5GKJPhgdUF5uYfbmmBq+t2VYhMvKtNZZK1CejSjAntwpRgpOFPsHdEq6Y3WTe/qlOipA1Kn8ihHeQ==',key_name='tempest-keypair-645111669',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:14:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f0a2ff3d04db4832a990891c79df356c',ramdisk_id='',reservation_id='r-9za7bkf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280062788',owner_user_name='tempest-AttachVolumeTestJSON-280062788-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9947f4c20feb463fb485de2a7d4bbef5',uuid=0dc18c93-5a40-4c98-a6bf-7422e45b245d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converting VIF {"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG os_vif [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac69c289-81, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5558db3-4d12-4c7e-a4e7-276252df414b) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:04 user nova-compute[75021]: INFO os_vif [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81')
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Cannot resize image /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Ensure instance console log exists: /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Updating instance_info_cache with network_info: [{"id": "c40da641-e0b5-4077-959e-cd325f6475be", "address": "fa:16:3e:70:4a:cd", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40da641-e0", "ovs_interfaceid": "c40da641-e0b5-4077-959e-cd325f6475be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvwfnuhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:18:04 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:18:04 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Releasing lock "refresh_cache-65977b9a-f812-44b8-b8dc-95c12e2f8a6d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Instance network_info: |[{"id": "c40da641-e0b5-4077-959e-cd325f6475be", "address": "fa:16:3e:70:4a:cd", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40da641-e0", "ovs_interfaceid": "c40da641-e0b5-4077-959e-cd325f6475be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c376fa55-35fc-4e22-9f75-ffd7feaf6bba req-dd55ba69-c974-49ff-803c-73c261a2a98a service nova] Acquired lock "refresh_cache-65977b9a-f812-44b8-b8dc-95c12e2f8a6d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.network.neutron [req-c376fa55-35fc-4e22-9f75-ffd7feaf6bba req-dd55ba69-c974-49ff-803c-73c261a2a98a service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Refreshing network info cache for port c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Start _get_guest_xml network_info=[{"id": "c40da641-e0b5-4077-959e-cd325f6475be", "address": "fa:16:3e:70:4a:cd", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40da641-e0", "ovs_interfaceid": "c40da641-e0b5-4077-959e-cd325f6475be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b01c22eecf101221fc18048cbf0f2d89',container_format='bare',created_at=2023-12-06T07:17:51Z,direct_url=<?>,disk_format='qcow2',id=1f2040dd-0102-481e-8a11-7975d01c9e01,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1530967761',owner='7f583c975ad5427f8a6ea845d0e22f2e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-06T07:17:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': '1f2040dd-0102-481e-8a11-7975d01c9e01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:18:04 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:18:04 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b01c22eecf101221fc18048cbf0f2d89',container_format='bare',created_at=2023-12-06T07:17:51Z,direct_url=<?>,disk_format='qcow2',id=1f2040dd-0102-481e-8a11-7975d01c9e01,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1530967761',owner='7f583c975ad5427f8a6ea845d0e22f2e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-06T07:17:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:18:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-411127879',display_name='tempest-TestStampPattern-server-411127879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-411127879',id=38,image_ref='1f2040dd-0102-481e-8a11-7975d01c9e01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg8IGkXaXCpoLXuv1QgPTQlIboH6YGAoE4h1LpIm9THcogGNb2pCBJ53/n7DkXcaYeQRE+8kERBbD6EPJISjHNebvAB2igEJJMWl/apA8rqHLtvdqFZ90Vp+dBW6ln6vA==',key_name='tempest-TestStampPattern-2114891316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f583c975ad5427f8a6ea845d0e22f2e',ramdisk_id='',reservation_id='r-owwu5gql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='92c63579-741c-4daa-9568-f7ddf95e3729',image_min_disk='1',image_min_ram='0',image_owner_id='7f583c975ad5427f8a6ea845d0e22f2e',image_owner_project_name='tempest-TestStampPattern-1309177845',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1309177845-project-member',image_user_id='6fe3ee5eb8fd41b08a813b53c4e3ec23',network_allocated='True',owner_project_name='tempest-TestStampPattern-1309177845',owner_user_name='tempest-TestStampPattern-1309177845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:18:02Z,user_data=None,user_id='6fe3ee5eb8fd41b08a813b53c4e3ec23',uuid=65977b9a-f812-44b8-b8dc-95c12e2f8a6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c40da641-e0b5-4077-959e-cd325f6475be", "address": "fa:16:3e:70:4a:cd", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40da641-e0", "ovs_interfaceid": "c40da641-e0b5-4077-959e-cd325f6475be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Converting VIF {"id": "c40da641-e0b5-4077-959e-cd325f6475be", "address": "fa:16:3e:70:4a:cd", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40da641-e0", "ovs_interfaceid": "c40da641-e0b5-4077-959e-cd325f6475be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:4a:cd,bridge_name='br-int',has_traffic_filtering=True,id=c40da641-e0b5-4077-959e-cd325f6475be,network=Network(1392d2f0-29b7-4293-bf52-5e004250332f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40da641-e0') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.objects.instance [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lazy-loading 'pci_devices' on Instance uuid 65977b9a-f812-44b8-b8dc-95c12e2f8a6d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:18:04 user nova-compute[75021]:   <uuid>65977b9a-f812-44b8-b8dc-95c12e2f8a6d</uuid>
Dec 06 07:18:04 user nova-compute[75021]:   <name>instance-00000026</name>
Dec 06 07:18:04 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:18:04 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:18:04 user nova-compute[75021]:   <metadata>
Dec 06 07:18:04 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:18:04 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:18:04 user nova-compute[75021]:       <nova:name>tempest-TestStampPattern-server-411127879</nova:name>
Dec 06 07:18:04 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:18:04</nova:creationTime>
Dec 06 07:18:04 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:18:04 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:18:04 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:18:04 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:18:04 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:18:04 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:18:04 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:18:04 user nova-compute[75021]:       <nova:owner>
Dec 06 07:18:04 user nova-compute[75021]:         <nova:user uuid="6fe3ee5eb8fd41b08a813b53c4e3ec23">tempest-TestStampPattern-1309177845-project-member</nova:user>
Dec 06 07:18:04 user nova-compute[75021]:         <nova:project uuid="7f583c975ad5427f8a6ea845d0e22f2e">tempest-TestStampPattern-1309177845</nova:project>
Dec 06 07:18:04 user nova-compute[75021]:       </nova:owner>
Dec 06 07:18:04 user nova-compute[75021]:       <nova:root type="image" uuid="1f2040dd-0102-481e-8a11-7975d01c9e01"/>
Dec 06 07:18:04 user nova-compute[75021]:       <nova:ports>
Dec 06 07:18:04 user nova-compute[75021]:         <nova:port uuid="c40da641-e0b5-4077-959e-cd325f6475be">
Dec 06 07:18:04 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 06 07:18:04 user nova-compute[75021]:         </nova:port>
Dec 06 07:18:04 user nova-compute[75021]:       </nova:ports>
Dec 06 07:18:04 user nova-compute[75021]:     </nova:instance>
Dec 06 07:18:04 user nova-compute[75021]:   </metadata>
Dec 06 07:18:04 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:18:04 user nova-compute[75021]:     <system>
Dec 06 07:18:04 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:18:04 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:18:04 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:18:04 user nova-compute[75021]:       <entry name="serial">65977b9a-f812-44b8-b8dc-95c12e2f8a6d</entry>
Dec 06 07:18:04 user nova-compute[75021]:       <entry name="uuid">65977b9a-f812-44b8-b8dc-95c12e2f8a6d</entry>
Dec 06 07:18:04 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:18:04 user nova-compute[75021]:     </system>
Dec 06 07:18:04 user nova-compute[75021]:   </sysinfo>
Dec 06 07:18:04 user nova-compute[75021]:   <os>
Dec 06 07:18:04 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:18:04 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:18:04 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:18:04 user nova-compute[75021]:   </os>
Dec 06 07:18:04 user nova-compute[75021]:   <features>
Dec 06 07:18:04 user nova-compute[75021]:     <acpi/>
Dec 06 07:18:04 user nova-compute[75021]:     <apic/>
Dec 06 07:18:04 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:18:04 user nova-compute[75021]:   </features>
Dec 06 07:18:04 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:18:04 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:18:04 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:18:04 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:18:04 user nova-compute[75021]:   </clock>
Dec 06 07:18:04 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:18:04 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:18:04 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:18:04 user nova-compute[75021]:   </cpu>
Dec 06 07:18:04 user nova-compute[75021]:   <devices>
Dec 06 07:18:04 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:18:04 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:18:04 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk"/>
Dec 06 07:18:04 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:18:04 user nova-compute[75021]:     </disk>
Dec 06 07:18:04 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:18:04 user nova-compute[75021]:       <mac address="fa:16:3e:70:4a:cd"/>
Dec 06 07:18:04 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:18:04 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:18:04 user nova-compute[75021]:       <target dev="tapc40da641-e0"/>
Dec 06 07:18:04 user nova-compute[75021]:     </interface>
Dec 06 07:18:04 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:18:04 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/console.log" append="off"/>
Dec 06 07:18:04 user nova-compute[75021]:     </serial>
Dec 06 07:18:04 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:18:04 user nova-compute[75021]:     <video>
Dec 06 07:18:04 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:18:04 user nova-compute[75021]:     </video>
Dec 06 07:18:04 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:18:04 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:18:04 user nova-compute[75021]:     </rng>
Dec 06 07:18:04 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:18:04 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:18:04 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:18:04 user nova-compute[75021]:     </memballoon>
Dec 06 07:18:04 user nova-compute[75021]:   </devices>
Dec 06 07:18:04 user nova-compute[75021]: </domain>
Dec 06 07:18:04 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:18:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-411127879',display_name='tempest-TestStampPattern-server-411127879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-411127879',id=38,image_ref='1f2040dd-0102-481e-8a11-7975d01c9e01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg8IGkXaXCpoLXuv1QgPTQlIboH6YGAoE4h1LpIm9THcogGNb2pCBJ53/n7DkXcaYeQRE+8kERBbD6EPJISjHNebvAB2igEJJMWl/apA8rqHLtvdqFZ90Vp+dBW6ln6vA==',key_name='tempest-TestStampPattern-2114891316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f583c975ad5427f8a6ea845d0e22f2e',ramdisk_id='',reservation_id='r-owwu5gql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='92c63579-741c-4daa-9568-f7ddf95e3729',image_min_disk='1',image_min_ram='0',image_owner_id='7f583c975ad5427f8a6ea845d0e22f2e',image_owner_project_name='tempest-TestStampPattern-1309177845',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1309177845-project-member',image_user_id='6fe3ee5eb8fd41b08a813b53c4e3ec23',network_allocated='True',owner_project_name='tempest-TestStampPattern-1309177845',owner_user_name='tempest-TestStampPattern-1309177845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:18:02Z,user_data=None,user_id='6fe3ee5eb8fd41b08a813b53c4e3ec23',uuid=65977b9a-f812-44b8-b8dc-95c12e2f8a6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c40da641-e0b5-4077-959e-cd325f6475be", "address": "fa:16:3e:70:4a:cd", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40da641-e0", "ovs_interfaceid": "c40da641-e0b5-4077-959e-cd325f6475be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Converting VIF {"id": "c40da641-e0b5-4077-959e-cd325f6475be", "address": "fa:16:3e:70:4a:cd", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40da641-e0", "ovs_interfaceid": "c40da641-e0b5-4077-959e-cd325f6475be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:4a:cd,bridge_name='br-int',has_traffic_filtering=True,id=c40da641-e0b5-4077-959e-cd325f6475be,network=Network(1392d2f0-29b7-4293-bf52-5e004250332f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40da641-e0') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG os_vif [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:4a:cd,bridge_name='br-int',has_traffic_filtering=True,id=c40da641-e0b5-4077-959e-cd325f6475be,network=Network(1392d2f0-29b7-4293-bf52-5e004250332f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40da641-e0') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1f0455a-fde2-5a62-8417-d0b905fac0f8', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc40da641-e0, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc40da641-e0, col_values=(('qos', UUID('310426eb-7ff1-4505-b64c-2ad7d955dfaa')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc40da641-e0, col_values=(('external_ids', {'iface-id': 'c40da641-e0b5-4077-959e-cd325f6475be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:4a:cd', 'vm-uuid': '65977b9a-f812-44b8-b8dc-95c12e2f8a6d'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:18:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:04 user nova-compute[75021]: INFO os_vif [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:4a:cd,bridge_name='br-int',has_traffic_filtering=True,id=c40da641-e0b5-4077-959e-cd325f6475be,network=Network(1392d2f0-29b7-4293-bf52-5e004250332f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40da641-e0')
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] No VIF found with MAC fa:16:3e:70:4a:cd, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Successfully updated port: 17d6b8c2-69b7-43de-b142-6a5015d774ef {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "refresh_cache-1045c42c-85e8-46b9-ad58-124004244545" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquired lock "refresh_cache-1045c42c-85e8-46b9-ad58-124004244545" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-a369cfd3-dbe3-4f3c-89d5-53ffbb18e11a req-a3b96eb3-5b92-45f9-a0e6-49489672aaed service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Received event network-changed-17d6b8c2-69b7-43de-b142-6a5015d774ef {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-a369cfd3-dbe3-4f3c-89d5-53ffbb18e11a req-a3b96eb3-5b92-45f9-a0e6-49489672aaed service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Refreshing instance network info cache due to event network-changed-17d6b8c2-69b7-43de-b142-6a5015d774ef. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a369cfd3-dbe3-4f3c-89d5-53ffbb18e11a req-a3b96eb3-5b92-45f9-a0e6-49489672aaed service nova] Acquiring lock "refresh_cache-1045c42c-85e8-46b9-ad58-124004244545" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.network.neutron [req-c376fa55-35fc-4e22-9f75-ffd7feaf6bba req-dd55ba69-c974-49ff-803c-73c261a2a98a service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Updated VIF entry in instance network info cache for port c40da641-e0b5-4077-959e-cd325f6475be. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.network.neutron [req-c376fa55-35fc-4e22-9f75-ffd7feaf6bba req-dd55ba69-c974-49ff-803c-73c261a2a98a service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Updating instance_info_cache with network_info: [{"id": "c40da641-e0b5-4077-959e-cd325f6475be", "address": "fa:16:3e:70:4a:cd", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40da641-e0", "ovs_interfaceid": "c40da641-e0b5-4077-959e-cd325f6475be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c376fa55-35fc-4e22-9f75-ffd7feaf6bba req-dd55ba69-c974-49ff-803c-73c261a2a98a service nova] Releasing lock "refresh_cache-65977b9a-f812-44b8-b8dc-95c12e2f8a6d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.695s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] <== connect_volume: return (2697ms) {'type': 'block', 'scsi_wwn': '23564323638366335', 'path': '/dev/sdf'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564323638366335', 'path': '/dev/sdf'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.829s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'flavor' on Instance uuid 2696d783-bb1e-4709-9683-c8ad1ffc627f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd7a341-0f38-4103-af4a-9436f8c03ad8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:18:05 user nova-compute[75021]: No targets found.
Dec 06 07:18:05 user nova-compute[75021]: iSNS:
Dec 06 07:18:05 user nova-compute[75021]: No targets found.
Dec 06 07:18:05 user nova-compute[75021]: STATIC:
Dec 06 07:18:05 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19
Dec 06 07:18:05 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:18:05 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:18:05 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8
Dec 06 07:18:05 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:18:05 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:18:05 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:18:05 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:18:05 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:18:05 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c
Dec 06 07:18:05 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:18:05 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:18:05 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc
Dec 06 07:18:05 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:18:05 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:18:05 user nova-compute[75021]: FIRMWARE:
Dec 06 07:18:05 user nova-compute[75021]: No targets found.
Dec 06 07:18:05 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:18:05 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:18:05 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4484dc-83cb-46e1-b0fb-db1255e6208c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:18:05 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:18:05 user nova-compute[75021]:   <source dev="/dev/sdf"/>
Dec 06 07:18:05 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:18:05 user nova-compute[75021]:   <serial>20755113-4e50-4da7-b5af-83bc6d35ad19</serial>
Dec 06 07:18:05 user nova-compute[75021]: </disk>
Dec 06 07:18:05 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10c7b1f-a17c-4f31-bcb4-983bfa0194cb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:18:05 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:18:05 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:18:05 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:18:05 user nova-compute[75021]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 (non-flash)
Dec 06 07:18:05 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:18:05 user nova-compute[75021]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:18:05 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:18:05 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:18:05 user nova-compute[75021]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 (non-flash)
Dec 06 07:18:05 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b4771ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6e3ef1-18a0-4304-9d0b-c7a4071ccf2a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67d592d-6aa8-4a07-9502-c76934f15aff]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67335c5-bcf6-46da-9eba-843229c0a6cb]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Updating instance_info_cache with network_info: [{"id": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "address": "fa:16:3e:b5:01:eb", "network": {"id": "f1e69964-2fda-415d-b583-02725df10e58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1091928512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23503d0dbe8d4fecb75c457a20a5909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6b8c2-69", "ovs_interfaceid": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Releasing lock "refresh_cache-1045c42c-85e8-46b9-ad58-124004244545" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Instance network_info: |[{"id": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "address": "fa:16:3e:b5:01:eb", "network": {"id": "f1e69964-2fda-415d-b583-02725df10e58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1091928512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23503d0dbe8d4fecb75c457a20a5909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6b8c2-69", "ovs_interfaceid": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a369cfd3-dbe3-4f3c-89d5-53ffbb18e11a req-a3b96eb3-5b92-45f9-a0e6-49489672aaed service nova] Acquired lock "refresh_cache-1045c42c-85e8-46b9-ad58-124004244545" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.network.neutron [req-a369cfd3-dbe3-4f3c-89d5-53ffbb18e11a req-a3b96eb3-5b92-45f9-a0e6-49489672aaed service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Refreshing network info cache for port 17d6b8c2-69b7-43de-b142-6a5015d774ef {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Start _get_guest_xml network_info=[{"id": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "address": "fa:16:3e:b5:01:eb", "network": {"id": "f1e69964-2fda-415d-b583-02725df10e58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1091928512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23503d0dbe8d4fecb75c457a20a5909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6b8c2-69", "ovs_interfaceid": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9122efa-db20-4657-a5c8-3bf9c3e25c2e]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:05 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:18:05 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:18:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-195134945',display_name='tempest-TestServerVolumeAttachmentScenario-server-195134945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-195134945',id=39,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+S7w+R1LKvpJUDeB6lUA4IfI1BM6vLADflzcRCHHHLcYhPEbDkakj3hiHUFPfNjqTPRUgmfOU6Do9g+kfgPxWhbpUdzcQrOa7ZMQPr3wfTA3K6dKP7kY9xPOwSHUZAkQ==',key_name='tempest-keypair-640378619',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23503d0dbe8d4fecb75c457a20a5909d',ramdisk_id='',reservation_id='r-pydhi2lb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-414613911',owner_user_name='tempest-TestServerVolumeAttachmentScenario-414613911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40060f0208274a93a4b51d49ea49b0ff',uuid=1045c42c-85e8-46b9-ad58-124004244545,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "address": "fa:16:3e:b5:01:eb", "network": {"id": "f1e69964-2fda-415d-b583-02725df10e58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1091928512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23503d0dbe8d4fecb75c457a20a5909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6b8c2-69", "ovs_interfaceid": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Converting VIF {"id": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "address": "fa:16:3e:b5:01:eb", "network": {"id": "f1e69964-2fda-415d-b583-02725df10e58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1091928512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23503d0dbe8d4fecb75c457a20a5909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6b8c2-69", "ovs_interfaceid": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:01:eb,bridge_name='br-int',has_traffic_filtering=True,id=17d6b8c2-69b7-43de-b142-6a5015d774ef,network=Network(f1e69964-2fda-415d-b583-02725df10e58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6b8c2-69') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.objects.instance [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lazy-loading 'pci_devices' on Instance uuid 1045c42c-85e8-46b9-ad58-124004244545 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cd42ae-3f51-4ece-925e-512de9374d12]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:18:05 user nova-compute[75021]:   <uuid>1045c42c-85e8-46b9-ad58-124004244545</uuid>
Dec 06 07:18:05 user nova-compute[75021]:   <name>instance-00000027</name>
Dec 06 07:18:05 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:18:05 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:18:05 user nova-compute[75021]:   <metadata>
Dec 06 07:18:05 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:18:05 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:18:05 user nova-compute[75021]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-195134945</nova:name>
Dec 06 07:18:05 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:18:05</nova:creationTime>
Dec 06 07:18:05 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:18:05 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:18:05 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:18:05 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:18:05 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:18:05 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:18:05 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:18:05 user nova-compute[75021]:       <nova:owner>
Dec 06 07:18:05 user nova-compute[75021]:         <nova:user uuid="40060f0208274a93a4b51d49ea49b0ff">tempest-TestServerVolumeAttachmentScenario-414613911-project-member</nova:user>
Dec 06 07:18:05 user nova-compute[75021]:         <nova:project uuid="23503d0dbe8d4fecb75c457a20a5909d">tempest-TestServerVolumeAttachmentScenario-414613911</nova:project>
Dec 06 07:18:05 user nova-compute[75021]:       </nova:owner>
Dec 06 07:18:05 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:18:05 user nova-compute[75021]:       <nova:ports>
Dec 06 07:18:05 user nova-compute[75021]:         <nova:port uuid="17d6b8c2-69b7-43de-b142-6a5015d774ef">
Dec 06 07:18:05 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 07:18:05 user nova-compute[75021]:         </nova:port>
Dec 06 07:18:05 user nova-compute[75021]:       </nova:ports>
Dec 06 07:18:05 user nova-compute[75021]:     </nova:instance>
Dec 06 07:18:05 user nova-compute[75021]:   </metadata>
Dec 06 07:18:05 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:18:05 user nova-compute[75021]:     <system>
Dec 06 07:18:05 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:18:05 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:18:05 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:18:05 user nova-compute[75021]:       <entry name="serial">1045c42c-85e8-46b9-ad58-124004244545</entry>
Dec 06 07:18:05 user nova-compute[75021]:       <entry name="uuid">1045c42c-85e8-46b9-ad58-124004244545</entry>
Dec 06 07:18:05 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:18:05 user nova-compute[75021]:     </system>
Dec 06 07:18:05 user nova-compute[75021]:   </sysinfo>
Dec 06 07:18:05 user nova-compute[75021]:   <os>
Dec 06 07:18:05 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:18:05 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:18:05 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:18:05 user nova-compute[75021]:   </os>
Dec 06 07:18:05 user nova-compute[75021]:   <features>
Dec 06 07:18:05 user nova-compute[75021]:     <acpi/>
Dec 06 07:18:05 user nova-compute[75021]:     <apic/>
Dec 06 07:18:05 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:18:05 user nova-compute[75021]:   </features>
Dec 06 07:18:05 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:18:05 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:18:05 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:18:05 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:18:05 user nova-compute[75021]:   </clock>
Dec 06 07:18:05 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:18:05 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:18:05 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:18:05 user nova-compute[75021]:   </cpu>
Dec 06 07:18:05 user nova-compute[75021]:   <devices>
Dec 06 07:18:05 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:18:05 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:18:05 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk"/>
Dec 06 07:18:05 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:18:05 user nova-compute[75021]:     </disk>
Dec 06 07:18:05 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:18:05 user nova-compute[75021]:       <mac address="fa:16:3e:b5:01:eb"/>
Dec 06 07:18:05 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:18:05 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:18:05 user nova-compute[75021]:       <target dev="tap17d6b8c2-69"/>
Dec 06 07:18:05 user nova-compute[75021]:     </interface>
Dec 06 07:18:05 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:18:05 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/console.log" append="off"/>
Dec 06 07:18:05 user nova-compute[75021]:     </serial>
Dec 06 07:18:05 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:18:05 user nova-compute[75021]:     <video>
Dec 06 07:18:05 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:18:05 user nova-compute[75021]:     </video>
Dec 06 07:18:05 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:18:05 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:18:05 user nova-compute[75021]:     </rng>
Dec 06 07:18:05 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:18:05 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:18:05 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:18:05 user nova-compute[75021]:     </memballoon>
Dec 06 07:18:05 user nova-compute[75021]:   </devices>
Dec 06 07:18:05 user nova-compute[75021]: </domain>
Dec 06 07:18:05 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:18:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-195134945',display_name='tempest-TestServerVolumeAttachmentScenario-server-195134945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-195134945',id=39,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+S7w+R1LKvpJUDeB6lUA4IfI1BM6vLADflzcRCHHHLcYhPEbDkakj3hiHUFPfNjqTPRUgmfOU6Do9g+kfgPxWhbpUdzcQrOa7ZMQPr3wfTA3K6dKP7kY9xPOwSHUZAkQ==',key_name='tempest-keypair-640378619',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23503d0dbe8d4fecb75c457a20a5909d',ramdisk_id='',reservation_id='r-pydhi2lb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-414613911',owner_user_name='tempest-TestServerVolumeAttachmentScenario-414613911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40060f0208274a93a4b51d49ea49b0ff',uuid=1045c42c-85e8-46b9-ad58-124004244545,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "address": "fa:16:3e:b5:01:eb", "network": {"id": "f1e69964-2fda-415d-b583-02725df10e58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1091928512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23503d0dbe8d4fecb75c457a20a5909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6b8c2-69", "ovs_interfaceid": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Converting VIF {"id": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "address": "fa:16:3e:b5:01:eb", "network": {"id": "f1e69964-2fda-415d-b583-02725df10e58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1091928512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23503d0dbe8d4fecb75c457a20a5909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6b8c2-69", "ovs_interfaceid": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:01:eb,bridge_name='br-int',has_traffic_filtering=True,id=17d6b8c2-69b7-43de-b142-6a5015d774ef,network=Network(f1e69964-2fda-415d-b583-02725df10e58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6b8c2-69') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_vif [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:01:eb,bridge_name='br-int',has_traffic_filtering=True,id=17d6b8c2-69b7-43de-b142-6a5015d774ef,network=Network(f1e69964-2fda-415d-b583-02725df10e58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6b8c2-69') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '417f117f-7d63-554e-b677-0c681f3b372a', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17d6b8c2-69, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17d6b8c2-69, col_values=(('qos', UUID('723567dc-b40b-4034-83f7-0283261e0237')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17d6b8c2-69, col_values=(('external_ids', {'iface-id': '17d6b8c2-69b7-43de-b142-6a5015d774ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:01:eb', 'vm-uuid': '1045c42c-85e8-46b9-ad58-124004244545'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:05 user nova-compute[75021]: INFO os_vif [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:01:eb,bridge_name='br-int',has_traffic_filtering=True,id=17d6b8c2-69b7-43de-b142-6a5015d774ef,network=Network(f1e69964-2fda-415d-b583-02725df10e58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6b8c2-69')
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[37672b26-9ea5-431f-aa4e-9a8d8134dd7d]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260]
Dec 06 07:18:05 user nova-compute[75021]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260] successful.
Dec 06 07:18:05 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ad394b-92e3-4235-8745-0c978ce07731]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] <== disconnect_volume: return (1281ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Start _get_guest_xml network_info=[{"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '050a4958-c294-405a-abbf-67e33555214e', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvwfnuhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '0dc18c93-5a40-4c98-a6bf-7422e45b245d', 'attached_at': '', 'detached_at': '', 'volume_id': '894f0d86-2788-4a34-83db-84324142d4a8', 'serial': '894f0d86-2788-4a34-83db-84324142d4a8'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.objects.instance [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'numa_topology' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] No VIF found with MAC fa:16:3e:b5:01:eb, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.objects.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Object Instance<0dc18c93-5a40-4c98-a6bf-7422e45b245d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:18:05 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:18:05 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.objects.instance [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:18:05 user nova-compute[75021]: DEBUG nova.objects.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Object Instance<0dc18c93-5a40-4c98-a6bf-7422e45b245d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvwfnuhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:18:06 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:18:06 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:18:06 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f4309f-425c-4a2d-804c-3cb85676eb2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:18:06 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0812b3fa-1ca5-4780-8391-af6026633a35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8] added
Dec 06 07:18:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac77b56-6f3e-4bdb-829f-c249eaed1632]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2d348d-30d8-4607-8bc1-c84c56549f62]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OvwfnuhH {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OvwfnuhH" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8949295a-c0d3-4278-89b3-6a4ce1ab07d3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OvwfnuhH'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[65649f0b-2cb3-4452-8725-14d4b6861b21]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb605f4-dbad-4acd-8cb5-f710b443aba4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:18:06 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:18:06 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:18:06 user nova-compute[75021]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 (non-flash)
Dec 06 07:18:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:18:06 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:18:06 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:18:06 user nova-compute[75021]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 (non-flash)
Dec 06 07:18:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG nova.network.neutron [req-a369cfd3-dbe3-4f3c-89d5-53ffbb18e11a req-a3b96eb3-5b92-45f9-a0e6-49489672aaed service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Updated VIF entry in instance network info cache for port 17d6b8c2-69b7-43de-b142-6a5015d774ef. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG nova.network.neutron [req-a369cfd3-dbe3-4f3c-89d5-53ffbb18e11a req-a3b96eb3-5b92-45f9-a0e6-49489672aaed service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Updating instance_info_cache with network_info: [{"id": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "address": "fa:16:3e:b5:01:eb", "network": {"id": "f1e69964-2fda-415d-b583-02725df10e58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1091928512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23503d0dbe8d4fecb75c457a20a5909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6b8c2-69", "ovs_interfaceid": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a369cfd3-dbe3-4f3c-89d5-53ffbb18e11a req-a3b96eb3-5b92-45f9-a0e6-49489672aaed service nova] Releasing lock "refresh_cache-1045c42c-85e8-46b9-ad58-124004244545" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d61fb61-c1ef-4584-8e8a-8d472ff47ebc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260]
Dec 06 07:18:06 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260] successful.
Dec 06 07:18:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd089a4-2e5e-4d35-8943-d87302112cbe]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9ba432-d68c-4626-af82-514f7328a40e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:18:06 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:18:06 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:18:06 user nova-compute[75021]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 (non-flash)
Dec 06 07:18:06 user nova-compute[75021]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:18:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:18:06 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:18:06 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:18:06 user nova-compute[75021]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 (non-flash)
Dec 06 07:18:06 user nova-compute[75021]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:18:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafc1deb-4ba1-4f1e-97ca-891ccdc605e2]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvwfnuhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:18:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No VIF found with MAC fa:16:3e:88:5a:01, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd820c4a-f36e-43ab-81d1-75fb5273a6b4 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.826s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23138376365636265', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138376365636265', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-964895959',display_name='tempest-AttachVolumeTestJSON-server-964895959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-964895959',id=33,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXnsp33Va88K9HMduz0isu8LdTEYh6ifTevR8F0QY6TmOty18bkV5GKJPhgdUF5uYfbmmBq+t2VYhMvKtNZZK1CejSjAntwpRgpOFPsHdEq6Y3WTe/qlOipA1Kn8ihHeQ==',key_name='tempest-keypair-645111669',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:14:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f0a2ff3d04db4832a990891c79df356c',ramdisk_id='',reservation_id='r-9za7bkf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280062788',owner_user_name='tempest-AttachVolumeTestJSON-280062788-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9947f4c20feb463fb485de2a7d4bbef5',uuid=0dc18c93-5a40-4c98-a6bf-7422e45b245d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converting VIF {"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG nova.objects.instance [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG nova.objects.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Object Instance<0dc18c93-5a40-4c98-a6bf-7422e45b245d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:18:07 user nova-compute[75021]:   <uuid>0dc18c93-5a40-4c98-a6bf-7422e45b245d</uuid>
Dec 06 07:18:07 user nova-compute[75021]:   <name>instance-00000021</name>
Dec 06 07:18:07 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:18:07 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:18:07 user nova-compute[75021]:   <metadata>
Dec 06 07:18:07 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:18:07 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:18:07 user nova-compute[75021]:       <nova:name>tempest-AttachVolumeTestJSON-server-964895959</nova:name>
Dec 06 07:18:07 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:18:05</nova:creationTime>
Dec 06 07:18:07 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:18:07 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:18:07 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:18:07 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:18:07 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:18:07 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:18:07 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:18:07 user nova-compute[75021]:       <nova:owner>
Dec 06 07:18:07 user nova-compute[75021]:         <nova:user uuid="9947f4c20feb463fb485de2a7d4bbef5">tempest-AttachVolumeTestJSON-280062788-project-member</nova:user>
Dec 06 07:18:07 user nova-compute[75021]:         <nova:project uuid="f0a2ff3d04db4832a990891c79df356c">tempest-AttachVolumeTestJSON-280062788</nova:project>
Dec 06 07:18:07 user nova-compute[75021]:       </nova:owner>
Dec 06 07:18:07 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:18:07 user nova-compute[75021]:       <nova:ports>
Dec 06 07:18:07 user nova-compute[75021]:         <nova:port uuid="ac69c289-818f-48bb-a95e-2e72646ef67e">
Dec 06 07:18:07 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 07:18:07 user nova-compute[75021]:         </nova:port>
Dec 06 07:18:07 user nova-compute[75021]:       </nova:ports>
Dec 06 07:18:07 user nova-compute[75021]:     </nova:instance>
Dec 06 07:18:07 user nova-compute[75021]:   </metadata>
Dec 06 07:18:07 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:18:07 user nova-compute[75021]:     <system>
Dec 06 07:18:07 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:18:07 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:18:07 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:18:07 user nova-compute[75021]:       <entry name="serial">0dc18c93-5a40-4c98-a6bf-7422e45b245d</entry>
Dec 06 07:18:07 user nova-compute[75021]:       <entry name="uuid">0dc18c93-5a40-4c98-a6bf-7422e45b245d</entry>
Dec 06 07:18:07 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:18:07 user nova-compute[75021]:     </system>
Dec 06 07:18:07 user nova-compute[75021]:   </sysinfo>
Dec 06 07:18:07 user nova-compute[75021]:   <os>
Dec 06 07:18:07 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:18:07 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:18:07 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:18:07 user nova-compute[75021]:   </os>
Dec 06 07:18:07 user nova-compute[75021]:   <features>
Dec 06 07:18:07 user nova-compute[75021]:     <acpi/>
Dec 06 07:18:07 user nova-compute[75021]:     <apic/>
Dec 06 07:18:07 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:18:07 user nova-compute[75021]:   </features>
Dec 06 07:18:07 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:18:07 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:18:07 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:18:07 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:18:07 user nova-compute[75021]:   </clock>
Dec 06 07:18:07 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:18:07 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:18:07 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:18:07 user nova-compute[75021]:   </cpu>
Dec 06 07:18:07 user nova-compute[75021]:   <devices>
Dec 06 07:18:07 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:18:07 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:18:07 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk"/>
Dec 06 07:18:07 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:18:07 user nova-compute[75021]:     </disk>
Dec 06 07:18:07 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:18:07 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:18:07 user nova-compute[75021]:       <source dev="/dev/sdb"/>
Dec 06 07:18:07 user nova-compute[75021]:       <target dev="vdb" bus="virtio"/>
Dec 06 07:18:07 user nova-compute[75021]:       <serial>894f0d86-2788-4a34-83db-84324142d4a8</serial>
Dec 06 07:18:07 user nova-compute[75021]:     </disk>
Dec 06 07:18:07 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:18:07 user nova-compute[75021]:       <mac address="fa:16:3e:4f:e9:89"/>
Dec 06 07:18:07 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:18:07 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:18:07 user nova-compute[75021]:       <target dev="tapac69c289-81"/>
Dec 06 07:18:07 user nova-compute[75021]:     </interface>
Dec 06 07:18:07 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:18:07 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/console.log" append="off"/>
Dec 06 07:18:07 user nova-compute[75021]:     </serial>
Dec 06 07:18:07 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:18:07 user nova-compute[75021]:     <video>
Dec 06 07:18:07 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:18:07 user nova-compute[75021]:     </video>
Dec 06 07:18:07 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:18:07 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:18:07 user nova-compute[75021]:     </rng>
Dec 06 07:18:07 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:18:07 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:18:07 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:18:07 user nova-compute[75021]:     </memballoon>
Dec 06 07:18:07 user nova-compute[75021]:   </devices>
Dec 06 07:18:07 user nova-compute[75021]: </domain>
Dec 06 07:18:07 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:18:07 user nova-compute[75021]: DEBUG nova.objects.instance [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG nova.objects.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Object Instance<0dc18c93-5a40-4c98-a6bf-7422e45b245d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.279s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-2064543f-31f6-4602-af3a-050d5a3b45f6 req-8c7bf47e-917c-4d12-9870-78462a363e95 service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Received event network-vif-plugged-c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2064543f-31f6-4602-af3a-050d5a3b45f6 req-8c7bf47e-917c-4d12-9870-78462a363e95 service nova] Acquiring lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2064543f-31f6-4602-af3a-050d5a3b45f6 req-8c7bf47e-917c-4d12-9870-78462a363e95 service nova] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2064543f-31f6-4602-af3a-050d5a3b45f6 req-8c7bf47e-917c-4d12-9870-78462a363e95 service nova] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-2064543f-31f6-4602-af3a-050d5a3b45f6 req-8c7bf47e-917c-4d12-9870-78462a363e95 service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] No waiting events found dispatching network-vif-plugged-c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:18:08 user nova-compute[75021]: WARNING nova.compute.manager [req-2064543f-31f6-4602-af3a-050d5a3b45f6 req-8c7bf47e-917c-4d12-9870-78462a363e95 service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Received unexpected event network-vif-plugged-c40da641-e0b5-4077-959e-cd325f6475be for instance with vm_state building and task_state spawning.
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "2696d783-bb1e-4709-9683-c8ad1ffc627f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:08 user nova-compute[75021]: INFO nova.compute.manager [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Detaching volume 20755113-4e50-4da7-b5af-83bc6d35ad19
Dec 06 07:18:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Cannot resize image /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG nova.objects.instance [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'migration_context' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG nova.objects.base [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Object Instance<0dc18c93-5a40-4c98-a6bf-7422e45b245d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-964895959',display_name='tempest-AttachVolumeTestJSON-server-964895959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-964895959',id=33,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXnsp33Va88K9HMduz0isu8LdTEYh6ifTevR8F0QY6TmOty18bkV5GKJPhgdUF5uYfbmmBq+t2VYhMvKtNZZK1CejSjAntwpRgpOFPsHdEq6Y3WTe/qlOipA1Kn8ihHeQ==',key_name='tempest-keypair-645111669',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:14:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f0a2ff3d04db4832a990891c79df356c',ramdisk_id='',reservation_id='r-9za7bkf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280062788',owner_user_name='tempest-AttachVolumeTestJSON-280062788-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9947f4c20feb463fb485de2a7d4bbef5',uuid=0dc18c93-5a40-4c98-a6bf-7422e45b245d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converting VIF {"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG os_vif [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4ed3d22-b952-5c98-80b7-3eb177e4b1bb', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac69c289-81, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac69c289-81, col_values=(('qos', UUID('ea6285b1-12b1-4198-8498-971f0f18edd7')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac69c289-81, col_values=(('external_ids', {'iface-id': 'ac69c289-818f-48bb-a95e-2e72646ef67e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:e9:89', 'vm-uuid': '0dc18c93-5a40-4c98-a6bf-7422e45b245d'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:18:08 user nova-compute[75021]: INFO nova.virt.block_device [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Attempting to driver detach volume 20755113-4e50-4da7-b5af-83bc6d35ad19 from mountpoint /dev/vdb
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:08 user nova-compute[75021]: INFO os_vif [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81')
Dec 06 07:18:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Attempting to detach device vdb from instance 2696d783-bb1e-4709-9683-c8ad1ffc627f from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:18:08 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:18:08 user nova-compute[75021]:   <source dev="/dev/sdf"/>
Dec 06 07:18:08 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:18:08 user nova-compute[75021]:   <serial>20755113-4e50-4da7-b5af-83bc6d35ad19</serial>
Dec 06 07:18:08 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:18:08 user nova-compute[75021]: </disk>
Dec 06 07:18:08 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:18:08 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Successfully detached device vdb from instance 2696d783-bb1e-4709-9683-c8ad1ffc627f from the persistent domain config.
Dec 06 07:18:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2696d783-bb1e-4709-9683-c8ad1ffc627f from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:18:08 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:18:08 user nova-compute[75021]:   <source dev="/dev/sdf"/>
Dec 06 07:18:08 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:18:08 user nova-compute[75021]:   <serial>20755113-4e50-4da7-b5af-83bc6d35ad19</serial>
Dec 06 07:18:08 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:18:08 user nova-compute[75021]: </disk>
Dec 06 07:18:08 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2696d783-bb1e-4709-9683-c8ad1ffc627f {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Received event network-vif-plugged-c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] Acquiring lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] No waiting events found dispatching network-vif-plugged-c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:18:10 user nova-compute[75021]: WARNING nova.compute.manager [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Received unexpected event network-vif-plugged-c40da641-e0b5-4077-959e-cd325f6475be for instance with vm_state building and task_state spawning.
Dec 06 07:18:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Received event network-vif-plugged-17d6b8c2-69b7-43de-b142-6a5015d774ef {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] Acquiring lock "1045c42c-85e8-46b9-ad58-124004244545-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] Lock "1045c42c-85e8-46b9-ad58-124004244545-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] Lock "1045c42c-85e8-46b9-ad58-124004244545-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] No waiting events found dispatching network-vif-plugged-17d6b8c2-69b7-43de-b142-6a5015d774ef {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:18:10 user nova-compute[75021]: WARNING nova.compute.manager [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Received unexpected event network-vif-plugged-17d6b8c2-69b7-43de-b142-6a5015d774ef for instance with vm_state building and task_state spawning.
Dec 06 07:18:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Received event network-vif-plugged-17d6b8c2-69b7-43de-b142-6a5015d774ef {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] Acquiring lock "1045c42c-85e8-46b9-ad58-124004244545-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] Lock "1045c42c-85e8-46b9-ad58-124004244545-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] Lock "1045c42c-85e8-46b9-ad58-124004244545-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:10 user nova-compute[75021]: DEBUG nova.compute.manager [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] No waiting events found dispatching network-vif-plugged-17d6b8c2-69b7-43de-b142-6a5015d774ef {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:18:10 user nova-compute[75021]: WARNING nova.compute.manager [req-2fa65094-dda7-4507-92f8-9c806200e9fe req-cdc6c645-edbb-40df-8919-e805acde1cef service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Received unexpected event network-vif-plugged-17d6b8c2-69b7-43de-b142-6a5015d774ef for instance with vm_state building and task_state spawning.
Dec 06 07:18:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-3b702b88-a42b-4168-b3d1-68b5d4f42f99 req-206b3e0f-a57d-4bbf-8bda-95f5a69fa2a1 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:18:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3b702b88-a42b-4168-b3d1-68b5d4f42f99 req-206b3e0f-a57d-4bbf-8bda-95f5a69fa2a1 service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3b702b88-a42b-4168-b3d1-68b5d4f42f99 req-206b3e0f-a57d-4bbf-8bda-95f5a69fa2a1 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3b702b88-a42b-4168-b3d1-68b5d4f42f99 req-206b3e0f-a57d-4bbf-8bda-95f5a69fa2a1 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-3b702b88-a42b-4168-b3d1-68b5d4f42f99 req-206b3e0f-a57d-4bbf-8bda-95f5a69fa2a1 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:18:11 user nova-compute[75021]: WARNING nova.compute.manager [req-3b702b88-a42b-4168-b3d1-68b5d4f42f99 req-206b3e0f-a57d-4bbf-8bda-95f5a69fa2a1 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received unexpected event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with vm_state stopped and task_state powering-on.
Dec 06 07:18:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:18:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:18:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:18:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/disk.rescue --force-share --output=json" returned: 0 in 0.287s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:18:13 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Instance spawned successfully.
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:18:13 user nova-compute[75021]: INFO nova.compute.manager [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Took 11.51 seconds to spawn the instance on the hypervisor.
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-7d79cac5-bca8-4e03-9d5a-8cb13146a873 req-b6b7135d-44b4-4c33-9d9e-b6e3e68a18fb service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7d79cac5-bca8-4e03-9d5a-8cb13146a873 req-b6b7135d-44b4-4c33-9d9e-b6e3e68a18fb service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7d79cac5-bca8-4e03-9d5a-8cb13146a873 req-b6b7135d-44b4-4c33-9d9e-b6e3e68a18fb service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7d79cac5-bca8-4e03-9d5a-8cb13146a873 req-b6b7135d-44b4-4c33-9d9e-b6e3e68a18fb service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-7d79cac5-bca8-4e03-9d5a-8cb13146a873 req-b6b7135d-44b4-4c33-9d9e-b6e3e68a18fb service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:18:13 user nova-compute[75021]: WARNING nova.compute.manager [req-7d79cac5-bca8-4e03-9d5a-8cb13146a873 req-b6b7135d-44b4-4c33-9d9e-b6e3e68a18fb service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received unexpected event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with vm_state stopped and task_state powering-on.
Dec 06 07:18:13 user nova-compute[75021]: INFO nova.compute.manager [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Took 12.65 seconds to build instance.
Dec 06 07:18:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f53be85f-fbd9-471e-9c5f-be35297edfc0 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.784s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:18:13 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Instance spawned successfully.
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:13 user nova-compute[75021]: INFO nova.compute.manager [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Took 10.24 seconds to spawn the instance on the hypervisor.
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:18:13 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Instance rebooted successfully.
Dec 06 07:18:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-cb9f9fe8-d8b0-46bf-8d16-883c2ccfe99a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:14 user nova-compute[75021]: INFO nova.compute.manager [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Took 12.72 seconds to build instance.
Dec 06 07:18:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a613bc72-5cf5-4206-aff1-9503cad0750d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.856s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:18:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:16 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:18:16 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:18:16 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7866MB free_disk=24.920032501220703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:18:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Applying migration context for instance a31eae43-b01c-46cf-9c06-13e9242b5fe1 as it has an incoming, in-progress migration e03bb2de-3fdd-4e74-a159-853ceff47a16. Migration status is finished {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 06 07:18:17 user nova-compute[75021]: INFO nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Updating resource usage from migration e03bb2de-3fdd-4e74-a159-853ceff47a16
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 58ef39ae-4b66-42e6-ae22-5308a98eb55d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 92c63579-741c-4daa-9568-f7ddf95e3729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2696d783-bb1e-4709-9683-c8ad1ffc627f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2064385e-a37f-468e-bed6-129eb54295ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Migration e03bb2de-3fdd-4e74-a159-853ceff47a16 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1712}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a31eae43-b01c-46cf-9c06-13e9242b5fe1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 65977b9a-f812-44b8-b8dc-95c12e2f8a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 1045c42c-85e8-46b9-ad58-124004244545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:18:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.777s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:18 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:18:18 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:18:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:18:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-58ef39ae-4b66-42e6-ae22-5308a98eb55d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:18:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-58ef39ae-4b66-42e6-ae22-5308a98eb55d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:18:19 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:18:19 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Updating instance_info_cache with network_info: [{"id": "8d305221-2e91-46cc-99d8-428d63a55a80", "address": "fa:16:3e:e3:57:1d", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d305221-2e", "ovs_interfaceid": "8d305221-2e91-46cc-99d8-428d63a55a80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:18:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-58ef39ae-4b66-42e6-ae22-5308a98eb55d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:18:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:18:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:18:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:18:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:18:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:18:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:18:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:30 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2696d783-bb1e-4709-9683-c8ad1ffc627f is timed out.
Dec 06 07:18:30 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Successfully detached device vdb from instance 2696d783-bb1e-4709-9683-c8ad1ffc627f from the live domain config.
Dec 06 07:18:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YUpHhLSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:18:30 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[324f82c6-9107-4cf4-a05a-ddd7623cd6af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:18:30 user nova-compute[75021]: No targets found.
Dec 06 07:18:30 user nova-compute[75021]: iSNS:
Dec 06 07:18:30 user nova-compute[75021]: No targets found.
Dec 06 07:18:30 user nova-compute[75021]: STATIC:
Dec 06 07:18:30 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19
Dec 06 07:18:30 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:18:30 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:18:30 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8
Dec 06 07:18:30 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:18:30 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:18:30 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:18:30 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:18:30 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:18:30 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c
Dec 06 07:18:30 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:18:30 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:18:30 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc
Dec 06 07:18:30 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:18:30 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:18:30 user nova-compute[75021]: FIRMWARE:
Dec 06 07:18:30 user nova-compute[75021]: No targets found.
Dec 06 07:18:30 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:18:30 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:18:30 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b62233-68c1-4bb4-a601-16d02b05c0f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b98b7f-1070-41e1-a2ff-123ef8bd0633]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:18:30 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:18:30 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:18:30 user nova-compute[75021]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 (non-flash)
Dec 06 07:18:30 user nova-compute[75021]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:18:30 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:18:30 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:18:30 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:18:30 user nova-compute[75021]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 (non-flash)
Dec 06 07:18:30 user nova-compute[75021]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:18:30 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b46297e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19'): ({'sdf'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Removing single pathed devices sdf {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff78942-9def-4dfc-9884-987f936e3db2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f2e587-254f-4342-84c8-0d489c64b07c]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Flushing IO for device /dev/sdf {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a660085-e5e4-471b-96d7-6e516888fca9]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.059s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ac63fd-70e9-42fe-80b3-0b72fb70a365]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaa0b25-de21-4370-9cb9-0f3cbc79c017]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c48df5-f13a-42db-be48-3d18bde83a0c]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19, portal: 172.16.0.220,3260]
Dec 06 07:18:30 user nova-compute[75021]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19, portal: 172.16.0.220,3260] successful.
Dec 06 07:18:30 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20755113-4e50-4da7-b5af-83bc6d35ad19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa6e0d8-647a-41de-8cb7-b1bcbad50c65]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] <== disconnect_volume: return (360ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:18:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:18:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:34 user nova-compute[75021]: DEBUG nova.objects.instance [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'flavor' on Instance uuid 2696d783-bb1e-4709-9683-c8ad1ffc627f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:18:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-112233d6-b27f-44a5-9b76-db6fe81dbe20 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.681s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:52 user nova-compute[75021]: DEBUG nova.compute.manager [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Going to confirm migration 2 {{(pid=75021) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Dec 06 07:18:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:18:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquired lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:18:52 user nova-compute[75021]: DEBUG nova.network.neutron [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:18:52 user nova-compute[75021]: DEBUG nova.objects.instance [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lazy-loading 'info_cache' on Instance uuid a31eae43-b01c-46cf-9c06-13e9242b5fe1 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:18:52 user nova-compute[75021]: DEBUG nova.network.neutron [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Updating instance_info_cache with network_info: [{"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:18:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Releasing lock "refresh_cache-a31eae43-b01c-46cf-9c06-13e9242b5fe1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:18:52 user nova-compute[75021]: DEBUG nova.objects.instance [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lazy-loading 'migration_context' on Instance uuid a31eae43-b01c-46cf-9c06-13e9242b5fe1 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:18:52 user nova-compute[75021]: DEBUG nova.objects.base [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Object Instance<a31eae43-b01c-46cf-9c06-13e9242b5fe1> lazy-loaded attributes: info_cache,migration_context {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:18:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:53 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:18:53 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:18:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.414s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:53 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Deleted allocation for migration e03bb2de-3fdd-4e74-a159-853ceff47a16
Dec 06 07:18:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-5561742a-6f63-4b05-b3ff-b21c1755af2a tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.277s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:18:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:18:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:18:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:18:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "2696d783-bb1e-4709-9683-c8ad1ffc627f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "2696d783-bb1e-4709-9683-c8ad1ffc627f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:58 user nova-compute[75021]: INFO nova.compute.manager [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Terminating instance
Dec 06 07:18:58 user nova-compute[75021]: DEBUG nova.compute.manager [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:18:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG nova.compute.manager [req-5336779f-2007-4bc0-ac82-98a10921762c req-ef6fc429-e55f-4112-a015-afe50024b672 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Received event network-vif-unplugged-27433f1d-9497-4e66-8303-57382337858b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5336779f-2007-4bc0-ac82-98a10921762c req-ef6fc429-e55f-4112-a015-afe50024b672 service nova] Acquiring lock "2696d783-bb1e-4709-9683-c8ad1ffc627f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5336779f-2007-4bc0-ac82-98a10921762c req-ef6fc429-e55f-4112-a015-afe50024b672 service nova] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5336779f-2007-4bc0-ac82-98a10921762c req-ef6fc429-e55f-4112-a015-afe50024b672 service nova] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG nova.compute.manager [req-5336779f-2007-4bc0-ac82-98a10921762c req-ef6fc429-e55f-4112-a015-afe50024b672 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] No waiting events found dispatching network-vif-unplugged-27433f1d-9497-4e66-8303-57382337858b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG nova.compute.manager [req-5336779f-2007-4bc0-ac82-98a10921762c req-ef6fc429-e55f-4112-a015-afe50024b672 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Received event network-vif-unplugged-27433f1d-9497-4e66-8303-57382337858b for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:59 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Instance destroyed successfully.
Dec 06 07:18:59 user nova-compute[75021]: DEBUG nova.objects.instance [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'resources' on Instance uuid 2696d783-bb1e-4709-9683-c8ad1ffc627f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1634997589',display_name='tempest-AttachVolumeNegativeTest-server-1634997589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1634997589',id=36,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9e4V3nlf8sH5b/RhgHKYvcpls42DkvshkjSLuywJkvLpIsyIsMYhSc22mwBYhF8RtvBtFcIPB86AAY6M+acFNG//GF2CYwCR71xi0XRMFexZMeWL1G1SV44TafftB+5Q==',key_name='tempest-keypair-393715469',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:15:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae65045cef754813bd33f68b9868dc9d',ramdisk_id='',reservation_id='r-183i0u7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-967416759',owner_user_name='tempest-AttachVolumeNegativeTest-967416759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:15:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e1155d2c304bdd8404712faf046b05',uuid=2696d783-bb1e-4709-9683-c8ad1ffc627f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27433f1d-9497-4e66-8303-57382337858b", "address": "fa:16:3e:88:5a:01", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27433f1d-94", "ovs_interfaceid": "27433f1d-9497-4e66-8303-57382337858b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converting VIF {"id": "27433f1d-9497-4e66-8303-57382337858b", "address": "fa:16:3e:88:5a:01", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27433f1d-94", "ovs_interfaceid": "27433f1d-9497-4e66-8303-57382337858b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:5a:01,bridge_name='br-int',has_traffic_filtering=True,id=27433f1d-9497-4e66-8303-57382337858b,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27433f1d-94') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG os_vif [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:5a:01,bridge_name='br-int',has_traffic_filtering=True,id=27433f1d-9497-4e66-8303-57382337858b,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27433f1d-94') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27433f1d-94, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1c9d1aa-8905-414d-9e66-4523ab042b9d) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:18:59 user nova-compute[75021]: INFO os_vif [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:5a:01,bridge_name='br-int',has_traffic_filtering=True,id=27433f1d-9497-4e66-8303-57382337858b,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27433f1d-94')
Dec 06 07:18:59 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Deleting instance files /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f_del
Dec 06 07:18:59 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Deletion of /opt/stack/data/nova/instances/2696d783-bb1e-4709-9683-c8ad1ffc627f_del complete
Dec 06 07:18:59 user nova-compute[75021]: INFO nova.compute.manager [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Took 0.86 seconds to destroy the instance on the hypervisor.
Dec 06 07:18:59 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:18:59 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:19:00 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:19:00 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Took 0.58 seconds to deallocate network for instance.
Dec 06 07:19:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-e2f2248c-22de-42ca-9dd2-8846a6469ea8 req-a158201d-6db6-4c2c-a028-8af4f79bb383 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Received event network-vif-deleted-27433f1d-9497-4e66-8303-57382337858b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:19:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:00 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:19:00 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:19:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:00 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Deleted allocations for instance 2696d783-bb1e-4709-9683-c8ad1ffc627f
Dec 06 07:19:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-2e2b5eef-d820-4638-abf5-662ba1c9231d tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.021s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-58e298c8-2851-4439-b102-ecf38235dede req-647c8d91-9104-4e5c-b0f9-456c6891b2b0 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Received event network-vif-plugged-27433f1d-9497-4e66-8303-57382337858b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:19:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-58e298c8-2851-4439-b102-ecf38235dede req-647c8d91-9104-4e5c-b0f9-456c6891b2b0 service nova] Acquiring lock "2696d783-bb1e-4709-9683-c8ad1ffc627f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-58e298c8-2851-4439-b102-ecf38235dede req-647c8d91-9104-4e5c-b0f9-456c6891b2b0 service nova] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-58e298c8-2851-4439-b102-ecf38235dede req-647c8d91-9104-4e5c-b0f9-456c6891b2b0 service nova] Lock "2696d783-bb1e-4709-9683-c8ad1ffc627f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-58e298c8-2851-4439-b102-ecf38235dede req-647c8d91-9104-4e5c-b0f9-456c6891b2b0 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] No waiting events found dispatching network-vif-plugged-27433f1d-9497-4e66-8303-57382337858b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:19:01 user nova-compute[75021]: WARNING nova.compute.manager [req-58e298c8-2851-4439-b102-ecf38235dede req-647c8d91-9104-4e5c-b0f9-456c6891b2b0 service nova] [instance: 2696d783-bb1e-4709-9683-c8ad1ffc627f] Received unexpected event network-vif-plugged-27433f1d-9497-4e66-8303-57382337858b for instance with vm_state deleted and task_state None.
Dec 06 07:19:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:19:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:19:11 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:19:11 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:19:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:11 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:19:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:19:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:19:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:19:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:19:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:14 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:19:14 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:19:14 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7701MB free_disk=24.91421890258789GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 58ef39ae-4b66-42e6-ae22-5308a98eb55d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 92c63579-741c-4daa-9568-f7ddf95e3729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2064385e-a37f-468e-bed6-129eb54295ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a31eae43-b01c-46cf-9c06-13e9242b5fe1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 65977b9a-f812-44b8-b8dc-95c12e2f8a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 1045c42c-85e8-46b9-ad58-124004244545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:19:14 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:19:15 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:19:15 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:19:15 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:19:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:16 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:19:16 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:19:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:19:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:19:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:19:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:19:16 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:19:16 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid cd198206-4476-4b87-8399-dd5cb38fd3b1 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:19:16 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Updating instance_info_cache with network_info: [{"id": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "address": "fa:16:3e:b7:f2:e4", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f43de0b-bf", "ovs_interfaceid": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:19:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-cd198206-4476-4b87-8399-dd5cb38fd3b1" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:19:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:19:16 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:19:16 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:19:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:19:17 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:19:18 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:19:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:22 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:19:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:43 user nova-compute[75021]: INFO nova.compute.manager [None req-a869cbd2-87d0-4048-bf5d-3bcadf91c0fb tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Unrescuing
Dec 06 07:19:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a869cbd2-87d0-4048-bf5d-3bcadf91c0fb tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "refresh_cache-2064385e-a37f-468e-bed6-129eb54295ae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:19:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a869cbd2-87d0-4048-bf5d-3bcadf91c0fb tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquired lock "refresh_cache-2064385e-a37f-468e-bed6-129eb54295ae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:19:43 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a869cbd2-87d0-4048-bf5d-3bcadf91c0fb tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:19:44 user nova-compute[75021]: DEBUG nova.network.neutron [None req-a869cbd2-87d0-4048-bf5d-3bcadf91c0fb tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Updating instance_info_cache with network_info: [{"id": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "address": "fa:16:3e:d4:2a:27", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f8ce24-a9", "ovs_interfaceid": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:19:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-a869cbd2-87d0-4048-bf5d-3bcadf91c0fb tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Releasing lock "refresh_cache-2064385e-a37f-468e-bed6-129eb54295ae" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:19:44 user nova-compute[75021]: DEBUG nova.objects.instance [None req-a869cbd2-87d0-4048-bf5d-3bcadf91c0fb tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'flavor' on Instance uuid 2064385e-a37f-468e-bed6-129eb54295ae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:19:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-3a9acf24-62a0-41c5-99cd-6d88a55cc2df req-16ba2e2d-b3ce-4bc2-9311-d4be8d807560 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received event network-vif-unplugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:19:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3a9acf24-62a0-41c5-99cd-6d88a55cc2df req-16ba2e2d-b3ce-4bc2-9311-d4be8d807560 service nova] Acquiring lock "2064385e-a37f-468e-bed6-129eb54295ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3a9acf24-62a0-41c5-99cd-6d88a55cc2df req-16ba2e2d-b3ce-4bc2-9311-d4be8d807560 service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3a9acf24-62a0-41c5-99cd-6d88a55cc2df req-16ba2e2d-b3ce-4bc2-9311-d4be8d807560 service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-3a9acf24-62a0-41c5-99cd-6d88a55cc2df req-16ba2e2d-b3ce-4bc2-9311-d4be8d807560 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] No waiting events found dispatching network-vif-unplugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:19:44 user nova-compute[75021]: WARNING nova.compute.manager [req-3a9acf24-62a0-41c5-99cd-6d88a55cc2df req-16ba2e2d-b3ce-4bc2-9311-d4be8d807560 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received unexpected event network-vif-unplugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:19:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:44 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Instance destroyed successfully.
Dec 06 07:19:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-703fe109-169a-442e-874b-fb40847160cb req-b278817c-0724-42be-bb31-053fac82f0cf service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:19:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-703fe109-169a-442e-874b-fb40847160cb req-b278817c-0724-42be-bb31-053fac82f0cf service nova] Acquiring lock "2064385e-a37f-468e-bed6-129eb54295ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-703fe109-169a-442e-874b-fb40847160cb req-b278817c-0724-42be-bb31-053fac82f0cf service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-703fe109-169a-442e-874b-fb40847160cb req-b278817c-0724-42be-bb31-053fac82f0cf service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-703fe109-169a-442e-874b-fb40847160cb req-b278817c-0724-42be-bb31-053fac82f0cf service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] No waiting events found dispatching network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:19:46 user nova-compute[75021]: WARNING nova.compute.manager [req-703fe109-169a-442e-874b-fb40847160cb req-b278817c-0724-42be-bb31-053fac82f0cf service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received unexpected event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:19:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-703fe109-169a-442e-874b-fb40847160cb req-b278817c-0724-42be-bb31-053fac82f0cf service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:19:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-703fe109-169a-442e-874b-fb40847160cb req-b278817c-0724-42be-bb31-053fac82f0cf service nova] Acquiring lock "2064385e-a37f-468e-bed6-129eb54295ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-703fe109-169a-442e-874b-fb40847160cb req-b278817c-0724-42be-bb31-053fac82f0cf service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-703fe109-169a-442e-874b-fb40847160cb req-b278817c-0724-42be-bb31-053fac82f0cf service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-703fe109-169a-442e-874b-fb40847160cb req-b278817c-0724-42be-bb31-053fac82f0cf service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] No waiting events found dispatching network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:19:46 user nova-compute[75021]: WARNING nova.compute.manager [req-703fe109-169a-442e-874b-fb40847160cb req-b278817c-0724-42be-bb31-053fac82f0cf service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received unexpected event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:19:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:48 user nova-compute[75021]: DEBUG nova.compute.manager [None req-a869cbd2-87d0-4048-bf5d-3bcadf91c0fb tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:19:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-bb15cb4e-2d1a-40e9-9ec3-a4e43a2d4383 req-53d926a9-347a-4802-b6c7-bc35d399d9e2 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:19:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bb15cb4e-2d1a-40e9-9ec3-a4e43a2d4383 req-53d926a9-347a-4802-b6c7-bc35d399d9e2 service nova] Acquiring lock "2064385e-a37f-468e-bed6-129eb54295ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bb15cb4e-2d1a-40e9-9ec3-a4e43a2d4383 req-53d926a9-347a-4802-b6c7-bc35d399d9e2 service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bb15cb4e-2d1a-40e9-9ec3-a4e43a2d4383 req-53d926a9-347a-4802-b6c7-bc35d399d9e2 service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:48 user nova-compute[75021]: DEBUG nova.compute.manager [req-bb15cb4e-2d1a-40e9-9ec3-a4e43a2d4383 req-53d926a9-347a-4802-b6c7-bc35d399d9e2 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] No waiting events found dispatching network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:19:48 user nova-compute[75021]: WARNING nova.compute.manager [req-bb15cb4e-2d1a-40e9-9ec3-a4e43a2d4383 req-53d926a9-347a-4802-b6c7-bc35d399d9e2 service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received unexpected event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 for instance with vm_state active and task_state None.
Dec 06 07:19:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-961dfd8e-2bde-4421-9085-222acc22ee29 req-6517f82f-ecac-435e-b590-f5a891e05cd9 service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Received event network-changed-17d6b8c2-69b7-43de-b142-6a5015d774ef {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:19:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-961dfd8e-2bde-4421-9085-222acc22ee29 req-6517f82f-ecac-435e-b590-f5a891e05cd9 service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Refreshing instance network info cache due to event network-changed-17d6b8c2-69b7-43de-b142-6a5015d774ef. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:19:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-961dfd8e-2bde-4421-9085-222acc22ee29 req-6517f82f-ecac-435e-b590-f5a891e05cd9 service nova] Acquiring lock "refresh_cache-1045c42c-85e8-46b9-ad58-124004244545" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:19:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-961dfd8e-2bde-4421-9085-222acc22ee29 req-6517f82f-ecac-435e-b590-f5a891e05cd9 service nova] Acquired lock "refresh_cache-1045c42c-85e8-46b9-ad58-124004244545" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:19:52 user nova-compute[75021]: DEBUG nova.network.neutron [req-961dfd8e-2bde-4421-9085-222acc22ee29 req-6517f82f-ecac-435e-b590-f5a891e05cd9 service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Refreshing network info cache for port 17d6b8c2-69b7-43de-b142-6a5015d774ef {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:19:52 user nova-compute[75021]: DEBUG nova.network.neutron [req-961dfd8e-2bde-4421-9085-222acc22ee29 req-6517f82f-ecac-435e-b590-f5a891e05cd9 service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Updated VIF entry in instance network info cache for port 17d6b8c2-69b7-43de-b142-6a5015d774ef. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:19:52 user nova-compute[75021]: DEBUG nova.network.neutron [req-961dfd8e-2bde-4421-9085-222acc22ee29 req-6517f82f-ecac-435e-b590-f5a891e05cd9 service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Updating instance_info_cache with network_info: [{"id": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "address": "fa:16:3e:b5:01:eb", "network": {"id": "f1e69964-2fda-415d-b583-02725df10e58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1091928512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23503d0dbe8d4fecb75c457a20a5909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6b8c2-69", "ovs_interfaceid": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:19:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-961dfd8e-2bde-4421-9085-222acc22ee29 req-6517f82f-ecac-435e-b590-f5a891e05cd9 service nova] Releasing lock "refresh_cache-1045c42c-85e8-46b9-ad58-124004244545" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-11be6d14-01dd-4bca-82b3-3a92caf1a79f req-5c21d098-357d-4644-ad38-1f90899a02b6 service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Received event network-changed-c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG nova.compute.manager [req-11be6d14-01dd-4bca-82b3-3a92caf1a79f req-5c21d098-357d-4644-ad38-1f90899a02b6 service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Refreshing instance network info cache due to event network-changed-c40da641-e0b5-4077-959e-cd325f6475be. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-11be6d14-01dd-4bca-82b3-3a92caf1a79f req-5c21d098-357d-4644-ad38-1f90899a02b6 service nova] Acquiring lock "refresh_cache-65977b9a-f812-44b8-b8dc-95c12e2f8a6d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-11be6d14-01dd-4bca-82b3-3a92caf1a79f req-5c21d098-357d-4644-ad38-1f90899a02b6 service nova] Acquired lock "refresh_cache-65977b9a-f812-44b8-b8dc-95c12e2f8a6d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG nova.network.neutron [req-11be6d14-01dd-4bca-82b3-3a92caf1a79f req-5c21d098-357d-4644-ad38-1f90899a02b6 service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Refreshing network info cache for port c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "17638711-6771-4b89-b0d0-231eeb1a9080" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "17638711-6771-4b89-b0d0-231eeb1a9080" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:19:53 user nova-compute[75021]: INFO nova.compute.claims [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Claim successful on node user
Dec 06 07:19:53 user nova-compute[75021]: DEBUG nova.network.neutron [req-11be6d14-01dd-4bca-82b3-3a92caf1a79f req-5c21d098-357d-4644-ad38-1f90899a02b6 service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Updated VIF entry in instance network info cache for port c40da641-e0b5-4077-959e-cd325f6475be. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG nova.network.neutron [req-11be6d14-01dd-4bca-82b3-3a92caf1a79f req-5c21d098-357d-4644-ad38-1f90899a02b6 service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Updating instance_info_cache with network_info: [{"id": "c40da641-e0b5-4077-959e-cd325f6475be", "address": "fa:16:3e:70:4a:cd", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40da641-e0", "ovs_interfaceid": "c40da641-e0b5-4077-959e-cd325f6475be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-11be6d14-01dd-4bca-82b3-3a92caf1a79f req-5c21d098-357d-4644-ad38-1f90899a02b6 service nova] Releasing lock "refresh_cache-65977b9a-f812-44b8-b8dc-95c12e2f8a6d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG nova.objects.instance [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lazy-loading 'flavor' on Instance uuid 65977b9a-f812-44b8-b8dc-95c12e2f8a6d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG nova.network.neutron [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:19:53 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:53 user nova-compute[75021]: INFO nova.compute.manager [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Attaching volume 906aed19-353c-4281-97b4-3257a923c241 to /dev/vdb
Dec 06 07:19:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG nova.policy [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5e1155d2c304bdd8404712faf046b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae65045cef754813bd33f68b9868dc9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG os_brick.utils [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b5d4a6-b040-4a07-b49c-c537756fe0e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9217584a-bfa2-4ef4-bd6f-5adaeade7e42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[49384dd7-caf8-4348-a8c5-e28fb67604fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:19:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baa78e0-91d6-4a4a-9e1d-48ac25633f20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:19:54 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Creating image(s)
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "/opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "/opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "/opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:19:54 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[027c4ece-efaf-4554-92e5-7facedfe3959]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG os_brick.utils [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] <== get_connector_properties: return (206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Updating existing volume attachment record: 87444ffe-9375-429a-9c74-7dc3039fc6ac {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "1045c42c-85e8-46b9-ad58-124004244545" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG nova.objects.instance [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lazy-loading 'flavor' on Instance uuid 1045c42c-85e8-46b9-ad58-124004244545 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.225s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "1045c42c-85e8-46b9-ad58-124004244545" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:54 user nova-compute[75021]: INFO nova.compute.manager [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Attaching volume 3f3486fb-6e6a-4386-986f-1753fdee3f18 to /dev/vdb
Dec 06 07:19:54 user nova-compute[75021]: DEBUG os_brick.utils [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[894019e5-d8b4-4676-a98d-4a34f996d66c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc12d91-eab1-4b4f-87b8-b017eba8ee41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.209s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ac2473-3013-456a-b7c2-1274e012bd1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[626249de-105b-43e5-8c8b-20ba03be8a7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG nova.network.neutron [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Successfully created port: fee28653-2669-4e1f-9492-551ffa0fc228 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk 1073741824" returned: 0 in 0.109s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:19:54 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32713fa-b3bb-4e41-a506-5b7d9c1fb427]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG os_brick.utils [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] <== get_connector_properties: return (214ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Updating existing volume attachment record: 88b3aa0b-075e-49c9-83e9-f480a62f7072 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.189s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:54 user nova-compute[75021]: INFO nova.compute.manager [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Detaching volume 894f0d86-2788-4a34-83db-84324142d4a8
Dec 06 07:19:55 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Cannot resize image /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Ensure instance console log exists: /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:55 user nova-compute[75021]: INFO nova.virt.block_device [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Attempting to driver detach volume 894f0d86-2788-4a34-83db-84324142d4a8 from mountpoint /dev/vdb
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Attempting to detach device vdb from instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:19:55 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:19:55 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:19:55 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:19:55 user nova-compute[75021]:   <serial>894f0d86-2788-4a34-83db-84324142d4a8</serial>
Dec 06 07:19:55 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 07:19:55 user nova-compute[75021]: </disk>
Dec 06 07:19:55 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:19:55 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Successfully detached device vdb from instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d from the persistent domain config.
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:19:55 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:19:55 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:19:55 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:19:55 user nova-compute[75021]:   <serial>894f0d86-2788-4a34-83db-84324142d4a8</serial>
Dec 06 07:19:55 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 06 07:19:55 user nova-compute[75021]: </disk>
Dec 06 07:19:55 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.network.neutron [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Successfully updated port: fee28653-2669-4e1f-9492-551ffa0fc228 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "refresh_cache-17638711-6771-4b89-b0d0-231eeb1a9080" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquired lock "refresh_cache-17638711-6771-4b89-b0d0-231eeb1a9080" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.network.neutron [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-eff0b682-0b9a-4b3a-9099-4afe0175abac req-3ac5bb08-d02e-4c9b-a190-140a4da43d40 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Received event network-changed-fee28653-2669-4e1f-9492-551ffa0fc228 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-eff0b682-0b9a-4b3a-9099-4afe0175abac req-3ac5bb08-d02e-4c9b-a190-140a4da43d40 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Refreshing instance network info cache due to event network-changed-fee28653-2669-4e1f-9492-551ffa0fc228. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-eff0b682-0b9a-4b3a-9099-4afe0175abac req-3ac5bb08-d02e-4c9b-a190-140a4da43d40 service nova] Acquiring lock "refresh_cache-17638711-6771-4b89-b0d0-231eeb1a9080" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.network.neutron [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.network.neutron [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Updating instance_info_cache with network_info: [{"id": "fee28653-2669-4e1f-9492-551ffa0fc228", "address": "fa:16:3e:dc:59:0a", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee28653-26", "ovs_interfaceid": "fee28653-2669-4e1f-9492-551ffa0fc228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Releasing lock "refresh_cache-17638711-6771-4b89-b0d0-231eeb1a9080" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Instance network_info: |[{"id": "fee28653-2669-4e1f-9492-551ffa0fc228", "address": "fa:16:3e:dc:59:0a", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee28653-26", "ovs_interfaceid": "fee28653-2669-4e1f-9492-551ffa0fc228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-eff0b682-0b9a-4b3a-9099-4afe0175abac req-3ac5bb08-d02e-4c9b-a190-140a4da43d40 service nova] Acquired lock "refresh_cache-17638711-6771-4b89-b0d0-231eeb1a9080" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.network.neutron [req-eff0b682-0b9a-4b3a-9099-4afe0175abac req-3ac5bb08-d02e-4c9b-a190-140a4da43d40 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Refreshing network info cache for port fee28653-2669-4e1f-9492-551ffa0fc228 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Start _get_guest_xml network_info=[{"id": "fee28653-2669-4e1f-9492-551ffa0fc228", "address": "fa:16:3e:dc:59:0a", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee28653-26", "ovs_interfaceid": "fee28653-2669-4e1f-9492-551ffa0fc228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:19:55 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:19:55 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1911096286',display_name='tempest-AttachVolumeNegativeTest-server-1911096286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1911096286',id=40,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuRMDB9LjoMOK8m3JLIWGxvPBdzMsbu2+W+gAFnuxWMImrR33YiABmQp/F1l1w8yVI8cHPiCGaavOzjs0wYzZd8JBinuLtEkvdRWMqaiE6omnlq7hQSn/wFEWOtH+qIyA==',key_name='tempest-keypair-903842731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae65045cef754813bd33f68b9868dc9d',ramdisk_id='',reservation_id='r-rfxgj0rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-967416759',owner_user_name='tempest-AttachVolumeNegativeTest-967416759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:19:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e1155d2c304bdd8404712faf046b05',uuid=17638711-6771-4b89-b0d0-231eeb1a9080,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fee28653-2669-4e1f-9492-551ffa0fc228", "address": "fa:16:3e:dc:59:0a", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee28653-26", "ovs_interfaceid": "fee28653-2669-4e1f-9492-551ffa0fc228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converting VIF {"id": "fee28653-2669-4e1f-9492-551ffa0fc228", "address": "fa:16:3e:dc:59:0a", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee28653-26", "ovs_interfaceid": "fee28653-2669-4e1f-9492-551ffa0fc228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:59:0a,bridge_name='br-int',has_traffic_filtering=True,id=fee28653-2669-4e1f-9492-551ffa0fc228,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee28653-26') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.objects.instance [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'pci_devices' on Instance uuid 17638711-6771-4b89-b0d0-231eeb1a9080 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:19:55 user nova-compute[75021]:   <uuid>17638711-6771-4b89-b0d0-231eeb1a9080</uuid>
Dec 06 07:19:55 user nova-compute[75021]:   <name>instance-00000028</name>
Dec 06 07:19:55 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:19:55 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:19:55 user nova-compute[75021]:   <metadata>
Dec 06 07:19:55 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:19:55 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:19:55 user nova-compute[75021]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1911096286</nova:name>
Dec 06 07:19:55 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:19:55</nova:creationTime>
Dec 06 07:19:55 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:19:55 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:19:55 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:19:55 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:19:55 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:19:55 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:19:55 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:19:55 user nova-compute[75021]:       <nova:owner>
Dec 06 07:19:55 user nova-compute[75021]:         <nova:user uuid="c5e1155d2c304bdd8404712faf046b05">tempest-AttachVolumeNegativeTest-967416759-project-member</nova:user>
Dec 06 07:19:55 user nova-compute[75021]:         <nova:project uuid="ae65045cef754813bd33f68b9868dc9d">tempest-AttachVolumeNegativeTest-967416759</nova:project>
Dec 06 07:19:55 user nova-compute[75021]:       </nova:owner>
Dec 06 07:19:55 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:19:55 user nova-compute[75021]:       <nova:ports>
Dec 06 07:19:55 user nova-compute[75021]:         <nova:port uuid="fee28653-2669-4e1f-9492-551ffa0fc228">
Dec 06 07:19:55 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 07:19:55 user nova-compute[75021]:         </nova:port>
Dec 06 07:19:55 user nova-compute[75021]:       </nova:ports>
Dec 06 07:19:55 user nova-compute[75021]:     </nova:instance>
Dec 06 07:19:55 user nova-compute[75021]:   </metadata>
Dec 06 07:19:55 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:19:55 user nova-compute[75021]:     <system>
Dec 06 07:19:55 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:19:55 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:19:55 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:19:55 user nova-compute[75021]:       <entry name="serial">17638711-6771-4b89-b0d0-231eeb1a9080</entry>
Dec 06 07:19:55 user nova-compute[75021]:       <entry name="uuid">17638711-6771-4b89-b0d0-231eeb1a9080</entry>
Dec 06 07:19:55 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:19:55 user nova-compute[75021]:     </system>
Dec 06 07:19:55 user nova-compute[75021]:   </sysinfo>
Dec 06 07:19:55 user nova-compute[75021]:   <os>
Dec 06 07:19:55 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:19:55 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:19:55 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:19:55 user nova-compute[75021]:   </os>
Dec 06 07:19:55 user nova-compute[75021]:   <features>
Dec 06 07:19:55 user nova-compute[75021]:     <acpi/>
Dec 06 07:19:55 user nova-compute[75021]:     <apic/>
Dec 06 07:19:55 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:19:55 user nova-compute[75021]:   </features>
Dec 06 07:19:55 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:19:55 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:19:55 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:19:55 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:19:55 user nova-compute[75021]:   </clock>
Dec 06 07:19:55 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:19:55 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:19:55 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:19:55 user nova-compute[75021]:   </cpu>
Dec 06 07:19:55 user nova-compute[75021]:   <devices>
Dec 06 07:19:55 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:19:55 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:19:55 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk"/>
Dec 06 07:19:55 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:19:55 user nova-compute[75021]:     </disk>
Dec 06 07:19:55 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:19:55 user nova-compute[75021]:       <mac address="fa:16:3e:dc:59:0a"/>
Dec 06 07:19:55 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:19:55 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:19:55 user nova-compute[75021]:       <target dev="tapfee28653-26"/>
Dec 06 07:19:55 user nova-compute[75021]:     </interface>
Dec 06 07:19:55 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:19:55 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/console.log" append="off"/>
Dec 06 07:19:55 user nova-compute[75021]:     </serial>
Dec 06 07:19:55 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:19:55 user nova-compute[75021]:     <video>
Dec 06 07:19:55 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:19:55 user nova-compute[75021]:     </video>
Dec 06 07:19:55 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:19:55 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:19:55 user nova-compute[75021]:     </rng>
Dec 06 07:19:55 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:19:55 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:19:55 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:19:55 user nova-compute[75021]:     </memballoon>
Dec 06 07:19:55 user nova-compute[75021]:   </devices>
Dec 06 07:19:55 user nova-compute[75021]: </domain>
Dec 06 07:19:55 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1911096286',display_name='tempest-AttachVolumeNegativeTest-server-1911096286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1911096286',id=40,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuRMDB9LjoMOK8m3JLIWGxvPBdzMsbu2+W+gAFnuxWMImrR33YiABmQp/F1l1w8yVI8cHPiCGaavOzjs0wYzZd8JBinuLtEkvdRWMqaiE6omnlq7hQSn/wFEWOtH+qIyA==',key_name='tempest-keypair-903842731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae65045cef754813bd33f68b9868dc9d',ramdisk_id='',reservation_id='r-rfxgj0rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-967416759',owner_user_name='tempest-AttachVolumeNegativeTest-967416759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:19:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e1155d2c304bdd8404712faf046b05',uuid=17638711-6771-4b89-b0d0-231eeb1a9080,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fee28653-2669-4e1f-9492-551ffa0fc228", "address": "fa:16:3e:dc:59:0a", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee28653-26", "ovs_interfaceid": "fee28653-2669-4e1f-9492-551ffa0fc228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converting VIF {"id": "fee28653-2669-4e1f-9492-551ffa0fc228", "address": "fa:16:3e:dc:59:0a", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee28653-26", "ovs_interfaceid": "fee28653-2669-4e1f-9492-551ffa0fc228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:59:0a,bridge_name='br-int',has_traffic_filtering=True,id=fee28653-2669-4e1f-9492-551ffa0fc228,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee28653-26') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG os_vif [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:59:0a,bridge_name='br-int',has_traffic_filtering=True,id=fee28653-2669-4e1f-9492-551ffa0fc228,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee28653-26') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a6b715c-af44-5545-ac37-827718a3d8fd', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfee28653-26, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfee28653-26, col_values=(('qos', UUID('0dd147ba-9522-4af1-b878-615a937c717d')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfee28653-26, col_values=(('external_ids', {'iface-id': 'fee28653-2669-4e1f-9492-551ffa0fc228', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:59:0a', 'vm-uuid': '17638711-6771-4b89-b0d0-231eeb1a9080'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:19:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:19:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:56 user nova-compute[75021]: INFO os_vif [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:59:0a,bridge_name='br-int',has_traffic_filtering=True,id=fee28653-2669-4e1f-9492-551ffa0fc228,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee28653-26')
Dec 06 07:19:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:19:56 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No VIF found with MAC fa:16:3e:dc:59:0a, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:19:56 user nova-compute[75021]: DEBUG nova.network.neutron [req-eff0b682-0b9a-4b3a-9099-4afe0175abac req-3ac5bb08-d02e-4c9b-a190-140a4da43d40 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Updated VIF entry in instance network info cache for port fee28653-2669-4e1f-9492-551ffa0fc228. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:19:56 user nova-compute[75021]: DEBUG nova.network.neutron [req-eff0b682-0b9a-4b3a-9099-4afe0175abac req-3ac5bb08-d02e-4c9b-a190-140a4da43d40 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Updating instance_info_cache with network_info: [{"id": "fee28653-2669-4e1f-9492-551ffa0fc228", "address": "fa:16:3e:dc:59:0a", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee28653-26", "ovs_interfaceid": "fee28653-2669-4e1f-9492-551ffa0fc228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:19:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-eff0b682-0b9a-4b3a-9099-4afe0175abac req-3ac5bb08-d02e-4c9b-a190-140a4da43d40 service nova] Releasing lock "refresh_cache-17638711-6771-4b89-b0d0-231eeb1a9080" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:19:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:57 user nova-compute[75021]: DEBUG nova.compute.manager [req-5112f435-0b62-49aa-ba15-b3b524dc8fcd req-158b5112-f170-45d0-a447-1d2944ac1da6 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Received event network-vif-plugged-fee28653-2669-4e1f-9492-551ffa0fc228 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:19:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5112f435-0b62-49aa-ba15-b3b524dc8fcd req-158b5112-f170-45d0-a447-1d2944ac1da6 service nova] Acquiring lock "17638711-6771-4b89-b0d0-231eeb1a9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5112f435-0b62-49aa-ba15-b3b524dc8fcd req-158b5112-f170-45d0-a447-1d2944ac1da6 service nova] Lock "17638711-6771-4b89-b0d0-231eeb1a9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5112f435-0b62-49aa-ba15-b3b524dc8fcd req-158b5112-f170-45d0-a447-1d2944ac1da6 service nova] Lock "17638711-6771-4b89-b0d0-231eeb1a9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:57 user nova-compute[75021]: DEBUG nova.compute.manager [req-5112f435-0b62-49aa-ba15-b3b524dc8fcd req-158b5112-f170-45d0-a447-1d2944ac1da6 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] No waiting events found dispatching network-vif-plugged-fee28653-2669-4e1f-9492-551ffa0fc228 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:19:57 user nova-compute[75021]: WARNING nova.compute.manager [req-5112f435-0b62-49aa-ba15-b3b524dc8fcd req-158b5112-f170-45d0-a447-1d2944ac1da6 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Received unexpected event network-vif-plugged-fee28653-2669-4e1f-9492-551ffa0fc228 for instance with vm_state building and task_state spawning.
Dec 06 07:19:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:19:59 user nova-compute[75021]: DEBUG nova.compute.manager [req-6958f036-79aa-4d31-b9c5-8a824198370c req-751c3387-adac-45a6-b9a7-7e2f84d7aa72 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Received event network-vif-plugged-fee28653-2669-4e1f-9492-551ffa0fc228 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:19:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6958f036-79aa-4d31-b9c5-8a824198370c req-751c3387-adac-45a6-b9a7-7e2f84d7aa72 service nova] Acquiring lock "17638711-6771-4b89-b0d0-231eeb1a9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:19:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6958f036-79aa-4d31-b9c5-8a824198370c req-751c3387-adac-45a6-b9a7-7e2f84d7aa72 service nova] Lock "17638711-6771-4b89-b0d0-231eeb1a9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:19:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6958f036-79aa-4d31-b9c5-8a824198370c req-751c3387-adac-45a6-b9a7-7e2f84d7aa72 service nova] Lock "17638711-6771-4b89-b0d0-231eeb1a9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:19:59 user nova-compute[75021]: DEBUG nova.compute.manager [req-6958f036-79aa-4d31-b9c5-8a824198370c req-751c3387-adac-45a6-b9a7-7e2f84d7aa72 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] No waiting events found dispatching network-vif-plugged-fee28653-2669-4e1f-9492-551ffa0fc228 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:19:59 user nova-compute[75021]: WARNING nova.compute.manager [req-6958f036-79aa-4d31-b9c5-8a824198370c req-751c3387-adac-45a6-b9a7-7e2f84d7aa72 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Received unexpected event network-vif-plugged-fee28653-2669-4e1f-9492-551ffa0fc228 for instance with vm_state building and task_state spawning.
Dec 06 07:19:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:19:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:19:59 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Instance spawned successfully.
Dec 06 07:19:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:19:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:19:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:19:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:19:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:19:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:19:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:20:00 user nova-compute[75021]: INFO nova.compute.manager [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Took 6.03 seconds to spawn the instance on the hypervisor.
Dec 06 07:20:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:20:00 user nova-compute[75021]: INFO nova.compute.manager [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Took 6.99 seconds to build instance.
Dec 06 07:20:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-43b201aa-23c3-4afd-a26e-fadfbb25e90b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "17638711-6771-4b89-b0d0-231eeb1a9080" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.101s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:20:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPFlGHYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:20:05 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:20:05 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:20:05 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb4575a-a367-4a2a-a661-42ac72da970d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:20:05 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ff9f81-7584-4a70-90b4-3bc4c8210412]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241] added
Dec 06 07:20:05 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0423835-ced2-4160-a510-992a19e1fd75]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f426d9fc-a297-4a75-be65-34e6bec62372]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DPFlGHYO {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DPFlGHYO" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[17740fe1-2935-44e2-bea7-6452bf72d01a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DPFlGHYO'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18095d3-d24d-46bb-9979-13478e1f0c59]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ad3cfe-c475-4348-97de-6a9e7720b29e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:05 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:05 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:05 user nova-compute[75021]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:20:05 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:05 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:05 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:05 user nova-compute[75021]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:20:05 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa75b60-7213-4816-9e4c-baed58394856]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241, portal: 172.16.0.220,3260]
Dec 06 07:20:05 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241, portal: 172.16.0.220,3260] successful.
Dec 06 07:20:05 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bd69d6-4fba-4d86-9961-2e21eb82a1dc]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[365f48dc-b583-48d8-8bf6-b4915a4753b7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:05 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:05 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:05 user nova-compute[75021]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:20:05 user nova-compute[75021]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)
Dec 06 07:20:05 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:05 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:05 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:05 user nova-compute[75021]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:20:05 user nova-compute[75021]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)
Dec 06 07:20:05 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] HCTL ('37', '-', '-', 0) found on session 48 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f1fd88-fc64-4c8c-85ad-6c7cdd0b2422]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPFlGHYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCoxhdPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:20:05 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:20:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:20:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26166373563666636', 'path': '/dev/sdf'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166373563666636', 'path': '/dev/sdf'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.529s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:20:06 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:20:06 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG nova.objects.instance [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lazy-loading 'flavor' on Instance uuid 65977b9a-f812-44b8-b8dc-95c12e2f8a6d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a433bf4a-d4b8-4214-8b7f-1bf22446d799]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:20:06 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:20:06 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:20:06 user nova-compute[75021]:   <source dev="/dev/sdf"/>
Dec 06 07:20:06 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:20:06 user nova-compute[75021]:   <serial>906aed19-353c-4281-97b4-3257a923c241</serial>
Dec 06 07:20:06 user nova-compute[75021]: </disk>
Dec 06 07:20:06 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f25ce4-5930-43a7-99e7-a60cab7fe51b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18] added
Dec 06 07:20:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deda4e6-ea6d-47c2-a342-42ed84284f88]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a8f548-66a0-4478-9863-1046252205e4]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JCoxhdPU {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JCoxhdPU" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a1eb65-99c3-4035-807b-729fe909afa6]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JCoxhdPU'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[95733018-1e68-4adb-a3e0-241bfefffb78]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b93060-8123-483f-b087-ce7a97e67750]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)
Dec 06 07:20:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)
Dec 06 07:20:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2209a1-3532-4490-8c30-79564f1c80dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18, portal: 172.16.0.220,3260]
Dec 06 07:20:06 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18, portal: 172.16.0.220,3260] successful.
Dec 06 07:20:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6aab67-129f-4b78-9997-e73e2e1f87da]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2f1c3b-9ff1-4d97-81af-62127555ca71]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:20:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)
Dec 06 07:20:06 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:20:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] HCTL ('38', '-', '-', 0) found on session 49 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[60953aba-7478-4d6d-abaa-4540017c707b]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Searching for a device in session 49 and hctl ['38', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:20:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] No VIF found with MAC fa:16:3e:70:4a:cd, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:20:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7e41c0c9-cf17-419e-9848-e7f76176af2f tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.276s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:20:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Searching for a device in session 49 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:20:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCoxhdPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:20:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:20:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] <== connect_volume: return (1880ms) {'type': 'block', 'scsi_wwn': '26662366336313935', 'path': '/dev/sdg'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:20:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662366336313935', 'path': '/dev/sdg'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:20:07 user nova-compute[75021]: DEBUG nova.objects.instance [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lazy-loading 'flavor' on Instance uuid 1045c42c-85e8-46b9-ad58-124004244545 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:20:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:20:07 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:20:07 user nova-compute[75021]:   <source dev="/dev/sdg"/>
Dec 06 07:20:07 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:20:07 user nova-compute[75021]:   <serial>3f3486fb-6e6a-4386-986f-1753fdee3f18</serial>
Dec 06 07:20:07 user nova-compute[75021]: </disk>
Dec 06 07:20:07 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:20:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:20:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:20:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] No VIF found with MAC fa:16:3e:b5:01:eb, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:20:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cab1895f-c48d-42a7-b9c4-d5c5c109c756 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.087s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:20:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:20:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:20:09 user nova-compute[75021]: INFO nova.compute.manager [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Detaching volume 906aed19-353c-4281-97b4-3257a923c241
Dec 06 07:20:09 user nova-compute[75021]: INFO nova.virt.block_device [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Attempting to driver detach volume 906aed19-353c-4281-97b4-3257a923c241 from mountpoint /dev/vdb
Dec 06 07:20:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Attempting to detach device vdb from instance 65977b9a-f812-44b8-b8dc-95c12e2f8a6d from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:20:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:20:09 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:20:09 user nova-compute[75021]:   <source dev="/dev/sdf"/>
Dec 06 07:20:09 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:20:09 user nova-compute[75021]:   <serial>906aed19-353c-4281-97b4-3257a923c241</serial>
Dec 06 07:20:09 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:20:09 user nova-compute[75021]: </disk>
Dec 06 07:20:09 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:20:09 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Successfully detached device vdb from instance 65977b9a-f812-44b8-b8dc-95c12e2f8a6d from the persistent domain config.
Dec 06 07:20:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 65977b9a-f812-44b8-b8dc-95c12e2f8a6d from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:20:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:20:09 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:20:09 user nova-compute[75021]:   <source dev="/dev/sdf"/>
Dec 06 07:20:09 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:20:09 user nova-compute[75021]:   <serial>906aed19-353c-4281-97b4-3257a923c241</serial>
Dec 06 07:20:09 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:20:09 user nova-compute[75021]: </disk>
Dec 06 07:20:09 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:20:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 65977b9a-f812-44b8-b8dc-95c12e2f8a6d {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:20:10 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:20:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "1045c42c-85e8-46b9-ad58-124004244545" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG nova.objects.instance [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lazy-loading 'flavor' on Instance uuid 1045c42c-85e8-46b9-ad58-124004244545 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "1045c42c-85e8-46b9-ad58-124004244545" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:20:12 user nova-compute[75021]: INFO nova.compute.manager [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Attaching volume b2094c0c-e902-487d-8dd9-f2676ce6716a to /dev/vdc
Dec 06 07:20:12 user nova-compute[75021]: DEBUG os_brick.utils [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7121a211-7d20-4ec2-8988-36045d5fd745]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[64513eb5-4d1b-4a7a-9627-3dc753cc22d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a113d6-c517-42d1-b31d-0d42fca4aa80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7802ac-183d-4e07-93a3-aea2cdbe656d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:20:12 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:20:12 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4399ac18-bba5-4353-87a3-ebbcebb4ea02]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG os_brick.utils [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:20:12 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Updating existing volume attachment record: 739490b8-7748-46ca-8767-bdc79cf98f6c {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:20:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:20:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:20:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:20:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:20:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:20:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:20:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:20:13 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:20:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:13 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:20:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:20:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:20:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:15 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d is timed out.
Dec 06 07:20:15 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Successfully detached device vdb from instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d from the live domain config.
Dec 06 07:20:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvwfnuhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:20:15 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bc7366-23b8-4eab-a6b2-790058e2ad88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:20:15 user nova-compute[75021]: No targets found.
Dec 06 07:20:15 user nova-compute[75021]: iSNS:
Dec 06 07:20:15 user nova-compute[75021]: No targets found.
Dec 06 07:20:15 user nova-compute[75021]: STATIC:
Dec 06 07:20:15 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8
Dec 06 07:20:15 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:15 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:15 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18
Dec 06 07:20:15 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:15 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:15 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:20:15 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:15 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:15 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c
Dec 06 07:20:15 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:15 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:15 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc
Dec 06 07:20:15 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:15 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:15 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241
Dec 06 07:20:15 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:15 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:15 user nova-compute[75021]: FIRMWARE:
Dec 06 07:20:15 user nova-compute[75021]: No targets found.
Dec 06 07:20:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:20:15 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:20:15 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[341b2445-1efe-449d-80ed-c9ee1c14ba34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4601fae9-f000-4a78-9ac4-5226db71d4ba]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:15 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:15 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:15 user nova-compute[75021]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:20:15 user nova-compute[75021]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)
Dec 06 07:20:15 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:20:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:15 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:15 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:15 user nova-compute[75021]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 (non-flash)
Dec 06 07:20:15 user nova-compute[75021]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)
Dec 06 07:20:15 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:20:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89f0393250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[72923e14-7e56-4743-a6df-472c9759f459]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c750ce23-9269-49a3-b1dd-c4302bd6fb47]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0777ef-8d26-4ca5-9070-a7c35073b9c6]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec7b7fc-64fa-42f7-8073-aa36c6e9fb3c]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c787d9-a5c4-466b-9949-7caf8ddeb2c3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf4b63f-8ffb-48b7-8dbc-befc5ef14059]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260]
Dec 06 07:20:15 user nova-compute[75021]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8, portal: 172.16.0.220,3260] successful.
Dec 06 07:20:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f0d86-2788-4a34-83db-84324142d4a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0519ce15-597f-4f03-a710-8e051919d98c]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] <== disconnect_volume: return (378ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.objects.instance [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'flavor' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:20:17 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:20:17 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7635MB free_disk=24.911392211914062GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-91bedb91-1c70-41d3-8022-d16df00eec50 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.254s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 58ef39ae-4b66-42e6-ae22-5308a98eb55d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 92c63579-741c-4daa-9568-f7ddf95e3729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2064385e-a37f-468e-bed6-129eb54295ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a31eae43-b01c-46cf-9c06-13e9242b5fe1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 65977b9a-f812-44b8-b8dc-95c12e2f8a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 1045c42c-85e8-46b9-ad58-124004244545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 17638711-6771-4b89-b0d0-231eeb1a9080 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-98869d50-86dc-4e2b-a01d-43cb86f667c8 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-98869d50-86dc-4e2b-a01d-43cb86f667c8 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-98869d50-86dc-4e2b-a01d-43cb86f667c8 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-98869d50-86dc-4e2b-a01d-43cb86f667c8 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75021) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.objects.instance [None req-98869d50-86dc-4e2b-a01d-43cb86f667c8 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'flavor' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.manager [req-5a88cfd1-b6e7-45da-a027-47332e192ef3 req-b2af25ad-20d8-4fce-ab24-84595dad5e17 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-unplugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5a88cfd1-b6e7-45da-a027-47332e192ef3 req-b2af25ad-20d8-4fce-ab24-84595dad5e17 service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5a88cfd1-b6e7-45da-a027-47332e192ef3 req-b2af25ad-20d8-4fce-ab24-84595dad5e17 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5a88cfd1-b6e7-45da-a027-47332e192ef3 req-b2af25ad-20d8-4fce-ab24-84595dad5e17 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:20:17 user nova-compute[75021]: DEBUG nova.compute.manager [req-5a88cfd1-b6e7-45da-a027-47332e192ef3 req-b2af25ad-20d8-4fce-ab24-84595dad5e17 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-unplugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:20:17 user nova-compute[75021]: WARNING nova.compute.manager [req-5a88cfd1-b6e7-45da-a027-47332e192ef3 req-b2af25ad-20d8-4fce-ab24-84595dad5e17 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received unexpected event network-vif-unplugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with vm_state active and task_state powering-off.
Dec 06 07:20:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:18 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Instance destroyed successfully.
Dec 06 07:20:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-98869d50-86dc-4e2b-a01d-43cb86f667c8 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:20:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-98869d50-86dc-4e2b-a01d-43cb86f667c8 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.834s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:20:18 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:20:18 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:20:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:20:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-b9372825-c75d-45a3-a48c-e111869d97a5" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:20:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-b9372825-c75d-45a3-a48c-e111869d97a5" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:20:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:20:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:19 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Updating instance_info_cache with network_info: [{"id": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "address": "fa:16:3e:fb:4a:05", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c8a95e-1a", "ovs_interfaceid": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:20:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-b9372825-c75d-45a3-a48c-e111869d97a5" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:20:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:20:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:20:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:20:19 user nova-compute[75021]: DEBUG nova.compute.manager [req-feaa14e5-ce21-45fb-93f1-db8b210a2d75 req-43e90a31-38f7-4278-8e6b-3e5371962651 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:20:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-feaa14e5-ce21-45fb-93f1-db8b210a2d75 req-43e90a31-38f7-4278-8e6b-3e5371962651 service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:20:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-feaa14e5-ce21-45fb-93f1-db8b210a2d75 req-43e90a31-38f7-4278-8e6b-3e5371962651 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:20:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-feaa14e5-ce21-45fb-93f1-db8b210a2d75 req-43e90a31-38f7-4278-8e6b-3e5371962651 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:20:19 user nova-compute[75021]: DEBUG nova.compute.manager [req-feaa14e5-ce21-45fb-93f1-db8b210a2d75 req-43e90a31-38f7-4278-8e6b-3e5371962651 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:20:19 user nova-compute[75021]: WARNING nova.compute.manager [req-feaa14e5-ce21-45fb-93f1-db8b210a2d75 req-43e90a31-38f7-4278-8e6b-3e5371962651 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received unexpected event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with vm_state stopped and task_state None.
Dec 06 07:20:20 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:20:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:22 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:20:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75021) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUNtaKhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:20:23 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:20:23 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:20:23 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9421a647-4fe4-4670-aefa-2ff63e0f61a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:20:23 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b51fcc4-f054-4260-8f4d-81c2a3d85497]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a] added
Dec 06 07:20:23 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5039f7ae-1d58-4581-b7c9-44c9c2048135]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2eb601-bcde-4ac7-b878-63b8225f37f2]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lUNtaKhI {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lUNtaKhI" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[451be776-47ba-4d6a-a740-5207a5909e85]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lUNtaKhI'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[09319bc7-378f-41b9-bb5f-31f37fa2c56b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[504dc775-1ad5-407f-b59f-ab45693e2898]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:20:23 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:20:23 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd608182-ec52-48a6-8a12-69c04de2a3a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a, portal: 172.16.0.220,3260]
Dec 06 07:20:23 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a, portal: 172.16.0.220,3260] successful.
Dec 06 07:20:23 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3640794-4859-4227-bdd1-cd408eb788c2]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[01361fb8-c6b2-4171-9c06-30e1096450cb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a (non-flash)
Dec 06 07:20:23 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:20:23 user nova-compute[75021]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a (non-flash)
Dec 06 07:20:23 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed726d3-b0a1-4747-a12b-0833d43d5140]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:20:23 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUNtaKhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:20:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:20:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26532653430633133', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:20:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532653430633133', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:20:24 user nova-compute[75021]: DEBUG nova.objects.instance [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lazy-loading 'flavor' on Instance uuid 1045c42c-85e8-46b9-ad58-124004244545 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:20:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:20:24 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:20:24 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:20:24 user nova-compute[75021]:   <target dev="vdc" bus="virtio"/>
Dec 06 07:20:24 user nova-compute[75021]:   <serial>b2094c0c-e902-487d-8dd9-f2676ce6716a</serial>
Dec 06 07:20:24 user nova-compute[75021]: </disk>
Dec 06 07:20:24 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:20:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:20:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:20:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:20:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] No VIF found with MAC fa:16:3e:b5:01:eb, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:20:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dfb12e04-82bb-43ac-9c6a-0b6c9684f4f4 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.388s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:20:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "1045c42c-85e8-46b9-ad58-124004244545" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:20:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:20:25 user nova-compute[75021]: INFO nova.compute.manager [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Detaching volume b2094c0c-e902-487d-8dd9-f2676ce6716a
Dec 06 07:20:25 user nova-compute[75021]: INFO nova.virt.block_device [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Attempting to driver detach volume b2094c0c-e902-487d-8dd9-f2676ce6716a from mountpoint /dev/vdc
Dec 06 07:20:25 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Attempting to detach device vdc from instance 1045c42c-85e8-46b9-ad58-124004244545 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:20:25 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:20:25 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:20:25 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:20:25 user nova-compute[75021]:   <target dev="vdc" bus="virtio"/>
Dec 06 07:20:25 user nova-compute[75021]:   <serial>b2094c0c-e902-487d-8dd9-f2676ce6716a</serial>
Dec 06 07:20:25 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 07:20:25 user nova-compute[75021]: </disk>
Dec 06 07:20:25 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:20:25 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Successfully detached device vdc from instance 1045c42c-85e8-46b9-ad58-124004244545 from the persistent domain config.
Dec 06 07:20:25 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1045c42c-85e8-46b9-ad58-124004244545 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:20:25 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:20:25 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:20:25 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:20:25 user nova-compute[75021]:   <target dev="vdc" bus="virtio"/>
Dec 06 07:20:25 user nova-compute[75021]:   <serial>b2094c0c-e902-487d-8dd9-f2676ce6716a</serial>
Dec 06 07:20:25 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 07:20:25 user nova-compute[75021]: </disk>
Dec 06 07:20:25 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:20:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1045c42c-85e8-46b9-ad58-124004244545 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:29 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 65977b9a-f812-44b8-b8dc-95c12e2f8a6d is timed out.
Dec 06 07:20:29 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Successfully detached device vdb from instance 65977b9a-f812-44b8-b8dc-95c12e2f8a6d from the live domain config.
Dec 06 07:20:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPFlGHYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:20:29 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:20:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc2a1de-c7b2-4661-9289-f94d618c60c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:20:29 user nova-compute[75021]: No targets found.
Dec 06 07:20:29 user nova-compute[75021]: iSNS:
Dec 06 07:20:29 user nova-compute[75021]: No targets found.
Dec 06 07:20:29 user nova-compute[75021]: STATIC:
Dec 06 07:20:29 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a
Dec 06 07:20:29 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:29 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:29 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18
Dec 06 07:20:29 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:29 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:29 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:20:29 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:29 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:29 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c
Dec 06 07:20:29 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:29 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:29 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc
Dec 06 07:20:29 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:29 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:29 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241
Dec 06 07:20:29 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:29 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:29 user nova-compute[75021]: FIRMWARE:
Dec 06 07:20:29 user nova-compute[75021]: No targets found.
Dec 06 07:20:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:20:29 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:20:29 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31fcd61-6feb-46e6-a8dc-5d9143f80590]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.072s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[20eda8fe-18c3-4d9f-851f-1cc8b8cfff3f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:29 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:29 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:29 user nova-compute[75021]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)
Dec 06 07:20:29 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:20:29 user nova-compute[75021]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a (non-flash)
Dec 06 07:20:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:29 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:29 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:29 user nova-compute[75021]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 (non-flash)
Dec 06 07:20:29 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:20:29 user nova-compute[75021]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a (non-flash)
Dec 06 07:20:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b45fc550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241'): ({'sdf'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Removing single pathed devices sdf {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[100e6623-06d5-4302-97d0-3a4dfc578f13]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.031s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbd3cff-3c5c-4112-9b35-be5907456537]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Flushing IO for device /dev/sdf {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a571c60-6d32-49b4-a1b4-56db2c7eab62]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8ff5f4-f588-451b-8af9-20cd0ff014cb]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] SCSI volumes sdf have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:20:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[88166436-a6de-48bd-abd0-510e27b23020]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dba08d-66cf-4de2-9eeb-0c2aece6d600]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241, portal: 172.16.0.220,3260]
Dec 06 07:20:30 user nova-compute[75021]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241, portal: 172.16.0.220,3260] successful.
Dec 06 07:20:30 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:906aed19-353c-4281-97b4-3257a923c241 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c73c7f6-6136-46e8-bfaf-387772175449]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] <== disconnect_volume: return (409ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG nova.objects.instance [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lazy-loading 'flavor' on Instance uuid 65977b9a-f812-44b8-b8dc-95c12e2f8a6d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:20:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f47932ae-4f09-4951-adc7-c653e9413dc1 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.792s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:20:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:35 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:20:35 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 07:20:35 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] There are 0 instances to clean {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 07:20:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:20:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:20:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:20:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:20:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:20:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:20:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:20:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:20:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:44 user nova-compute[75021]: INFO nova.compute.manager [None req-93eb2927-4325-4425-a3f4-47428cc71859 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Get console output
Dec 06 07:20:44 user nova-compute[75021]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Dec 06 07:20:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:20:46 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 1045c42c-85e8-46b9-ad58-124004244545 is timed out.
Dec 06 07:20:46 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Successfully detached device vdc from instance 1045c42c-85e8-46b9-ad58-124004244545 from the live domain config.
Dec 06 07:20:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUNtaKhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:20:46 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa4fff6-f4cc-463d-a4bf-c99aef75a1a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:20:46 user nova-compute[75021]: No targets found.
Dec 06 07:20:46 user nova-compute[75021]: iSNS:
Dec 06 07:20:46 user nova-compute[75021]: No targets found.
Dec 06 07:20:46 user nova-compute[75021]: STATIC:
Dec 06 07:20:46 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a
Dec 06 07:20:46 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:46 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:46 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18
Dec 06 07:20:46 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:46 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:46 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:20:46 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:46 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:46 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c
Dec 06 07:20:46 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:46 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:46 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc
Dec 06 07:20:46 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:20:46 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:20:46 user nova-compute[75021]: FIRMWARE:
Dec 06 07:20:46 user nova-compute[75021]: No targets found.
Dec 06 07:20:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:20:46 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:20:46 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec8dffb-a91a-4b98-a611-f225758450f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[39555516-1f88-437d-88a5-1856d9586efa]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:46 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:46 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:46 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:20:46 user nova-compute[75021]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a (non-flash)
Dec 06 07:20:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:20:46 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:20:46 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:20:46 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:20:46 user nova-compute[75021]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a (non-flash)
Dec 06 07:20:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b4529360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ed0f84-d8ea-4897-8049-66a4e120b0db]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca7dc37-6fa9-469d-99f0-10d7954608bc]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d47910-209c-4107-86cc-cb7311e53928]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52fc1a2-1646-4c80-b27a-a4d4a7b65c6d]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c118b672-3a01-46c3-a516-2331abe6eb9e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b142d79-2174-4a9d-b064-cf413dcd5892]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a, portal: 172.16.0.220,3260]
Dec 06 07:20:46 user nova-compute[75021]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a, portal: 172.16.0.220,3260] successful.
Dec 06 07:20:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2094c0c-e902-487d-8dd9-f2676ce6716a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c088f885-894b-407a-88c2-d605811dad7e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] <== disconnect_volume: return (304ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:20:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:20:47 user nova-compute[75021]: DEBUG nova.objects.instance [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lazy-loading 'flavor' on Instance uuid 1045c42c-85e8-46b9-ad58-124004244545 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:20:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8917ef96-352f-4e9b-a351-2f3b2a0b458d tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.703s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:20:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:20:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:20:59 user nova-compute[75021]: DEBUG nova.compute.manager [req-5fc2a025-a1cf-4bfb-b944-a2f6f8b44d15 req-1a196a4f-5261-426e-b8fa-ac25988550db service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Received event network-changed-c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:20:59 user nova-compute[75021]: DEBUG nova.compute.manager [req-5fc2a025-a1cf-4bfb-b944-a2f6f8b44d15 req-1a196a4f-5261-426e-b8fa-ac25988550db service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Refreshing instance network info cache due to event network-changed-c40da641-e0b5-4077-959e-cd325f6475be. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:20:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5fc2a025-a1cf-4bfb-b944-a2f6f8b44d15 req-1a196a4f-5261-426e-b8fa-ac25988550db service nova] Acquiring lock "refresh_cache-65977b9a-f812-44b8-b8dc-95c12e2f8a6d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:20:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5fc2a025-a1cf-4bfb-b944-a2f6f8b44d15 req-1a196a4f-5261-426e-b8fa-ac25988550db service nova] Acquired lock "refresh_cache-65977b9a-f812-44b8-b8dc-95c12e2f8a6d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:20:59 user nova-compute[75021]: DEBUG nova.network.neutron [req-5fc2a025-a1cf-4bfb-b944-a2f6f8b44d15 req-1a196a4f-5261-426e-b8fa-ac25988550db service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Refreshing network info cache for port c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:00 user nova-compute[75021]: INFO nova.compute.manager [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Terminating instance
Dec 06 07:21:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG nova.network.neutron [req-5fc2a025-a1cf-4bfb-b944-a2f6f8b44d15 req-1a196a4f-5261-426e-b8fa-ac25988550db service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Updated VIF entry in instance network info cache for port c40da641-e0b5-4077-959e-cd325f6475be. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG nova.network.neutron [req-5fc2a025-a1cf-4bfb-b944-a2f6f8b44d15 req-1a196a4f-5261-426e-b8fa-ac25988550db service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Updating instance_info_cache with network_info: [{"id": "c40da641-e0b5-4077-959e-cd325f6475be", "address": "fa:16:3e:70:4a:cd", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40da641-e0", "ovs_interfaceid": "c40da641-e0b5-4077-959e-cd325f6475be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5fc2a025-a1cf-4bfb-b944-a2f6f8b44d15 req-1a196a4f-5261-426e-b8fa-ac25988550db service nova] Releasing lock "refresh_cache-65977b9a-f812-44b8-b8dc-95c12e2f8a6d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-06effcf5-ad10-4195-b6c3-32122859f947 req-d188564e-1f38-4dc0-8356-548081dcb140 service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Received event network-vif-unplugged-c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-06effcf5-ad10-4195-b6c3-32122859f947 req-d188564e-1f38-4dc0-8356-548081dcb140 service nova] Acquiring lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-06effcf5-ad10-4195-b6c3-32122859f947 req-d188564e-1f38-4dc0-8356-548081dcb140 service nova] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-06effcf5-ad10-4195-b6c3-32122859f947 req-d188564e-1f38-4dc0-8356-548081dcb140 service nova] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-06effcf5-ad10-4195-b6c3-32122859f947 req-d188564e-1f38-4dc0-8356-548081dcb140 service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] No waiting events found dispatching network-vif-unplugged-c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-06effcf5-ad10-4195-b6c3-32122859f947 req-d188564e-1f38-4dc0-8356-548081dcb140 service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Received event network-vif-unplugged-c40da641-e0b5-4077-959e-cd325f6475be for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:01 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Instance destroyed successfully.
Dec 06 07:21:01 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lazy-loading 'resources' on Instance uuid 65977b9a-f812-44b8-b8dc-95c12e2f8a6d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:18:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-411127879',display_name='tempest-TestStampPattern-server-411127879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-411127879',id=38,image_ref='1f2040dd-0102-481e-8a11-7975d01c9e01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg8IGkXaXCpoLXuv1QgPTQlIboH6YGAoE4h1LpIm9THcogGNb2pCBJ53/n7DkXcaYeQRE+8kERBbD6EPJISjHNebvAB2igEJJMWl/apA8rqHLtvdqFZ90Vp+dBW6ln6vA==',key_name='tempest-TestStampPattern-2114891316',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f583c975ad5427f8a6ea845d0e22f2e',ramdisk_id='',reservation_id='r-owwu5gql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='92c63579-741c-4daa-9568-f7ddf95e3729',image_min_disk='1',image_min_ram='0',image_owner_id='7f583c975ad5427f8a6ea845d0e22f2e',image_owner_project_name='tempest-TestStampPattern-1309177845',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1309177845-project-member',image_user_id='6fe3ee5eb8fd41b08a813b53c4e3ec23',owner_project_name='tempest-TestStampPattern-1309177845',owner_user_name='tempest-TestStampPattern-1309177845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:18:13Z,user_data=None,user_id='6fe3ee5eb8fd41b08a813b53c4e3ec23',uuid=65977b9a-f812-44b8-b8dc-95c12e2f8a6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c40da641-e0b5-4077-959e-cd325f6475be", "address": "fa:16:3e:70:4a:cd", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40da641-e0", "ovs_interfaceid": "c40da641-e0b5-4077-959e-cd325f6475be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Converting VIF {"id": "c40da641-e0b5-4077-959e-cd325f6475be", "address": "fa:16:3e:70:4a:cd", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40da641-e0", "ovs_interfaceid": "c40da641-e0b5-4077-959e-cd325f6475be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:4a:cd,bridge_name='br-int',has_traffic_filtering=True,id=c40da641-e0b5-4077-959e-cd325f6475be,network=Network(1392d2f0-29b7-4293-bf52-5e004250332f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40da641-e0') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG os_vif [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:4a:cd,bridge_name='br-int',has_traffic_filtering=True,id=c40da641-e0b5-4077-959e-cd325f6475be,network=Network(1392d2f0-29b7-4293-bf52-5e004250332f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40da641-e0') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc40da641-e0, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=310426eb-7ff1-4505-b64c-2ad7d955dfaa) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:01 user nova-compute[75021]: INFO os_vif [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:4a:cd,bridge_name='br-int',has_traffic_filtering=True,id=c40da641-e0b5-4077-959e-cd325f6475be,network=Network(1392d2f0-29b7-4293-bf52-5e004250332f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40da641-e0')
Dec 06 07:21:01 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Deleting instance files /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d_del
Dec 06 07:21:01 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Deletion of /opt/stack/data/nova/instances/65977b9a-f812-44b8-b8dc-95c12e2f8a6d_del complete
Dec 06 07:21:01 user nova-compute[75021]: INFO nova.compute.manager [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 06 07:21:01 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:21:01 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Took 0.51 seconds to deallocate network for instance.
Dec 06 07:21:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-1940b87b-9e07-4a9a-9eb1-a5f7f687a849 req-519ad4bc-fec9-4e06-949a-8369e24f84d5 service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Received event network-vif-deleted-c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Refreshing inventories for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Updating ProviderTree inventory for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Updating inventory in ProviderTree for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Refreshing aggregate associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, aggregates: None {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 07:21:01 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Refreshing trait associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, traits: HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 07:21:02 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:21:02 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:21:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:02 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Deleted allocations for instance 65977b9a-f812-44b8-b8dc-95c12e2f8a6d
Dec 06 07:21:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d785995a-dbd9-4525-b1a1-d35c53e04e93 tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-968e0bdd-fb80-4394-b7bf-6470c3cd5d01 req-41a3382c-4c0d-4be0-aabc-66a9a30c0e54 service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Received event network-vif-plugged-c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:21:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-968e0bdd-fb80-4394-b7bf-6470c3cd5d01 req-41a3382c-4c0d-4be0-aabc-66a9a30c0e54 service nova] Acquiring lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-968e0bdd-fb80-4394-b7bf-6470c3cd5d01 req-41a3382c-4c0d-4be0-aabc-66a9a30c0e54 service nova] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-968e0bdd-fb80-4394-b7bf-6470c3cd5d01 req-41a3382c-4c0d-4be0-aabc-66a9a30c0e54 service nova] Lock "65977b9a-f812-44b8-b8dc-95c12e2f8a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-968e0bdd-fb80-4394-b7bf-6470c3cd5d01 req-41a3382c-4c0d-4be0-aabc-66a9a30c0e54 service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] No waiting events found dispatching network-vif-plugged-c40da641-e0b5-4077-959e-cd325f6475be {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:21:02 user nova-compute[75021]: WARNING nova.compute.manager [req-968e0bdd-fb80-4394-b7bf-6470c3cd5d01 req-41a3382c-4c0d-4be0-aabc-66a9a30c0e54 service nova] [instance: 65977b9a-f812-44b8-b8dc-95c12e2f8a6d] Received unexpected event network-vif-plugged-c40da641-e0b5-4077-959e-cd325f6475be for instance with vm_state deleted and task_state None.
Dec 06 07:21:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:21:11 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:21:14 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:21:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:21:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:21:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:21:14 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:21:14 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Updating instance_info_cache with network_info: [{"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:21:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-828f5456-6310-4664-87b3-ee0ed6787d3f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:21:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:21:14 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:21:14 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:21:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:14 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:21:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:21:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:21:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:21:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "1045c42c-85e8-46b9-ad58-124004244545" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:16 user nova-compute[75021]: INFO nova.compute.manager [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Detaching volume 3f3486fb-6e6a-4386-986f-1753fdee3f18
Dec 06 07:21:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:16 user nova-compute[75021]: INFO nova.virt.block_device [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Attempting to driver detach volume 3f3486fb-6e6a-4386-986f-1753fdee3f18 from mountpoint /dev/vdb
Dec 06 07:21:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Attempting to detach device vdb from instance 1045c42c-85e8-46b9-ad58-124004244545 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:21:16 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:21:16 user nova-compute[75021]:   <source dev="/dev/sdg"/>
Dec 06 07:21:16 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:21:16 user nova-compute[75021]:   <serial>3f3486fb-6e6a-4386-986f-1753fdee3f18</serial>
Dec 06 07:21:16 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:21:16 user nova-compute[75021]: </disk>
Dec 06 07:21:16 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:21:16 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Successfully detached device vdb from instance 1045c42c-85e8-46b9-ad58-124004244545 from the persistent domain config.
Dec 06 07:21:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1045c42c-85e8-46b9-ad58-124004244545 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:21:16 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:21:16 user nova-compute[75021]:   <source dev="/dev/sdg"/>
Dec 06 07:21:16 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:21:16 user nova-compute[75021]:   <serial>3f3486fb-6e6a-4386-986f-1753fdee3f18</serial>
Dec 06 07:21:16 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:21:16 user nova-compute[75021]: </disk>
Dec 06 07:21:16 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1045c42c-85e8-46b9-ad58-124004244545 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:21:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:17 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:21:17 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:21:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=7983MB free_disk=24.875709533691406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:21:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 58ef39ae-4b66-42e6-ae22-5308a98eb55d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 92c63579-741c-4daa-9568-f7ddf95e3729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 2064385e-a37f-468e-bed6-129eb54295ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a31eae43-b01c-46cf-9c06-13e9242b5fe1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 1045c42c-85e8-46b9-ad58-124004244545 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 17638711-6771-4b89-b0d0-231eeb1a9080 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:21:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:21:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:21:20 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:21:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:25 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:21:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:21:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "2064385e-a37f-468e-bed6-129eb54295ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "2064385e-a37f-468e-bed6-129eb54295ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "2064385e-a37f-468e-bed6-129eb54295ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:34 user nova-compute[75021]: INFO nova.compute.manager [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Terminating instance
Dec 06 07:21:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-38d51448-ba20-47e5-9606-3d94c849c52d req-515eace9-6904-42ec-8a96-d409e575432b service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received event network-vif-unplugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-38d51448-ba20-47e5-9606-3d94c849c52d req-515eace9-6904-42ec-8a96-d409e575432b service nova] Acquiring lock "2064385e-a37f-468e-bed6-129eb54295ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-38d51448-ba20-47e5-9606-3d94c849c52d req-515eace9-6904-42ec-8a96-d409e575432b service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-38d51448-ba20-47e5-9606-3d94c849c52d req-515eace9-6904-42ec-8a96-d409e575432b service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-38d51448-ba20-47e5-9606-3d94c849c52d req-515eace9-6904-42ec-8a96-d409e575432b service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] No waiting events found dispatching network-vif-unplugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-38d51448-ba20-47e5-9606-3d94c849c52d req-515eace9-6904-42ec-8a96-d409e575432b service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received event network-vif-unplugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:34 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Instance destroyed successfully.
Dec 06 07:21:34 user nova-compute[75021]: DEBUG nova.objects.instance [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'resources' on Instance uuid 2064385e-a37f-468e-bed6-129eb54295ae {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1457326660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1457326660',id=37,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:18:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9895e43bf76d4760a26a5e64ea6d4e14',ramdisk_id='',reservation_id='r-b1vuxe2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:19:48Z,user_data=None,user_id='c0774aa1e3ee4b69b195b575d116ee96',uuid=2064385e-a37f-468e-bed6-129eb54295ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "address": "fa:16:3e:d4:2a:27", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f8ce24-a9", "ovs_interfaceid": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converting VIF {"id": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "address": "fa:16:3e:d4:2a:27", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f8ce24-a9", "ovs_interfaceid": "19f8ce24-a977-46ee-a878-728ddc13a4e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:2a:27,bridge_name='br-int',has_traffic_filtering=True,id=19f8ce24-a977-46ee-a878-728ddc13a4e0,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f8ce24-a9') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG os_vif [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:2a:27,bridge_name='br-int',has_traffic_filtering=True,id=19f8ce24-a977-46ee-a878-728ddc13a4e0,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f8ce24-a9') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19f8ce24-a9, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a830e35a-190a-43a4-949c-41b0beffacd7) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:34 user nova-compute[75021]: INFO os_vif [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:2a:27,bridge_name='br-int',has_traffic_filtering=True,id=19f8ce24-a977-46ee-a878-728ddc13a4e0,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f8ce24-a9')
Dec 06 07:21:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZAMnyFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:21:34 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:21:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[764e01c6-bbec-4042-b0e4-d55f596c9571]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:21:34 user nova-compute[75021]: No targets found.
Dec 06 07:21:34 user nova-compute[75021]: iSNS:
Dec 06 07:21:34 user nova-compute[75021]: No targets found.
Dec 06 07:21:34 user nova-compute[75021]: STATIC:
Dec 06 07:21:34 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18
Dec 06 07:21:34 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:21:34 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:21:34 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:21:34 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:21:34 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:21:34 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c
Dec 06 07:21:34 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:21:34 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:21:34 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc
Dec 06 07:21:34 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:21:34 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:21:34 user nova-compute[75021]: FIRMWARE:
Dec 06 07:21:34 user nova-compute[75021]: No targets found.
Dec 06 07:21:34 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:21:34 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:21:34 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f50d64-c486-4068-888c-3a2e7232369e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bc771a-81da-486c-9b35-c04e2b1939b0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:21:34 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:21:34 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:21:34 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:21:34 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:21:34 user nova-compute[75021]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c (non-flash)
Dec 06 07:21:34 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:21:34 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:21:34 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b4528c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c'): ({'sde'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Removing single pathed devices sde {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e6fa9b-f717-4749-93a9-81e74433139c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e813c5c0-46c0-4c71-bcb6-e02244e4416a]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Flushing IO for device /dev/sde {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed48a780-6b39-46a4-8714-4be0ee471758]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d8400d-6c51-4d94-ab6a-c16efe553c1c]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26634393464306133', '/dev/disk/by-id/scsi-1SCST_BIO2362309-f494d0a3fd4f5a8f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2362309') {{(pid=86148) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 07:21:35 user nova-compute[75021]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26634393464306133
Dec 06 07:21:35 user nova-compute[75021]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO2362309-f494d0a3fd4f5a8f
Dec 06 07:21:35 user nova-compute[75021]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_2362309
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[482b16f8-e40a-490b-8ead-0e673824795a]: (4, None) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fc13b1-e411-4a69-a77d-ad6e70c09868]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[db687fdb-b641-4d5e-beda-942b188ed75e]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c, portal: 172.16.0.220,3260]
Dec 06 07:21:35 user nova-compute[75021]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c, portal: 172.16.0.220,3260] successful.
Dec 06 07:21:35 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bfe29a-a367-4b70-9d31-877ed682847c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b114a22-6121-46a0-b22b-07bce16bfcd7]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] <== disconnect_volume: return (317ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:21:35 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Deleting instance files /opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae_del
Dec 06 07:21:35 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Deletion of /opt/stack/data/nova/instances/2064385e-a37f-468e-bed6-129eb54295ae_del complete
Dec 06 07:21:35 user nova-compute[75021]: INFO nova.compute.manager [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Took 1.18 seconds to destroy the instance on the hypervisor.
Dec 06 07:21:35 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:21:35 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:21:35 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Took 0.44 seconds to deallocate network for instance.
Dec 06 07:21:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-aa4cd20d-4163-47b8-9367-feb675d3b58e req-9fad9381-f2a6-41d7-89d3-875d4da07cfe service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received event network-vif-deleted-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:21:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-2501752f-7f91-4c50-bb87-c46f715e2843 req-2117a0de-fc52-41ab-9337-b78379d41b2f service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:21:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2501752f-7f91-4c50-bb87-c46f715e2843 req-2117a0de-fc52-41ab-9337-b78379d41b2f service nova] Acquiring lock "2064385e-a37f-468e-bed6-129eb54295ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2501752f-7f91-4c50-bb87-c46f715e2843 req-2117a0de-fc52-41ab-9337-b78379d41b2f service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2501752f-7f91-4c50-bb87-c46f715e2843 req-2117a0de-fc52-41ab-9337-b78379d41b2f service nova] Lock "2064385e-a37f-468e-bed6-129eb54295ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-2501752f-7f91-4c50-bb87-c46f715e2843 req-2117a0de-fc52-41ab-9337-b78379d41b2f service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] No waiting events found dispatching network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:21:36 user nova-compute[75021]: WARNING nova.compute.manager [req-2501752f-7f91-4c50-bb87-c46f715e2843 req-2117a0de-fc52-41ab-9337-b78379d41b2f service nova] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Received unexpected event network-vif-plugged-19f8ce24-a977-46ee-a878-728ddc13a4e0 for instance with vm_state active and task_state deleting.
Dec 06 07:21:36 user nova-compute[75021]: INFO nova.compute.manager [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 2064385e-a37f-468e-bed6-129eb54295ae] Took 0.79 seconds to detach 1 volumes for instance.
Dec 06 07:21:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:36 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:21:36 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:21:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:36 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1045c42c-85e8-46b9-ad58-124004244545 is timed out.
Dec 06 07:21:36 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Successfully detached device vdb from instance 1045c42c-85e8-46b9-ad58-124004244545 from the live domain config.
Dec 06 07:21:36 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Deleted allocations for instance 2064385e-a37f-468e-bed6-129eb54295ae
Dec 06 07:21:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:21:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCoxhdPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:21:36 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:21:36 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[509624e1-0fd7-4bef-9eef-88c15615fab7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:21:37 user nova-compute[75021]: No targets found.
Dec 06 07:21:37 user nova-compute[75021]: iSNS:
Dec 06 07:21:37 user nova-compute[75021]: No targets found.
Dec 06 07:21:37 user nova-compute[75021]: STATIC:
Dec 06 07:21:37 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18
Dec 06 07:21:37 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:21:37 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:21:37 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:21:37 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:21:37 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:21:37 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc
Dec 06 07:21:37 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:21:37 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:21:37 user nova-compute[75021]: FIRMWARE:
Dec 06 07:21:37 user nova-compute[75021]: No targets found.
Dec 06 07:21:37 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:21:37 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:21:37 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae5c22c-9de5-48a4-86a2-1858d424591e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec692510-5081-4c92-a810-420db953b8c7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:21:37 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:21:37 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:21:37 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:21:37 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:21:37 user nova-compute[75021]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 (non-flash)
Dec 06 07:21:37 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b47cdd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18'): ({'sdg'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Removing single pathed devices sdg {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9034d38e-1cf0-415e-85b0-a5e0944db535]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-56f32a81-c31a-48d0-b0c2-c780938bc61e tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "2064385e-a37f-468e-bed6-129eb54295ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.021s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[858e683d-1749-4a13-805e-d018833e7f9a]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Flushing IO for device /dev/sdg {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[72669712-65e0-4bfd-a634-5f11b91f16ee]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.032s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde385bf-c0a5-42b2-a586-277eaa55924b]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] SCSI volumes sdg have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c4ade0-2f95-49fd-9b78-ac8ea696a866]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2396856-c43a-4ea4-8bdb-1de2bd508131]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18, portal: 172.16.0.220,3260]
Dec 06 07:21:37 user nova-compute[75021]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18, portal: 172.16.0.220,3260] successful.
Dec 06 07:21:37 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3486fb-6e6a-4386-986f-1753fdee3f18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[30141707-8025-43af-927f-d9b402e2cd00]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] <== disconnect_volume: return (297ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:21:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:21:38 user nova-compute[75021]: DEBUG nova.objects.instance [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lazy-loading 'flavor' on Instance uuid 1045c42c-85e8-46b9-ad58-124004244545 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:21:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-dfa4e841-c4f1-4160-87a3-2445196b92b6 tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.937s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-b26fca6b-992c-4ff1-90a6-c51bb7a24fa0 req-10a4dfcb-d199-4698-9e7f-5d31ffd9f885 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Received event network-changed-fee28653-2669-4e1f-9492-551ffa0fc228 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:21:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-b26fca6b-992c-4ff1-90a6-c51bb7a24fa0 req-10a4dfcb-d199-4698-9e7f-5d31ffd9f885 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Refreshing instance network info cache due to event network-changed-fee28653-2669-4e1f-9492-551ffa0fc228. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:21:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b26fca6b-992c-4ff1-90a6-c51bb7a24fa0 req-10a4dfcb-d199-4698-9e7f-5d31ffd9f885 service nova] Acquiring lock "refresh_cache-17638711-6771-4b89-b0d0-231eeb1a9080" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:21:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b26fca6b-992c-4ff1-90a6-c51bb7a24fa0 req-10a4dfcb-d199-4698-9e7f-5d31ffd9f885 service nova] Acquired lock "refresh_cache-17638711-6771-4b89-b0d0-231eeb1a9080" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:21:43 user nova-compute[75021]: DEBUG nova.network.neutron [req-b26fca6b-992c-4ff1-90a6-c51bb7a24fa0 req-10a4dfcb-d199-4698-9e7f-5d31ffd9f885 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Refreshing network info cache for port fee28653-2669-4e1f-9492-551ffa0fc228 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:21:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:44 user nova-compute[75021]: DEBUG nova.network.neutron [req-b26fca6b-992c-4ff1-90a6-c51bb7a24fa0 req-10a4dfcb-d199-4698-9e7f-5d31ffd9f885 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Updated VIF entry in instance network info cache for port fee28653-2669-4e1f-9492-551ffa0fc228. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:21:44 user nova-compute[75021]: DEBUG nova.network.neutron [req-b26fca6b-992c-4ff1-90a6-c51bb7a24fa0 req-10a4dfcb-d199-4698-9e7f-5d31ffd9f885 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Updating instance_info_cache with network_info: [{"id": "fee28653-2669-4e1f-9492-551ffa0fc228", "address": "fa:16:3e:dc:59:0a", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee28653-26", "ovs_interfaceid": "fee28653-2669-4e1f-9492-551ffa0fc228", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:21:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b26fca6b-992c-4ff1-90a6-c51bb7a24fa0 req-10a4dfcb-d199-4698-9e7f-5d31ffd9f885 service nova] Releasing lock "refresh_cache-17638711-6771-4b89-b0d0-231eeb1a9080" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:21:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:44 user nova-compute[75021]: INFO nova.compute.manager [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Terminating instance
Dec 06 07:21:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-a2b3d086-9a6e-4269-84f8-b4a4e7d4f95d req-ad3a077f-f31a-46da-872a-1c365320e2a9 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received event network-vif-unplugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a2b3d086-9a6e-4269-84f8-b4a4e7d4f95d req-ad3a077f-f31a-46da-872a-1c365320e2a9 service nova] Acquiring lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a2b3d086-9a6e-4269-84f8-b4a4e7d4f95d req-ad3a077f-f31a-46da-872a-1c365320e2a9 service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a2b3d086-9a6e-4269-84f8-b4a4e7d4f95d req-ad3a077f-f31a-46da-872a-1c365320e2a9 service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-a2b3d086-9a6e-4269-84f8-b4a4e7d4f95d req-ad3a077f-f31a-46da-872a-1c365320e2a9 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] No waiting events found dispatching network-vif-unplugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-a2b3d086-9a6e-4269-84f8-b4a4e7d4f95d req-ad3a077f-f31a-46da-872a-1c365320e2a9 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received event network-vif-unplugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Instance destroyed successfully.
Dec 06 07:21:45 user nova-compute[75021]: DEBUG nova.objects.instance [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lazy-loading 'resources' on Instance uuid a31eae43-b01c-46cf-9c06-13e9242b5fe1 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:15:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1372424050',display_name='tempest-ServerActionsTestOtherA-server-1372424050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1372424050',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbe4qUdep78TgBLG29O7GMFI0uEKESU+Xx64Y2G0xkh2EtccpxwWlafCMPJHygmaEQbyUAtZjD22PTzS9xqolPPxgkkpdNuHJ15mMhGsezfXPp1cLkefmXHoF6E+QYoeA==',key_name='tempest-keypair-34997867',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f011c1a70ac1465d8eb31e20850fdbad',ramdisk_id='',reservation_id='r-o2rbqj04',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1761792884',owner_user_name='tempest-ServerActionsTestOtherA-1761792884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:18:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3369c937ad24537a114a71eb4674750',uuid=a31eae43-b01c-46cf-9c06-13e9242b5fe1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converting VIF {"id": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "address": "fa:16:3e:81:38:94", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16e0c22-fb", "ovs_interfaceid": "a16e0c22-fbe2-4dff-87ed-813f89691a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:38:94,bridge_name='br-int',has_traffic_filtering=True,id=a16e0c22-fbe2-4dff-87ed-813f89691a4f,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16e0c22-fb') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_vif [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:38:94,bridge_name='br-int',has_traffic_filtering=True,id=a16e0c22-fbe2-4dff-87ed-813f89691a4f,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16e0c22-fb') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa16e0c22-fb, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b97fd02-5262-4b97-a39c-3cd31d93ec7a) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:45 user nova-compute[75021]: INFO os_vif [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:38:94,bridge_name='br-int',has_traffic_filtering=True,id=a16e0c22-fbe2-4dff-87ed-813f89691a4f,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16e0c22-fb')
Dec 06 07:21:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lfieSjZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:21:45 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[32901028-5faa-41ed-848a-42c843a78958]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:21:45 user nova-compute[75021]: No targets found.
Dec 06 07:21:45 user nova-compute[75021]: iSNS:
Dec 06 07:21:45 user nova-compute[75021]: No targets found.
Dec 06 07:21:45 user nova-compute[75021]: STATIC:
Dec 06 07:21:45 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:21:45 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:21:45 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:21:45 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc
Dec 06 07:21:45 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:21:45 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:21:45 user nova-compute[75021]: FIRMWARE:
Dec 06 07:21:45 user nova-compute[75021]: No targets found.
Dec 06 07:21:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:21:45 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:21:45 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e92e2fd-20c7-44c3-bc59-7a0f82861a45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[56556986-387d-4c2d-934e-79f9ba504d3b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:21:45 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:21:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:21:45 user nova-compute[75021]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc (non-flash)
Dec 06 07:21:45 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d851d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc'): ({'sdc'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Removing single pathed devices sdc {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[311600dd-deea-4bdc-a2bd-988680f9ea44]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedcc6fc-be89-446d-865d-13a75e83397b]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Flushing IO for device /dev/sdc {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53d374b-0f82-4182-9b2f-ae1456b1a104]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fd8fb7-b2d8-4829-bd29-2aa069a5c6ff]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb27f8cb-51c7-457b-88d9-0ce5f9300e3f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[270c4769-3d8e-4de8-835f-f189ff4f6e0a]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260]
Dec 06 07:21:46 user nova-compute[75021]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc, portal: 172.16.0.220,3260] successful.
Dec 06 07:21:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb71e11-36d0-44fe-9fcd-d2c2652e38fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c274a72f-d567-4e56-804b-2bfac3358fe7]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:21:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] <== disconnect_volume: return (305ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:21:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:21:46 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Deleting instance files /opt/stack/data/nova/instances/a31eae43-b01c-46cf-9c06-13e9242b5fe1_del
Dec 06 07:21:46 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Deletion of /opt/stack/data/nova/instances/a31eae43-b01c-46cf-9c06-13e9242b5fe1_del complete
Dec 06 07:21:46 user nova-compute[75021]: INFO nova.compute.manager [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Took 1.17 seconds to destroy the instance on the hypervisor.
Dec 06 07:21:46 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:21:46 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:21:46 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:21:46 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:21:46 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Took 0.80 seconds to deallocate network for instance.
Dec 06 07:21:46 user nova-compute[75021]: DEBUG nova.compute.manager [req-909c03bc-3e7a-4219-89c3-83f3c44e41be req-1353f275-6a0f-417e-aabb-2924e8912457 service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received event network-vif-deleted-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-c5c0aef9-7b4f-4fe7-a363-d061f08dab1c req-4e218cdb-cde3-4991-a81f-2b25c0a417fb service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received event network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c5c0aef9-7b4f-4fe7-a363-d061f08dab1c req-4e218cdb-cde3-4991-a81f-2b25c0a417fb service nova] Acquiring lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c5c0aef9-7b4f-4fe7-a363-d061f08dab1c req-4e218cdb-cde3-4991-a81f-2b25c0a417fb service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c5c0aef9-7b4f-4fe7-a363-d061f08dab1c req-4e218cdb-cde3-4991-a81f-2b25c0a417fb service nova] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-c5c0aef9-7b4f-4fe7-a363-d061f08dab1c req-4e218cdb-cde3-4991-a81f-2b25c0a417fb service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] No waiting events found dispatching network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:21:47 user nova-compute[75021]: WARNING nova.compute.manager [req-c5c0aef9-7b4f-4fe7-a363-d061f08dab1c req-4e218cdb-cde3-4991-a81f-2b25c0a417fb service nova] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Received unexpected event network-vif-plugged-a16e0c22-fbe2-4dff-87ed-813f89691a4f for instance with vm_state active and task_state deleting.
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "17638711-6771-4b89-b0d0-231eeb1a9080" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "17638711-6771-4b89-b0d0-231eeb1a9080" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'flavor' on Instance uuid 17638711-6771-4b89-b0d0-231eeb1a9080 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "17638711-6771-4b89-b0d0-231eeb1a9080" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "17638711-6771-4b89-b0d0-231eeb1a9080" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "17638711-6771-4b89-b0d0-231eeb1a9080" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:47 user nova-compute[75021]: INFO nova.compute.manager [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Attaching volume a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd to /dev/vdb
Dec 06 07:21:47 user nova-compute[75021]: INFO nova.compute.manager [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Took 0.78 seconds to detach 1 volumes for instance.
Dec 06 07:21:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: a31eae43-b01c-46cf-9c06-13e9242b5fe1] Deleting volume: acb71e11-36d0-44fe-9fcd-d2c2652e38fc {{(pid=75021) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG os_brick.utils [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6ff9dc-6ee1-47d6-9298-220255302e2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bca4c31-ca6a-458e-bbef-e530f7ee2a96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97c60a5-3751-4c5c-92e5-362bf7a0311d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[679535c2-25ce-448d-9af8-6307801c4168]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:21:47 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:21:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f10256-03d4-4ffe-8643-86616400d663]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG os_brick.utils [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:21:47 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Updating existing volume attachment record: 94b8eb7e-4b9d-4b93-9e42-f4c9c237f78b {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:21:48 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:21:48 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:21:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:48 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Deleted allocations for instance a31eae43-b01c-46cf-9c06-13e9242b5fe1
Dec 06 07:21:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-95c9816c-de7a-467b-aa10-74b185934bb4 tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "a31eae43-b01c-46cf-9c06-13e9242b5fe1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.336s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGSeaZuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:21:57 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:21:57 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:21:57 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffa935e-60af-4fa7-b6fa-d53e091b1513]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:21:57 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58148e6-dc14-42ee-81f2-82330208693f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd] added
Dec 06 07:21:57 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[08911f40-6ba3-4f02-b98a-652e8f11e409]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2317ae-f3be-4a6d-8018-4e00bfd9f4fa]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGSeaZuc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGSeaZuc" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[04989bf1-9cfa-4f79-8a6c-4bfd7047eae1]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nGSeaZuc'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b340d42e-bc24-4216-8908-ba3459beacaa]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd022523-d4b9-4c06-843c-23dac8b7bdb2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:21:57 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:21:57 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[76052f76-0656-4493-8356-c679575d48de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd, portal: 172.16.0.220,3260]
Dec 06 07:21:57 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd, portal: 172.16.0.220,3260] successful.
Dec 06 07:21:57 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd82cae4-057a-413d-8287-af55aa449e90]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e97487f-80fc-4b12-b7fa-9d8669798de3]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:21:57 user nova-compute[75021]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd (non-flash)
Dec 06 07:21:57 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:21:57 user nova-compute[75021]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd (non-flash)
Dec 06 07:21:57 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eade085-c4e0-4c46-b0f8-24622b31c723]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:21:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:21:58 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:21:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGSeaZuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:21:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:21:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23431353337326233', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:21:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431353337326233', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:21:58 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'flavor' on Instance uuid 17638711-6771-4b89-b0d0-231eeb1a9080 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:21:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:21:58 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:21:58 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:21:58 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:21:58 user nova-compute[75021]:   <serial>a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd</serial>
Dec 06 07:21:58 user nova-compute[75021]: </disk>
Dec 06 07:21:58 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:21:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:21:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:21:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] No VIF found with MAC fa:16:3e:dc:59:0a, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:21:58 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fd1187d6-1682-4549-a6ca-31571dd50438 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "17638711-6771-4b89-b0d0-231eeb1a9080" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.252s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:21:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:21:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "17638711-6771-4b89-b0d0-231eeb1a9080" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:21:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "17638711-6771-4b89-b0d0-231eeb1a9080" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:21:59 user nova-compute[75021]: INFO nova.compute.manager [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Detaching volume a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd
Dec 06 07:21:59 user nova-compute[75021]: INFO nova.virt.block_device [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Attempting to driver detach volume a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd from mountpoint /dev/vdb
Dec 06 07:21:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Attempting to detach device vdb from instance 17638711-6771-4b89-b0d0-231eeb1a9080 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:21:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:21:59 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:21:59 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:21:59 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:21:59 user nova-compute[75021]:   <serial>a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd</serial>
Dec 06 07:21:59 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:21:59 user nova-compute[75021]: </disk>
Dec 06 07:21:59 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:21:59 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Successfully detached device vdb from instance 17638711-6771-4b89-b0d0-231eeb1a9080 from the persistent domain config.
Dec 06 07:21:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17638711-6771-4b89-b0d0-231eeb1a9080 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:21:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:21:59 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:21:59 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:21:59 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:21:59 user nova-compute[75021]:   <serial>a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd</serial>
Dec 06 07:21:59 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:21:59 user nova-compute[75021]: </disk>
Dec 06 07:21:59 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:22:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17638711-6771-4b89-b0d0-231eeb1a9080 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:22:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-3e4d6925-98dd-46f7-9f8d-a46b6c725d77 req-aa39537e-1682-4fef-8113-3f005df77705 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Received event network-changed-5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-3e4d6925-98dd-46f7-9f8d-a46b6c725d77 req-aa39537e-1682-4fef-8113-3f005df77705 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Refreshing instance network info cache due to event network-changed-5ddd7dff-61be-4d5a-9bc4-7242cb57920d. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3e4d6925-98dd-46f7-9f8d-a46b6c725d77 req-aa39537e-1682-4fef-8113-3f005df77705 service nova] Acquiring lock "refresh_cache-92c63579-741c-4daa-9568-f7ddf95e3729" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3e4d6925-98dd-46f7-9f8d-a46b6c725d77 req-aa39537e-1682-4fef-8113-3f005df77705 service nova] Acquired lock "refresh_cache-92c63579-741c-4daa-9568-f7ddf95e3729" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG nova.network.neutron [req-3e4d6925-98dd-46f7-9f8d-a46b6c725d77 req-aa39537e-1682-4fef-8113-3f005df77705 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Refreshing network info cache for port 5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "92c63579-741c-4daa-9568-f7ddf95e3729" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "92c63579-741c-4daa-9568-f7ddf95e3729" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "92c63579-741c-4daa-9568-f7ddf95e3729-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "92c63579-741c-4daa-9568-f7ddf95e3729-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "92c63579-741c-4daa-9568-f7ddf95e3729-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:02 user nova-compute[75021]: INFO nova.compute.manager [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Terminating instance
Dec 06 07:22:02 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG nova.network.neutron [req-3e4d6925-98dd-46f7-9f8d-a46b6c725d77 req-aa39537e-1682-4fef-8113-3f005df77705 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Updated VIF entry in instance network info cache for port 5ddd7dff-61be-4d5a-9bc4-7242cb57920d. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG nova.network.neutron [req-3e4d6925-98dd-46f7-9f8d-a46b6c725d77 req-aa39537e-1682-4fef-8113-3f005df77705 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Updating instance_info_cache with network_info: [{"id": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "address": "fa:16:3e:ab:18:19", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddd7dff-61", "ovs_interfaceid": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:22:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-3e4d6925-98dd-46f7-9f8d-a46b6c725d77 req-aa39537e-1682-4fef-8113-3f005df77705 service nova] Releasing lock "refresh_cache-92c63579-741c-4daa-9568-f7ddf95e3729" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:22:03 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Instance destroyed successfully.
Dec 06 07:22:03 user nova-compute[75021]: DEBUG nova.objects.instance [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lazy-loading 'resources' on Instance uuid 92c63579-741c-4daa-9568-f7ddf95e3729 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1415493547',display_name='tempest-TestStampPattern-server-1415493547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1415493547',id=34,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg8IGkXaXCpoLXuv1QgPTQlIboH6YGAoE4h1LpIm9THcogGNb2pCBJ53/n7DkXcaYeQRE+8kERBbD6EPJISjHNebvAB2igEJJMWl/apA8rqHLtvdqFZ90Vp+dBW6ln6vA==',key_name='tempest-TestStampPattern-2114891316',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f583c975ad5427f8a6ea845d0e22f2e',ramdisk_id='',reservation_id='r-oojjzzbr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1309177845',owner_user_name='tempest-TestStampPattern-1309177845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:17:59Z,user_data=None,user_id='6fe3ee5eb8fd41b08a813b53c4e3ec23',uuid=92c63579-741c-4daa-9568-f7ddf95e3729,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "address": "fa:16:3e:ab:18:19", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddd7dff-61", "ovs_interfaceid": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Converting VIF {"id": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "address": "fa:16:3e:ab:18:19", "network": {"id": "1392d2f0-29b7-4293-bf52-5e004250332f", "bridge": "br-int", "label": "tempest-TestStampPattern-541969594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f583c975ad5427f8a6ea845d0e22f2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddd7dff-61", "ovs_interfaceid": "5ddd7dff-61be-4d5a-9bc4-7242cb57920d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:18:19,bridge_name='br-int',has_traffic_filtering=True,id=5ddd7dff-61be-4d5a-9bc4-7242cb57920d,network=Network(1392d2f0-29b7-4293-bf52-5e004250332f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ddd7dff-61') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG os_vif [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:18:19,bridge_name='br-int',has_traffic_filtering=True,id=5ddd7dff-61be-4d5a-9bc4-7242cb57920d,network=Network(1392d2f0-29b7-4293-bf52-5e004250332f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ddd7dff-61') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ddd7dff-61, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1732b861-487b-4011-bbdf-f05470c901ec) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:03 user nova-compute[75021]: INFO os_vif [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:18:19,bridge_name='br-int',has_traffic_filtering=True,id=5ddd7dff-61be-4d5a-9bc4-7242cb57920d,network=Network(1392d2f0-29b7-4293-bf52-5e004250332f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ddd7dff-61')
Dec 06 07:22:03 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Deleting instance files /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729_del
Dec 06 07:22:03 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Deletion of /opt/stack/data/nova/instances/92c63579-741c-4daa-9568-f7ddf95e3729_del complete
Dec 06 07:22:03 user nova-compute[75021]: INFO nova.compute.manager [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 06 07:22:03 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:22:03 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:22:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-5ea08036-d242-4fd4-9e06-bbeca5be2307 req-3cc56854-ec0e-4e19-8e0b-b7a05b0ec3e4 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Received event network-vif-deleted-5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:04 user nova-compute[75021]: INFO nova.compute.manager [req-5ea08036-d242-4fd4-9e06-bbeca5be2307 req-3cc56854-ec0e-4e19-8e0b-b7a05b0ec3e4 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Neutron deleted interface 5ddd7dff-61be-4d5a-9bc4-7242cb57920d; detaching it from the instance and deleting it from the info cache
Dec 06 07:22:04 user nova-compute[75021]: DEBUG nova.network.neutron [req-5ea08036-d242-4fd4-9e06-bbeca5be2307 req-3cc56854-ec0e-4e19-8e0b-b7a05b0ec3e4 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:22:04 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Took 0.54 seconds to deallocate network for instance.
Dec 06 07:22:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-5ea08036-d242-4fd4-9e06-bbeca5be2307 req-3cc56854-ec0e-4e19-8e0b-b7a05b0ec3e4 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Detach interface failed, port_id=5ddd7dff-61be-4d5a-9bc4-7242cb57920d, reason: Instance 92c63579-741c-4daa-9568-f7ddf95e3729 could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 07:22:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:04 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:22:04 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:22:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:04 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Deleted allocations for instance 92c63579-741c-4daa-9568-f7ddf95e3729
Dec 06 07:22:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0131d674-a045-4f90-9810-41629f2118ad tempest-TestStampPattern-1309177845 tempest-TestStampPattern-1309177845-project-member] Lock "92c63579-741c-4daa-9568-f7ddf95e3729" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.900s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-f92f25fc-bd06-4717-bbd7-b210804d040b req-03450c4c-d58b-42a9-8da3-38d32341c6c3 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Received event network-vif-unplugged-5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f92f25fc-bd06-4717-bbd7-b210804d040b req-03450c4c-d58b-42a9-8da3-38d32341c6c3 service nova] Acquiring lock "92c63579-741c-4daa-9568-f7ddf95e3729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f92f25fc-bd06-4717-bbd7-b210804d040b req-03450c4c-d58b-42a9-8da3-38d32341c6c3 service nova] Lock "92c63579-741c-4daa-9568-f7ddf95e3729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f92f25fc-bd06-4717-bbd7-b210804d040b req-03450c4c-d58b-42a9-8da3-38d32341c6c3 service nova] Lock "92c63579-741c-4daa-9568-f7ddf95e3729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-f92f25fc-bd06-4717-bbd7-b210804d040b req-03450c4c-d58b-42a9-8da3-38d32341c6c3 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] No waiting events found dispatching network-vif-unplugged-5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:22:04 user nova-compute[75021]: WARNING nova.compute.manager [req-f92f25fc-bd06-4717-bbd7-b210804d040b req-03450c4c-d58b-42a9-8da3-38d32341c6c3 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Received unexpected event network-vif-unplugged-5ddd7dff-61be-4d5a-9bc4-7242cb57920d for instance with vm_state deleted and task_state None.
Dec 06 07:22:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-f92f25fc-bd06-4717-bbd7-b210804d040b req-03450c4c-d58b-42a9-8da3-38d32341c6c3 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Received event network-vif-plugged-5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f92f25fc-bd06-4717-bbd7-b210804d040b req-03450c4c-d58b-42a9-8da3-38d32341c6c3 service nova] Acquiring lock "92c63579-741c-4daa-9568-f7ddf95e3729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f92f25fc-bd06-4717-bbd7-b210804d040b req-03450c4c-d58b-42a9-8da3-38d32341c6c3 service nova] Lock "92c63579-741c-4daa-9568-f7ddf95e3729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f92f25fc-bd06-4717-bbd7-b210804d040b req-03450c4c-d58b-42a9-8da3-38d32341c6c3 service nova] Lock "92c63579-741c-4daa-9568-f7ddf95e3729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-f92f25fc-bd06-4717-bbd7-b210804d040b req-03450c4c-d58b-42a9-8da3-38d32341c6c3 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] No waiting events found dispatching network-vif-plugged-5ddd7dff-61be-4d5a-9bc4-7242cb57920d {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:22:04 user nova-compute[75021]: WARNING nova.compute.manager [req-f92f25fc-bd06-4717-bbd7-b210804d040b req-03450c4c-d58b-42a9-8da3-38d32341c6c3 service nova] [instance: 92c63579-741c-4daa-9568-f7ddf95e3729] Received unexpected event network-vif-plugged-5ddd7dff-61be-4d5a-9bc4-7242cb57920d for instance with vm_state deleted and task_state None.
Dec 06 07:22:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "1045c42c-85e8-46b9-ad58-124004244545" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "1045c42c-85e8-46b9-ad58-124004244545-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:06 user nova-compute[75021]: INFO nova.compute.manager [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Terminating instance
Dec 06 07:22:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:22:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-437ddb8f-357b-4404-b0ad-3138b337e225 req-9b25d7ea-b523-448f-ad72-a24a98d59619 service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Received event network-vif-unplugged-17d6b8c2-69b7-43de-b142-6a5015d774ef {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-437ddb8f-357b-4404-b0ad-3138b337e225 req-9b25d7ea-b523-448f-ad72-a24a98d59619 service nova] Acquiring lock "1045c42c-85e8-46b9-ad58-124004244545-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-437ddb8f-357b-4404-b0ad-3138b337e225 req-9b25d7ea-b523-448f-ad72-a24a98d59619 service nova] Lock "1045c42c-85e8-46b9-ad58-124004244545-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-437ddb8f-357b-4404-b0ad-3138b337e225 req-9b25d7ea-b523-448f-ad72-a24a98d59619 service nova] Lock "1045c42c-85e8-46b9-ad58-124004244545-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-437ddb8f-357b-4404-b0ad-3138b337e225 req-9b25d7ea-b523-448f-ad72-a24a98d59619 service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] No waiting events found dispatching network-vif-unplugged-17d6b8c2-69b7-43de-b142-6a5015d774ef {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-437ddb8f-357b-4404-b0ad-3138b337e225 req-9b25d7ea-b523-448f-ad72-a24a98d59619 service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Received event network-vif-unplugged-17d6b8c2-69b7-43de-b142-6a5015d774ef for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:22:07 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Instance destroyed successfully.
Dec 06 07:22:07 user nova-compute[75021]: DEBUG nova.objects.instance [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lazy-loading 'resources' on Instance uuid 1045c42c-85e8-46b9-ad58-124004244545 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:18:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-195134945',display_name='tempest-TestServerVolumeAttachmentScenario-server-195134945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-195134945',id=39,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+S7w+R1LKvpJUDeB6lUA4IfI1BM6vLADflzcRCHHHLcYhPEbDkakj3hiHUFPfNjqTPRUgmfOU6Do9g+kfgPxWhbpUdzcQrOa7ZMQPr3wfTA3K6dKP7kY9xPOwSHUZAkQ==',key_name='tempest-keypair-640378619',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23503d0dbe8d4fecb75c457a20a5909d',ramdisk_id='',reservation_id='r-pydhi2lb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-414613911',owner_user_name='tempest-TestServerVolumeAttachmentScenario-414613911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:18:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40060f0208274a93a4b51d49ea49b0ff',uuid=1045c42c-85e8-46b9-ad58-124004244545,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "address": "fa:16:3e:b5:01:eb", "network": {"id": "f1e69964-2fda-415d-b583-02725df10e58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1091928512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23503d0dbe8d4fecb75c457a20a5909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6b8c2-69", "ovs_interfaceid": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Converting VIF {"id": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "address": "fa:16:3e:b5:01:eb", "network": {"id": "f1e69964-2fda-415d-b583-02725df10e58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1091928512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23503d0dbe8d4fecb75c457a20a5909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17d6b8c2-69", "ovs_interfaceid": "17d6b8c2-69b7-43de-b142-6a5015d774ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:01:eb,bridge_name='br-int',has_traffic_filtering=True,id=17d6b8c2-69b7-43de-b142-6a5015d774ef,network=Network(f1e69964-2fda-415d-b583-02725df10e58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6b8c2-69') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG os_vif [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:01:eb,bridge_name='br-int',has_traffic_filtering=True,id=17d6b8c2-69b7-43de-b142-6a5015d774ef,network=Network(f1e69964-2fda-415d-b583-02725df10e58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6b8c2-69') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17d6b8c2-69, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=723567dc-b40b-4034-83f7-0283261e0237) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:07 user nova-compute[75021]: INFO os_vif [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:01:eb,bridge_name='br-int',has_traffic_filtering=True,id=17d6b8c2-69b7-43de-b142-6a5015d774ef,network=Network(f1e69964-2fda-415d-b583-02725df10e58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17d6b8c2-69')
Dec 06 07:22:07 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Deleting instance files /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545_del
Dec 06 07:22:07 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Deletion of /opt/stack/data/nova/instances/1045c42c-85e8-46b9-ad58-124004244545_del complete
Dec 06 07:22:07 user nova-compute[75021]: INFO nova.compute.manager [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Took 0.91 seconds to destroy the instance on the hypervisor.
Dec 06 07:22:07 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:22:07 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 1045c42c-85e8-46b9-ad58-124004244545] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.objects.instance [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'flavor' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquired lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.network.neutron [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.objects.instance [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'info_cache' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.objects.base [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Object Instance<0dc18c93-5a40-4c98-a6bf-7422e45b245d> lazy-loaded attributes: flavor,info_cache {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:22:08 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Took 0.77 seconds to deallocate network for instance.
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-b2e42a4c-2612-456d-b485-ceea4699c5ae req-27120bea-6805-4300-a1aa-d4494504f166 service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Received event network-vif-deleted-17d6b8c2-69b7-43de-b142-6a5015d774ef {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:08 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Deleted allocations for instance 1045c42c-85e8-46b9-ad58-124004244545
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.network.neutron [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Updating instance_info_cache with network_info: [{"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Releasing lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f558555b-d205-4489-a3cc-150c1ef1591f tempest-TestServerVolumeAttachmentScenario-414613911 tempest-TestServerVolumeAttachmentScenario-414613911-project-member] Lock "1045c42c-85e8-46b9-ad58-124004244545" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.185s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:08 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Instance destroyed successfully.
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.objects.instance [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'resources' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.objects.base [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Object Instance<0dc18c93-5a40-4c98-a6bf-7422e45b245d> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-964895959',display_name='tempest-AttachVolumeTestJSON-server-964895959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-964895959',id=33,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXnsp33Va88K9HMduz0isu8LdTEYh6ifTevR8F0QY6TmOty18bkV5GKJPhgdUF5uYfbmmBq+t2VYhMvKtNZZK1CejSjAntwpRgpOFPsHdEq6Y3WTe/qlOipA1Kn8ihHeQ==',key_name='tempest-keypair-645111669',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:14:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f0a2ff3d04db4832a990891c79df356c',ramdisk_id='',reservation_id='r-9za7bkf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280062788',owner_user_name='tempest-AttachVolumeTestJSON-280062788-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:20:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9947f4c20feb463fb485de2a7d4bbef5',uuid=0dc18c93-5a40-4c98-a6bf-7422e45b245d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converting VIF {"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG os_vif [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac69c289-81, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea6285b1-12b1-4198-8498-971f0f18edd7) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:08 user nova-compute[75021]: INFO os_vif [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81')
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Start _get_guest_xml network_info=[{"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.objects.instance [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'numa_topology' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.objects.base [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Object Instance<0dc18c93-5a40-4c98-a6bf-7422e45b245d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:22:08 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:22:08 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.objects.instance [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.objects.base [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Object Instance<0dc18c93-5a40-4c98-a6bf-7422e45b245d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-964895959',display_name='tempest-AttachVolumeTestJSON-server-964895959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-964895959',id=33,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXnsp33Va88K9HMduz0isu8LdTEYh6ifTevR8F0QY6TmOty18bkV5GKJPhgdUF5uYfbmmBq+t2VYhMvKtNZZK1CejSjAntwpRgpOFPsHdEq6Y3WTe/qlOipA1Kn8ihHeQ==',key_name='tempest-keypair-645111669',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:14:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f0a2ff3d04db4832a990891c79df356c',ramdisk_id='',reservation_id='r-9za7bkf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280062788',owner_user_name='tempest-AttachVolumeTestJSON-280062788-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:20:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9947f4c20feb463fb485de2a7d4bbef5',uuid=0dc18c93-5a40-4c98-a6bf-7422e45b245d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converting VIF {"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.objects.instance [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.objects.base [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Object Instance<0dc18c93-5a40-4c98-a6bf-7422e45b245d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:22:08 user nova-compute[75021]:   <uuid>0dc18c93-5a40-4c98-a6bf-7422e45b245d</uuid>
Dec 06 07:22:08 user nova-compute[75021]:   <name>instance-00000021</name>
Dec 06 07:22:08 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:22:08 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:22:08 user nova-compute[75021]:   <metadata>
Dec 06 07:22:08 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:22:08 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:22:08 user nova-compute[75021]:       <nova:name>tempest-AttachVolumeTestJSON-server-964895959</nova:name>
Dec 06 07:22:08 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:22:08</nova:creationTime>
Dec 06 07:22:08 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:22:08 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:22:08 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:22:08 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:22:08 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:22:08 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:22:08 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:22:08 user nova-compute[75021]:       <nova:owner>
Dec 06 07:22:08 user nova-compute[75021]:         <nova:user uuid="9947f4c20feb463fb485de2a7d4bbef5">tempest-AttachVolumeTestJSON-280062788-project-member</nova:user>
Dec 06 07:22:08 user nova-compute[75021]:         <nova:project uuid="f0a2ff3d04db4832a990891c79df356c">tempest-AttachVolumeTestJSON-280062788</nova:project>
Dec 06 07:22:08 user nova-compute[75021]:       </nova:owner>
Dec 06 07:22:08 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:22:08 user nova-compute[75021]:       <nova:ports>
Dec 06 07:22:08 user nova-compute[75021]:         <nova:port uuid="ac69c289-818f-48bb-a95e-2e72646ef67e">
Dec 06 07:22:08 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 07:22:08 user nova-compute[75021]:         </nova:port>
Dec 06 07:22:08 user nova-compute[75021]:       </nova:ports>
Dec 06 07:22:08 user nova-compute[75021]:     </nova:instance>
Dec 06 07:22:08 user nova-compute[75021]:   </metadata>
Dec 06 07:22:08 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:22:08 user nova-compute[75021]:     <system>
Dec 06 07:22:08 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:22:08 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:22:08 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:22:08 user nova-compute[75021]:       <entry name="serial">0dc18c93-5a40-4c98-a6bf-7422e45b245d</entry>
Dec 06 07:22:08 user nova-compute[75021]:       <entry name="uuid">0dc18c93-5a40-4c98-a6bf-7422e45b245d</entry>
Dec 06 07:22:08 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:22:08 user nova-compute[75021]:     </system>
Dec 06 07:22:08 user nova-compute[75021]:   </sysinfo>
Dec 06 07:22:08 user nova-compute[75021]:   <os>
Dec 06 07:22:08 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:22:08 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:22:08 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:22:08 user nova-compute[75021]:   </os>
Dec 06 07:22:08 user nova-compute[75021]:   <features>
Dec 06 07:22:08 user nova-compute[75021]:     <acpi/>
Dec 06 07:22:08 user nova-compute[75021]:     <apic/>
Dec 06 07:22:08 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:22:08 user nova-compute[75021]:   </features>
Dec 06 07:22:08 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:22:08 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:22:08 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:22:08 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:22:08 user nova-compute[75021]:   </clock>
Dec 06 07:22:08 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:22:08 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:22:08 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:22:08 user nova-compute[75021]:   </cpu>
Dec 06 07:22:08 user nova-compute[75021]:   <devices>
Dec 06 07:22:08 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:22:08 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:22:08 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk"/>
Dec 06 07:22:08 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:22:08 user nova-compute[75021]:     </disk>
Dec 06 07:22:08 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:22:08 user nova-compute[75021]:       <mac address="fa:16:3e:4f:e9:89"/>
Dec 06 07:22:08 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:22:08 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:22:08 user nova-compute[75021]:       <target dev="tapac69c289-81"/>
Dec 06 07:22:08 user nova-compute[75021]:     </interface>
Dec 06 07:22:08 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:22:08 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/console.log" append="off"/>
Dec 06 07:22:08 user nova-compute[75021]:     </serial>
Dec 06 07:22:08 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:22:08 user nova-compute[75021]:     <video>
Dec 06 07:22:08 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:22:08 user nova-compute[75021]:     </video>
Dec 06 07:22:08 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:22:08 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:22:08 user nova-compute[75021]:     </rng>
Dec 06 07:22:08 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:22:08 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:22:08 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:22:08 user nova-compute[75021]:     </memballoon>
Dec 06 07:22:08 user nova-compute[75021]:   </devices>
Dec 06 07:22:08 user nova-compute[75021]: </domain>
Dec 06 07:22:08 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:22:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-68fe9326-94de-4306-aa79-22b6d8cf1fd7 req-de3bc17f-4b02-4909-a533-c6c352b2dc5e service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Received event network-vif-plugged-17d6b8c2-69b7-43de-b142-6a5015d774ef {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-68fe9326-94de-4306-aa79-22b6d8cf1fd7 req-de3bc17f-4b02-4909-a533-c6c352b2dc5e service nova] Acquiring lock "1045c42c-85e8-46b9-ad58-124004244545-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-68fe9326-94de-4306-aa79-22b6d8cf1fd7 req-de3bc17f-4b02-4909-a533-c6c352b2dc5e service nova] Lock "1045c42c-85e8-46b9-ad58-124004244545-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-68fe9326-94de-4306-aa79-22b6d8cf1fd7 req-de3bc17f-4b02-4909-a533-c6c352b2dc5e service nova] Lock "1045c42c-85e8-46b9-ad58-124004244545-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG nova.compute.manager [req-68fe9326-94de-4306-aa79-22b6d8cf1fd7 req-de3bc17f-4b02-4909-a533-c6c352b2dc5e service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] No waiting events found dispatching network-vif-plugged-17d6b8c2-69b7-43de-b142-6a5015d774ef {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:22:09 user nova-compute[75021]: WARNING nova.compute.manager [req-68fe9326-94de-4306-aa79-22b6d8cf1fd7 req-de3bc17f-4b02-4909-a533-c6c352b2dc5e service nova] [instance: 1045c42c-85e8-46b9-ad58-124004244545] Received unexpected event network-vif-plugged-17d6b8c2-69b7-43de-b142-6a5015d774ef for instance with vm_state deleted and task_state None.
Dec 06 07:22:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG nova.objects.instance [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG nova.objects.base [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Object Instance<0dc18c93-5a40-4c98-a6bf-7422e45b245d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.170s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Cannot resize image /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG nova.objects.instance [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'migration_context' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG nova.objects.base [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Object Instance<0dc18c93-5a40-4c98-a6bf-7422e45b245d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-964895959',display_name='tempest-AttachVolumeTestJSON-server-964895959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-964895959',id=33,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXnsp33Va88K9HMduz0isu8LdTEYh6ifTevR8F0QY6TmOty18bkV5GKJPhgdUF5uYfbmmBq+t2VYhMvKtNZZK1CejSjAntwpRgpOFPsHdEq6Y3WTe/qlOipA1Kn8ihHeQ==',key_name='tempest-keypair-645111669',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:14:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f0a2ff3d04db4832a990891c79df356c',ramdisk_id='',reservation_id='r-9za7bkf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280062788',owner_user_name='tempest-AttachVolumeTestJSON-280062788-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:20:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9947f4c20feb463fb485de2a7d4bbef5',uuid=0dc18c93-5a40-4c98-a6bf-7422e45b245d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converting VIF {"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG os_vif [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4ed3d22-b952-5c98-80b7-3eb177e4b1bb', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac69c289-81, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac69c289-81, col_values=(('qos', UUID('2a29349d-5630-466d-9d0c-09468edb2070')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac69c289-81, col_values=(('external_ids', {'iface-id': 'ac69c289-818f-48bb-a95e-2e72646ef67e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:e9:89', 'vm-uuid': '0dc18c93-5a40-4c98-a6bf-7422e45b245d'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:22:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:09 user nova-compute[75021]: INFO os_vif [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81')
Dec 06 07:22:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:11 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:22:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-c465b2ef-2ce1-4add-812e-e6904f01837c req-cecb2c7e-26ad-4aeb-947b-cfe16eb29d78 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c465b2ef-2ce1-4add-812e-e6904f01837c req-cecb2c7e-26ad-4aeb-947b-cfe16eb29d78 service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c465b2ef-2ce1-4add-812e-e6904f01837c req-cecb2c7e-26ad-4aeb-947b-cfe16eb29d78 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c465b2ef-2ce1-4add-812e-e6904f01837c req-cecb2c7e-26ad-4aeb-947b-cfe16eb29d78 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:11 user nova-compute[75021]: DEBUG nova.compute.manager [req-c465b2ef-2ce1-4add-812e-e6904f01837c req-cecb2c7e-26ad-4aeb-947b-cfe16eb29d78 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:22:11 user nova-compute[75021]: WARNING nova.compute.manager [req-c465b2ef-2ce1-4add-812e-e6904f01837c req-cecb2c7e-26ad-4aeb-947b-cfe16eb29d78 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received unexpected event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with vm_state stopped and task_state powering-on.
Dec 06 07:22:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-e10fd3ce-b0f0-483d-9d84-09bcb4cde3f9 req-d65949c2-a8f8-4b18-b60c-04d0535ab3a1 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e10fd3ce-b0f0-483d-9d84-09bcb4cde3f9 req-d65949c2-a8f8-4b18-b60c-04d0535ab3a1 service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e10fd3ce-b0f0-483d-9d84-09bcb4cde3f9 req-d65949c2-a8f8-4b18-b60c-04d0535ab3a1 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e10fd3ce-b0f0-483d-9d84-09bcb4cde3f9 req-d65949c2-a8f8-4b18-b60c-04d0535ab3a1 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-e10fd3ce-b0f0-483d-9d84-09bcb4cde3f9 req-d65949c2-a8f8-4b18-b60c-04d0535ab3a1 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:22:13 user nova-compute[75021]: WARNING nova.compute.manager [req-e10fd3ce-b0f0-483d-9d84-09bcb4cde3f9 req-d65949c2-a8f8-4b18-b60c-04d0535ab3a1 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received unexpected event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with vm_state stopped and task_state powering-on.
Dec 06 07:22:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:22:13 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Instance rebooted successfully.
Dec 06 07:22:13 user nova-compute[75021]: DEBUG nova.compute.manager [None req-82690f93-38f2-47e2-82be-1f8236ba4603 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:22:14 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:22:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:14 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:22:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:22:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:14 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:16 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:22:16 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:22:16 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8397MB free_disk=25.02645492553711GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance cd198206-4476-4b87-8399-dd5cb38fd3b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 58ef39ae-4b66-42e6-ae22-5308a98eb55d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 17638711-6771-4b89-b0d0-231eeb1a9080 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:22:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:17 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:22:17 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:22:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:22:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-58ef39ae-4b66-42e6-ae22-5308a98eb55d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:22:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-58ef39ae-4b66-42e6-ae22-5308a98eb55d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:22:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:22:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Updating instance_info_cache with network_info: [{"id": "8d305221-2e91-46cc-99d8-428d63a55a80", "address": "fa:16:3e:e3:57:1d", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d305221-2e", "ovs_interfaceid": "8d305221-2e91-46cc-99d8-428d63a55a80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:22:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-58ef39ae-4b66-42e6-ae22-5308a98eb55d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:22:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:22:18 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:22:18 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:22:18 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:22:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:22:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:22:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:22:20 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17638711-6771-4b89-b0d0-231eeb1a9080 is timed out.
Dec 06 07:22:20 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Successfully detached device vdb from instance 17638711-6771-4b89-b0d0-231eeb1a9080 from the live domain config.
Dec 06 07:22:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGSeaZuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:22:20 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e911111-b4b8-4aa5-9ea9-269994248a70]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:22:20 user nova-compute[75021]: No targets found.
Dec 06 07:22:20 user nova-compute[75021]: iSNS:
Dec 06 07:22:20 user nova-compute[75021]: No targets found.
Dec 06 07:22:20 user nova-compute[75021]: STATIC:
Dec 06 07:22:20 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd
Dec 06 07:22:20 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:22:20 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:22:20 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:22:20 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:22:20 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:22:20 user nova-compute[75021]: FIRMWARE:
Dec 06 07:22:20 user nova-compute[75021]: No targets found.
Dec 06 07:22:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:22:20 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:22:20 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe39a347-93ec-4de8-80d3-37492b1b608f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62bfdc4-8e83-4318-a028-30b63be3c9f3]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:22:20 user nova-compute[75021]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd (non-flash)
Dec 06 07:22:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:22:20 user nova-compute[75021]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd (non-flash)
Dec 06 07:22:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b476e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a225815d-697b-4db8-a0c7-227dadeb08d2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c200490-e691-424d-9d0d-968a040a9f31]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac35a3b0-bf69-42f1-bf0e-e3f4c47cfa94]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f93e73-fe98-429a-a0f9-878997402355]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8a6af7-a901-4fc1-9ebc-416095e20290]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22ef4b0-0241-4a0f-ae9e-efbdfb0e424c]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd, portal: 172.16.0.220,3260]
Dec 06 07:22:20 user nova-compute[75021]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd, portal: 172.16.0.220,3260] successful.
Dec 06 07:22:20 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a58d2b9b-2cea-49d6-b1e0-73d0ea89fddd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[08167fca-dd48-43d6-bb3d-d892a635de88]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] <== disconnect_volume: return (322ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:22:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:22:21 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'flavor' on Instance uuid 17638711-6771-4b89-b0d0-231eeb1a9080 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:22:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d68a3d7d-eeda-4890-b472-3c92a18fe9d5 tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "17638711-6771-4b89-b0d0-231eeb1a9080" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.725s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:22:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:24 user nova-compute[75021]: INFO nova.compute.manager [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Terminating instance
Dec 06 07:22:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:22:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-a271a87d-6566-4632-b3f7-0a88c343b24b req-748d5656-170c-47d7-b09c-8eaca018e67c service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Received event network-vif-unplugged-8d305221-2e91-46cc-99d8-428d63a55a80 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a271a87d-6566-4632-b3f7-0a88c343b24b req-748d5656-170c-47d7-b09c-8eaca018e67c service nova] Acquiring lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a271a87d-6566-4632-b3f7-0a88c343b24b req-748d5656-170c-47d7-b09c-8eaca018e67c service nova] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a271a87d-6566-4632-b3f7-0a88c343b24b req-748d5656-170c-47d7-b09c-8eaca018e67c service nova] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-a271a87d-6566-4632-b3f7-0a88c343b24b req-748d5656-170c-47d7-b09c-8eaca018e67c service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] No waiting events found dispatching network-vif-unplugged-8d305221-2e91-46cc-99d8-428d63a55a80 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG nova.compute.manager [req-a271a87d-6566-4632-b3f7-0a88c343b24b req-748d5656-170c-47d7-b09c-8eaca018e67c service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Received event network-vif-unplugged-8d305221-2e91-46cc-99d8-428d63a55a80 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:25 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Instance destroyed successfully.
Dec 06 07:22:25 user nova-compute[75021]: DEBUG nova.objects.instance [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'resources' on Instance uuid 58ef39ae-4b66-42e6-ae22-5308a98eb55d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:13:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-184221298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-184221298',id=31,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:13:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9895e43bf76d4760a26a5e64ea6d4e14',ramdisk_id='',reservation_id='r-nkjflk1n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:14:59Z,user_data=None,user_id='c0774aa1e3ee4b69b195b575d116ee96',uuid=58ef39ae-4b66-42e6-ae22-5308a98eb55d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d305221-2e91-46cc-99d8-428d63a55a80", "address": "fa:16:3e:e3:57:1d", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d305221-2e", "ovs_interfaceid": "8d305221-2e91-46cc-99d8-428d63a55a80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converting VIF {"id": "8d305221-2e91-46cc-99d8-428d63a55a80", "address": "fa:16:3e:e3:57:1d", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d305221-2e", "ovs_interfaceid": "8d305221-2e91-46cc-99d8-428d63a55a80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:57:1d,bridge_name='br-int',has_traffic_filtering=True,id=8d305221-2e91-46cc-99d8-428d63a55a80,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d305221-2e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG os_vif [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:57:1d,bridge_name='br-int',has_traffic_filtering=True,id=8d305221-2e91-46cc-99d8-428d63a55a80,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d305221-2e') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d305221-2e, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec499d75-33a6-4c76-9ea0-94bdb4d75bcc) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:22:25 user nova-compute[75021]: INFO os_vif [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:57:1d,bridge_name='br-int',has_traffic_filtering=True,id=8d305221-2e91-46cc-99d8-428d63a55a80,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d305221-2e')
Dec 06 07:22:25 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Deleting instance files /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d_del
Dec 06 07:22:25 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Deletion of /opt/stack/data/nova/instances/58ef39ae-4b66-42e6-ae22-5308a98eb55d_del complete
Dec 06 07:22:25 user nova-compute[75021]: INFO nova.compute.manager [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 06 07:22:25 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:22:25 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:22:26 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:22:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-368b880d-fce7-4b93-9856-7267c3e2745f req-800c9cac-f4bb-4c9d-a286-8da9e2982cbb service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Received event network-vif-deleted-8d305221-2e91-46cc-99d8-428d63a55a80 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:26 user nova-compute[75021]: INFO nova.compute.manager [req-368b880d-fce7-4b93-9856-7267c3e2745f req-800c9cac-f4bb-4c9d-a286-8da9e2982cbb service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Neutron deleted interface 8d305221-2e91-46cc-99d8-428d63a55a80; detaching it from the instance and deleting it from the info cache
Dec 06 07:22:26 user nova-compute[75021]: DEBUG nova.network.neutron [req-368b880d-fce7-4b93-9856-7267c3e2745f req-800c9cac-f4bb-4c9d-a286-8da9e2982cbb service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:22:26 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Took 0.50 seconds to deallocate network for instance.
Dec 06 07:22:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-368b880d-fce7-4b93-9856-7267c3e2745f req-800c9cac-f4bb-4c9d-a286-8da9e2982cbb service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Detach interface failed, port_id=8d305221-2e91-46cc-99d8-428d63a55a80, reason: Instance 58ef39ae-4b66-42e6-ae22-5308a98eb55d could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 07:22:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:26 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:22:26 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:22:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:26 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Deleted allocations for instance 58ef39ae-4b66-42e6-ae22-5308a98eb55d
Dec 06 07:22:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6a5ccfd0-7bf7-4b87-a201-44c0347d9903 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.795s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-294afa0a-6042-4862-9a92-da0210e86dc1 req-81389331-5e6e-4a31-b9f1-867192027329 service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Received event network-vif-plugged-8d305221-2e91-46cc-99d8-428d63a55a80 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-294afa0a-6042-4862-9a92-da0210e86dc1 req-81389331-5e6e-4a31-b9f1-867192027329 service nova] Acquiring lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-294afa0a-6042-4862-9a92-da0210e86dc1 req-81389331-5e6e-4a31-b9f1-867192027329 service nova] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-294afa0a-6042-4862-9a92-da0210e86dc1 req-81389331-5e6e-4a31-b9f1-867192027329 service nova] Lock "58ef39ae-4b66-42e6-ae22-5308a98eb55d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:27 user nova-compute[75021]: DEBUG nova.compute.manager [req-294afa0a-6042-4862-9a92-da0210e86dc1 req-81389331-5e6e-4a31-b9f1-867192027329 service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] No waiting events found dispatching network-vif-plugged-8d305221-2e91-46cc-99d8-428d63a55a80 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:22:27 user nova-compute[75021]: WARNING nova.compute.manager [req-294afa0a-6042-4862-9a92-da0210e86dc1 req-81389331-5e6e-4a31-b9f1-867192027329 service nova] [instance: 58ef39ae-4b66-42e6-ae22-5308a98eb55d] Received unexpected event network-vif-plugged-8d305221-2e91-46cc-99d8-428d63a55a80 for instance with vm_state deleted and task_state None.
Dec 06 07:22:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "cd198206-4476-4b87-8399-dd5cb38fd3b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "cd198206-4476-4b87-8399-dd5cb38fd3b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:39 user nova-compute[75021]: INFO nova.compute.manager [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Terminating instance
Dec 06 07:22:39 user nova-compute[75021]: DEBUG nova.compute.manager [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:22:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-db158929-634b-4fb3-a316-c7b08cf77b37 req-8208c5b4-2354-4453-964b-cc58bfcc50b2 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Received event network-vif-unplugged-1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-db158929-634b-4fb3-a316-c7b08cf77b37 req-8208c5b4-2354-4453-964b-cc58bfcc50b2 service nova] Acquiring lock "cd198206-4476-4b87-8399-dd5cb38fd3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-db158929-634b-4fb3-a316-c7b08cf77b37 req-8208c5b4-2354-4453-964b-cc58bfcc50b2 service nova] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-db158929-634b-4fb3-a316-c7b08cf77b37 req-8208c5b4-2354-4453-964b-cc58bfcc50b2 service nova] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-db158929-634b-4fb3-a316-c7b08cf77b37 req-8208c5b4-2354-4453-964b-cc58bfcc50b2 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] No waiting events found dispatching network-vif-unplugged-1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-db158929-634b-4fb3-a316-c7b08cf77b37 req-8208c5b4-2354-4453-964b-cc58bfcc50b2 service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Received event network-vif-unplugged-1f43de0b-bfae-4359-9a48-56a43f5dbdbf for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:40 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Instance destroyed successfully.
Dec 06 07:22:40 user nova-compute[75021]: DEBUG nova.objects.instance [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lazy-loading 'resources' on Instance uuid cd198206-4476-4b87-8399-dd5cb38fd3b1 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:03:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-713644889',display_name='tempest-ServerActionsTestOtherA-server-713644889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-713644889',id=16,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbe4qUdep78TgBLG29O7GMFI0uEKESU+Xx64Y2G0xkh2EtccpxwWlafCMPJHygmaEQbyUAtZjD22PTzS9xqolPPxgkkpdNuHJ15mMhGsezfXPp1cLkefmXHoF6E+QYoeA==',key_name='tempest-keypair-34997867',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f011c1a70ac1465d8eb31e20850fdbad',ramdisk_id='',reservation_id='r-dagydyip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1761792884',owner_user_name='tempest-ServerActionsTestOtherA-1761792884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:03:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3369c937ad24537a114a71eb4674750',uuid=cd198206-4476-4b87-8399-dd5cb38fd3b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "address": "fa:16:3e:b7:f2:e4", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f43de0b-bf", "ovs_interfaceid": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converting VIF {"id": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "address": "fa:16:3e:b7:f2:e4", "network": {"id": "7b1bbe2d-5474-4355-90e2-0010f56afe45", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538526069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f011c1a70ac1465d8eb31e20850fdbad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f43de0b-bf", "ovs_interfaceid": "1f43de0b-bfae-4359-9a48-56a43f5dbdbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:f2:e4,bridge_name='br-int',has_traffic_filtering=True,id=1f43de0b-bfae-4359-9a48-56a43f5dbdbf,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f43de0b-bf') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG os_vif [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:f2:e4,bridge_name='br-int',has_traffic_filtering=True,id=1f43de0b-bfae-4359-9a48-56a43f5dbdbf,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f43de0b-bf') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f43de0b-bf, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd7bba59-cb85-481a-9ad4-3dd516a324b5) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:40 user nova-compute[75021]: INFO os_vif [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:f2:e4,bridge_name='br-int',has_traffic_filtering=True,id=1f43de0b-bfae-4359-9a48-56a43f5dbdbf,network=Network(7b1bbe2d-5474-4355-90e2-0010f56afe45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f43de0b-bf')
Dec 06 07:22:40 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Deleting instance files /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1_del
Dec 06 07:22:40 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Deletion of /opt/stack/data/nova/instances/cd198206-4476-4b87-8399-dd5cb38fd3b1_del complete
Dec 06 07:22:40 user nova-compute[75021]: INFO nova.compute.manager [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Took 0.70 seconds to destroy the instance on the hypervisor.
Dec 06 07:22:40 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:22:40 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:22:41 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:22:41 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Took 0.47 seconds to deallocate network for instance.
Dec 06 07:22:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:41 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:22:41 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:22:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:41 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Deleted allocations for instance cd198206-4476-4b87-8399-dd5cb38fd3b1
Dec 06 07:22:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-76867ffa-c319-4bb1-8f1b-e923493d68bb tempest-ServerActionsTestOtherA-1761792884 tempest-ServerActionsTestOtherA-1761792884-project-member] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.615s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:42 user nova-compute[75021]: DEBUG nova.compute.manager [req-07087603-1b6c-431e-ae9f-afb3c05f64b5 req-f9316b1f-ea95-4f98-acc3-e933aeaafc5b service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Received event network-vif-plugged-1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-07087603-1b6c-431e-ae9f-afb3c05f64b5 req-f9316b1f-ea95-4f98-acc3-e933aeaafc5b service nova] Acquiring lock "cd198206-4476-4b87-8399-dd5cb38fd3b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-07087603-1b6c-431e-ae9f-afb3c05f64b5 req-f9316b1f-ea95-4f98-acc3-e933aeaafc5b service nova] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-07087603-1b6c-431e-ae9f-afb3c05f64b5 req-f9316b1f-ea95-4f98-acc3-e933aeaafc5b service nova] Lock "cd198206-4476-4b87-8399-dd5cb38fd3b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:42 user nova-compute[75021]: DEBUG nova.compute.manager [req-07087603-1b6c-431e-ae9f-afb3c05f64b5 req-f9316b1f-ea95-4f98-acc3-e933aeaafc5b service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] No waiting events found dispatching network-vif-plugged-1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:22:42 user nova-compute[75021]: WARNING nova.compute.manager [req-07087603-1b6c-431e-ae9f-afb3c05f64b5 req-f9316b1f-ea95-4f98-acc3-e933aeaafc5b service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Received unexpected event network-vif-plugged-1f43de0b-bfae-4359-9a48-56a43f5dbdbf for instance with vm_state deleted and task_state None.
Dec 06 07:22:42 user nova-compute[75021]: DEBUG nova.compute.manager [req-07087603-1b6c-431e-ae9f-afb3c05f64b5 req-f9316b1f-ea95-4f98-acc3-e933aeaafc5b service nova] [instance: cd198206-4476-4b87-8399-dd5cb38fd3b1] Received event network-vif-deleted-1f43de0b-bfae-4359-9a48-56a43f5dbdbf {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "17638711-6771-4b89-b0d0-231eeb1a9080" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "17638711-6771-4b89-b0d0-231eeb1a9080" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "17638711-6771-4b89-b0d0-231eeb1a9080-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "17638711-6771-4b89-b0d0-231eeb1a9080-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "17638711-6771-4b89-b0d0-231eeb1a9080-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:50 user nova-compute[75021]: INFO nova.compute.manager [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Terminating instance
Dec 06 07:22:50 user nova-compute[75021]: DEBUG nova.compute.manager [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG nova.compute.manager [req-08a20b62-3206-465f-bebd-b56b1e1c0256 req-c9ef9505-4552-4a42-9fa1-3a5a0761cc8c service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Received event network-vif-unplugged-fee28653-2669-4e1f-9492-551ffa0fc228 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-08a20b62-3206-465f-bebd-b56b1e1c0256 req-c9ef9505-4552-4a42-9fa1-3a5a0761cc8c service nova] Acquiring lock "17638711-6771-4b89-b0d0-231eeb1a9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-08a20b62-3206-465f-bebd-b56b1e1c0256 req-c9ef9505-4552-4a42-9fa1-3a5a0761cc8c service nova] Lock "17638711-6771-4b89-b0d0-231eeb1a9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-08a20b62-3206-465f-bebd-b56b1e1c0256 req-c9ef9505-4552-4a42-9fa1-3a5a0761cc8c service nova] Lock "17638711-6771-4b89-b0d0-231eeb1a9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG nova.compute.manager [req-08a20b62-3206-465f-bebd-b56b1e1c0256 req-c9ef9505-4552-4a42-9fa1-3a5a0761cc8c service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] No waiting events found dispatching network-vif-unplugged-fee28653-2669-4e1f-9492-551ffa0fc228 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG nova.compute.manager [req-08a20b62-3206-465f-bebd-b56b1e1c0256 req-c9ef9505-4552-4a42-9fa1-3a5a0761cc8c service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Received event network-vif-unplugged-fee28653-2669-4e1f-9492-551ffa0fc228 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:50 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Instance destroyed successfully.
Dec 06 07:22:50 user nova-compute[75021]: DEBUG nova.objects.instance [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lazy-loading 'resources' on Instance uuid 17638711-6771-4b89-b0d0-231eeb1a9080 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1911096286',display_name='tempest-AttachVolumeNegativeTest-server-1911096286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1911096286',id=40,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuRMDB9LjoMOK8m3JLIWGxvPBdzMsbu2+W+gAFnuxWMImrR33YiABmQp/F1l1w8yVI8cHPiCGaavOzjs0wYzZd8JBinuLtEkvdRWMqaiE6omnlq7hQSn/wFEWOtH+qIyA==',key_name='tempest-keypair-903842731',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:20:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae65045cef754813bd33f68b9868dc9d',ramdisk_id='',reservation_id='r-rfxgj0rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-967416759',owner_user_name='tempest-AttachVolumeNegativeTest-967416759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:20:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e1155d2c304bdd8404712faf046b05',uuid=17638711-6771-4b89-b0d0-231eeb1a9080,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fee28653-2669-4e1f-9492-551ffa0fc228", "address": "fa:16:3e:dc:59:0a", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee28653-26", "ovs_interfaceid": "fee28653-2669-4e1f-9492-551ffa0fc228", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converting VIF {"id": "fee28653-2669-4e1f-9492-551ffa0fc228", "address": "fa:16:3e:dc:59:0a", "network": {"id": "0ed5f4b9-5c08-479e-afc0-d3f240ddbe40", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-436426125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae65045cef754813bd33f68b9868dc9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee28653-26", "ovs_interfaceid": "fee28653-2669-4e1f-9492-551ffa0fc228", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:59:0a,bridge_name='br-int',has_traffic_filtering=True,id=fee28653-2669-4e1f-9492-551ffa0fc228,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee28653-26') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG os_vif [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:59:0a,bridge_name='br-int',has_traffic_filtering=True,id=fee28653-2669-4e1f-9492-551ffa0fc228,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee28653-26') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfee28653-26, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0dd147ba-9522-4af1-b878-615a937c717d) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:22:50 user nova-compute[75021]: INFO os_vif [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:59:0a,bridge_name='br-int',has_traffic_filtering=True,id=fee28653-2669-4e1f-9492-551ffa0fc228,network=Network(0ed5f4b9-5c08-479e-afc0-d3f240ddbe40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee28653-26')
Dec 06 07:22:50 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Deleting instance files /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080_del
Dec 06 07:22:50 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Deletion of /opt/stack/data/nova/instances/17638711-6771-4b89-b0d0-231eeb1a9080_del complete
Dec 06 07:22:51 user nova-compute[75021]: INFO nova.compute.manager [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 06 07:22:51 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:22:51 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:22:51 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:22:51 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:22:51 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Took 0.79 seconds to deallocate network for instance.
Dec 06 07:22:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-1fe2390b-d2ac-4bde-8847-e517ce64ca67 req-692a220a-d6d3-441e-bec4-e4def7690ec2 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Received event network-vif-deleted-fee28653-2669-4e1f-9492-551ffa0fc228 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:52 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:22:52 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:22:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:52 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Deleted allocations for instance 17638711-6771-4b89-b0d0-231eeb1a9080
Dec 06 07:22:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-df13d6d3-8073-4155-a2a1-e3a24339840b tempest-AttachVolumeNegativeTest-967416759 tempest-AttachVolumeNegativeTest-967416759-project-member] Lock "17638711-6771-4b89-b0d0-231eeb1a9080" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.259s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-5e65a438-92b2-48df-822c-0d6b6fc3b5b9 req-d3202890-d039-4915-b71e-415f32f9d730 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Received event network-vif-plugged-fee28653-2669-4e1f-9492-551ffa0fc228 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:22:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5e65a438-92b2-48df-822c-0d6b6fc3b5b9 req-d3202890-d039-4915-b71e-415f32f9d730 service nova] Acquiring lock "17638711-6771-4b89-b0d0-231eeb1a9080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:22:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5e65a438-92b2-48df-822c-0d6b6fc3b5b9 req-d3202890-d039-4915-b71e-415f32f9d730 service nova] Lock "17638711-6771-4b89-b0d0-231eeb1a9080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:22:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5e65a438-92b2-48df-822c-0d6b6fc3b5b9 req-d3202890-d039-4915-b71e-415f32f9d730 service nova] Lock "17638711-6771-4b89-b0d0-231eeb1a9080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:22:52 user nova-compute[75021]: DEBUG nova.compute.manager [req-5e65a438-92b2-48df-822c-0d6b6fc3b5b9 req-d3202890-d039-4915-b71e-415f32f9d730 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] No waiting events found dispatching network-vif-plugged-fee28653-2669-4e1f-9492-551ffa0fc228 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:22:52 user nova-compute[75021]: WARNING nova.compute.manager [req-5e65a438-92b2-48df-822c-0d6b6fc3b5b9 req-d3202890-d039-4915-b71e-415f32f9d730 service nova] [instance: 17638711-6771-4b89-b0d0-231eeb1a9080] Received unexpected event network-vif-plugged-fee28653-2669-4e1f-9492-551ffa0fc228 for instance with vm_state deleted and task_state None.
Dec 06 07:22:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:23:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:13 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:15 user nova-compute[75021]: INFO nova.compute.manager [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Terminating instance
Dec 06 07:23:15 user nova-compute[75021]: DEBUG nova.compute.manager [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-10e9d231-07a6-4409-b214-641a156fb936 req-4f2aaedc-35ff-4e3b-8c2f-492603a1e450 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received event network-vif-unplugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-10e9d231-07a6-4409-b214-641a156fb936 req-4f2aaedc-35ff-4e3b-8c2f-492603a1e450 service nova] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-10e9d231-07a6-4409-b214-641a156fb936 req-4f2aaedc-35ff-4e3b-8c2f-492603a1e450 service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-10e9d231-07a6-4409-b214-641a156fb936 req-4f2aaedc-35ff-4e3b-8c2f-492603a1e450 service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-10e9d231-07a6-4409-b214-641a156fb936 req-4f2aaedc-35ff-4e3b-8c2f-492603a1e450 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] No waiting events found dispatching network-vif-unplugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-10e9d231-07a6-4409-b214-641a156fb936 req-4f2aaedc-35ff-4e3b-8c2f-492603a1e450 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received event network-vif-unplugged-a3831721-6988-44ee-89a6-35d80066e41b for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:16 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Instance destroyed successfully.
Dec 06 07:23:16 user nova-compute[75021]: DEBUG nova.objects.instance [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'resources' on Instance uuid 828f5456-6310-4664-87b3-ee0ed6787d3f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1548788729',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1548788729',id=24,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:09:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9895e43bf76d4760a26a5e64ea6d4e14',ramdisk_id='',reservation_id='r-papxt6p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:11:16Z,user_data=None,user_id='c0774aa1e3ee4b69b195b575d116ee96',uuid=828f5456-6310-4664-87b3-ee0ed6787d3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converting VIF {"id": "a3831721-6988-44ee-89a6-35d80066e41b", "address": "fa:16:3e:ba:ed:50", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3831721-69", "ovs_interfaceid": "a3831721-6988-44ee-89a6-35d80066e41b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:ed:50,bridge_name='br-int',has_traffic_filtering=True,id=a3831721-6988-44ee-89a6-35d80066e41b,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3831721-69') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_vif [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:ed:50,bridge_name='br-int',has_traffic_filtering=True,id=a3831721-6988-44ee-89a6-35d80066e41b,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3831721-69') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3831721-69, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c8b62fd-88e5-48d2-a0bd-d2d7dd973433) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:23:16 user nova-compute[75021]: INFO os_vif [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:ed:50,bridge_name='br-int',has_traffic_filtering=True,id=a3831721-6988-44ee-89a6-35d80066e41b,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3831721-69')
Dec 06 07:23:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujAilWOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:23:16 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e38af80-5367-4318-b46a-4a7b438b1f61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:23:16 user nova-compute[75021]: No targets found.
Dec 06 07:23:16 user nova-compute[75021]: iSNS:
Dec 06 07:23:16 user nova-compute[75021]: No targets found.
Dec 06 07:23:16 user nova-compute[75021]: STATIC:
Dec 06 07:23:16 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44
Dec 06 07:23:16 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:23:16 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:23:16 user nova-compute[75021]: FIRMWARE:
Dec 06 07:23:16 user nova-compute[75021]: No targets found.
Dec 06 07:23:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:23:16 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:23:16 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[43417522-ba1d-4636-aa6f-4c1be12f6865]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55baf05-0b9e-4dc5-92f1-0b9eccee6f99]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:23:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 (non-flash)
Dec 06 07:23:16 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b442ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44'): ({'sdd'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Removing single pathed devices sdd {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b62aca-ec05-4979-870d-172495d5b832]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d15457b-788b-42bf-819c-6f4311bfc439]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Flushing IO for device /dev/sdd {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b12a425-ac55-4c7b-ae6b-c6ea47f7caca]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4840bf-5eca-4412-8cf6-db7a41499e69]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[36109354-4ffe-41f3-ae8a-7c16f257a6a3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:23:16 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9ff9ff-bc80-419e-87f6-5a553351f3a5]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44, portal: 172.16.0.220,3260]
Dec 06 07:23:17 user nova-compute[75021]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44, portal: 172.16.0.220,3260] successful.
Dec 06 07:23:17 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.528s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a03d75-07a1-4973-9127-073695e5fa44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[122d93e8-e1a0-4256-8870-91053ac6e98a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.643s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] <== disconnect_volume: return (645ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:23:17 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Deleting instance files /opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f_del
Dec 06 07:23:17 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Deletion of /opt/stack/data/nova/instances/828f5456-6310-4664-87b3-ee0ed6787d3f_del complete
Dec 06 07:23:17 user nova-compute[75021]: INFO nova.compute.manager [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Took 1.55 seconds to destroy the instance on the hypervisor.
Dec 06 07:23:17 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:17 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Error from libvirt while getting description of instance-00000018: [Error Code 42] Domain not found: no domain with matching uuid '828f5456-6310-4664-87b3-ee0ed6787d3f' (instance-00000018): libvirt.libvirtError: Domain not found: no domain with matching uuid '828f5456-6310-4664-87b3-ee0ed6787d3f' (instance-00000018)
Dec 06 07:23:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-58c06204-f6b6-41cd-b5d1-609ca418e3fc req-3492a272-d87e-452c-afca-5894072cd178 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-58c06204-f6b6-41cd-b5d1-609ca418e3fc req-3492a272-d87e-452c-afca-5894072cd178 service nova] Acquiring lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-58c06204-f6b6-41cd-b5d1-609ca418e3fc req-3492a272-d87e-452c-afca-5894072cd178 service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-58c06204-f6b6-41cd-b5d1-609ca418e3fc req-3492a272-d87e-452c-afca-5894072cd178 service nova] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-58c06204-f6b6-41cd-b5d1-609ca418e3fc req-3492a272-d87e-452c-afca-5894072cd178 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] No waiting events found dispatching network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:23:18 user nova-compute[75021]: WARNING nova.compute.manager [req-58c06204-f6b6-41cd-b5d1-609ca418e3fc req-3492a272-d87e-452c-afca-5894072cd178 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received unexpected event network-vif-plugged-a3831721-6988-44ee-89a6-35d80066e41b for instance with vm_state active and task_state deleting.
Dec 06 07:23:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-58c06204-f6b6-41cd-b5d1-609ca418e3fc req-3492a272-d87e-452c-afca-5894072cd178 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Received event network-vif-deleted-a3831721-6988-44ee-89a6-35d80066e41b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:23:18 user nova-compute[75021]: INFO nova.compute.manager [req-58c06204-f6b6-41cd-b5d1-609ca418e3fc req-3492a272-d87e-452c-afca-5894072cd178 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Neutron deleted interface a3831721-6988-44ee-89a6-35d80066e41b; detaching it from the instance and deleting it from the info cache
Dec 06 07:23:18 user nova-compute[75021]: DEBUG nova.network.neutron [req-58c06204-f6b6-41cd-b5d1-609ca418e3fc req-3492a272-d87e-452c-afca-5894072cd178 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:23:18 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:23:18 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:23:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=25.20471954345703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:18 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Took 0.87 seconds to deallocate network for instance.
Dec 06 07:23:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-58c06204-f6b6-41cd-b5d1-609ca418e3fc req-3492a272-d87e-452c-afca-5894072cd178 service nova] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Detach interface failed, port_id=a3831721-6988-44ee-89a6-35d80066e41b, reason: Instance 828f5456-6310-4664-87b3-ee0ed6787d3f could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9372825-c75d-45a3-a48c-e111869d97a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 828f5456-6310-4664-87b3-ee0ed6787d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:18 user nova-compute[75021]: INFO nova.compute.manager [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: 828f5456-6310-4664-87b3-ee0ed6787d3f] Took 0.78 seconds to detach 1 volumes for instance.
Dec 06 07:23:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:19 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:23:19 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:23:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:19 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Deleted allocations for instance 828f5456-6310-4664-87b3-ee0ed6787d3f
Dec 06 07:23:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-720e9314-a4f9-41dc-9d0b-71e7e750ceca tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "828f5456-6310-4664-87b3-ee0ed6787d3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.544s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:23:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:23:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:23:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:23:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:23:19 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:23:19 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Updating instance_info_cache with network_info: [{"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:23:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-0dc18c93-5a40-4c98-a6bf-7422e45b245d" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:23:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:23:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:23:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:23:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:23:21 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:23:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:27 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:23:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:23:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:41 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:23:41 user nova-compute[75021]: INFO nova.compute.claims [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Claim successful on node user
Dec 06 07:23:41 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:23:41 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:23:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:41 user nova-compute[75021]: DEBUG nova.compute.manager [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:23:41 user nova-compute[75021]: DEBUG nova.compute.manager [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:23:41 user nova-compute[75021]: DEBUG nova.network.neutron [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:23:41 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:23:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:41 user nova-compute[75021]: DEBUG nova.compute.manager [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:23:41 user nova-compute[75021]: DEBUG nova.policy [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b39552dec3964bf69ed87b5ca130fe5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddfde019af4962929aa2c8cfa84b35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:23:41 user nova-compute[75021]: INFO nova.virt.block_device [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Booting with volume snapshot e76a4878-bc6c-46f9-9efe-7ede33b481b6 at /dev/vda
Dec 06 07:23:42 user nova-compute[75021]: DEBUG nova.network.neutron [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Successfully created port: fa324ccb-28ee-4d6f-83fd-c559cd6fe20b {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG nova.network.neutron [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Successfully updated port: fa324ccb-28ee-4d6f-83fd-c559cd6fe20b {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "refresh_cache-f0793413-e2d1-49f8-b5c1-9e5fa6c34531" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquired lock "refresh_cache-f0793413-e2d1-49f8-b5c1-9e5fa6c34531" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG nova.network.neutron [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-f4ed21fe-41f1-4a51-bd44-a6c0876405f4 req-e7b43280-82a1-4dbd-bce5-40e8369f0458 service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Received event network-changed-fa324ccb-28ee-4d6f-83fd-c559cd6fe20b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-f4ed21fe-41f1-4a51-bd44-a6c0876405f4 req-e7b43280-82a1-4dbd-bce5-40e8369f0458 service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Refreshing instance network info cache due to event network-changed-fa324ccb-28ee-4d6f-83fd-c559cd6fe20b. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f4ed21fe-41f1-4a51-bd44-a6c0876405f4 req-e7b43280-82a1-4dbd-bce5-40e8369f0458 service nova] Acquiring lock "refresh_cache-f0793413-e2d1-49f8-b5c1-9e5fa6c34531" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG nova.network.neutron [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG nova.network.neutron [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Updating instance_info_cache with network_info: [{"id": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "address": "fa:16:3e:b8:3c:2f", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa324ccb-28", "ovs_interfaceid": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Releasing lock "refresh_cache-f0793413-e2d1-49f8-b5c1-9e5fa6c34531" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Instance network_info: |[{"id": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "address": "fa:16:3e:b8:3c:2f", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa324ccb-28", "ovs_interfaceid": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f4ed21fe-41f1-4a51-bd44-a6c0876405f4 req-e7b43280-82a1-4dbd-bce5-40e8369f0458 service nova] Acquired lock "refresh_cache-f0793413-e2d1-49f8-b5c1-9e5fa6c34531" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG nova.network.neutron [req-f4ed21fe-41f1-4a51-bd44-a6c0876405f4 req-e7b43280-82a1-4dbd-bce5-40e8369f0458 service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Refreshing network info cache for port fa324ccb-28ee-4d6f-83fd-c559cd6fe20b {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "5a0c7109-a15e-440b-b0f3-785721e55627" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:43 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:23:43 user nova-compute[75021]: INFO nova.compute.claims [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Claim successful on node user
Dec 06 07:23:44 user nova-compute[75021]: DEBUG nova.network.neutron [req-f4ed21fe-41f1-4a51-bd44-a6c0876405f4 req-e7b43280-82a1-4dbd-bce5-40e8369f0458 service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Updated VIF entry in instance network info cache for port fa324ccb-28ee-4d6f-83fd-c559cd6fe20b. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG nova.network.neutron [req-f4ed21fe-41f1-4a51-bd44-a6c0876405f4 req-e7b43280-82a1-4dbd-bce5-40e8369f0458 service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Updating instance_info_cache with network_info: [{"id": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "address": "fa:16:3e:b8:3c:2f", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa324ccb-28", "ovs_interfaceid": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f4ed21fe-41f1-4a51-bd44-a6c0876405f4 req-e7b43280-82a1-4dbd-bce5-40e8369f0458 service nova] Releasing lock "refresh_cache-f0793413-e2d1-49f8-b5c1-9e5fa6c34531" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:23:44 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:23:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG nova.policy [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa0d7066c737488faa4d0465e7046be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6f441403694bda9f8cfcfd2072d41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:23:44 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Creating image(s)
Dec 06 07:23:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "/opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "/opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.199s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:44 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk 1073741824" returned: 0 in 0.064s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Successfully created port: f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Cannot resize image /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Ensure instance console log exists: /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Successfully updated port: f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquired lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-0dd48c18-5b0b-4131-a56b-2090e98b25a7 req-0c6b781d-245d-41ed-ac57-4f715eafdc75 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-changed-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-0dd48c18-5b0b-4131-a56b-2090e98b25a7 req-0c6b781d-245d-41ed-ac57-4f715eafdc75 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Refreshing instance network info cache due to event network-changed-f342e747-6e80-462b-8193-7acecbc16a79. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0dd48c18-5b0b-4131-a56b-2090e98b25a7 req-0c6b781d-245d-41ed-ac57-4f715eafdc75 service nova] Acquiring lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updating instance_info_cache with network_info: [{"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Releasing lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Instance network_info: |[{"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0dd48c18-5b0b-4131-a56b-2090e98b25a7 req-0c6b781d-245d-41ed-ac57-4f715eafdc75 service nova] Acquired lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:23:45 user nova-compute[75021]: DEBUG nova.network.neutron [req-0dd48c18-5b0b-4131-a56b-2090e98b25a7 req-0c6b781d-245d-41ed-ac57-4f715eafdc75 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Refreshing network info cache for port f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Start _get_guest_xml network_info=[{"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:23:46 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:23:46 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1422117388',display_name='tempest-ServerStableDeviceRescueTest-server-1422117388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1422117388',id=42,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTyp1mNeRSFaOYhXh+upqAV91SqE5x6NiN1WeH04nh4B1+8t2m3RL1LSWF5730zfUczB8J0EeJcJ9Iizt0jKnjrFxRButr7rRwhlV+HlM+0niNeMPoFEDoamYa8Sf2mYw==',key_name='tempest-keypair-91380679',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df6f441403694bda9f8cfcfd2072d41d',ramdisk_id='',reservation_id='r-395d200m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2041652180',owner_user_name='tempest-ServerStableDeviceRescueTest-2041652180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa0d7066c737488faa4d0465e7046be4',uuid=5a0c7109-a15e-440b-b0f3-785721e55627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Converting VIF {"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:be:5b,bridge_name='br-int',has_traffic_filtering=True,id=f342e747-6e80-462b-8193-7acecbc16a79,network=Network(2baad0e4-f46e-44a8-9967-4191ab3dab95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf342e747-6e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.objects.instance [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:23:46 user nova-compute[75021]:   <uuid>5a0c7109-a15e-440b-b0f3-785721e55627</uuid>
Dec 06 07:23:46 user nova-compute[75021]:   <name>instance-0000002a</name>
Dec 06 07:23:46 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:23:46 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:23:46 user nova-compute[75021]:   <metadata>
Dec 06 07:23:46 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:23:46 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:23:46 user nova-compute[75021]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1422117388</nova:name>
Dec 06 07:23:46 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:23:46</nova:creationTime>
Dec 06 07:23:46 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:23:46 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:23:46 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:23:46 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:23:46 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:23:46 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:23:46 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:23:46 user nova-compute[75021]:       <nova:owner>
Dec 06 07:23:46 user nova-compute[75021]:         <nova:user uuid="fa0d7066c737488faa4d0465e7046be4">tempest-ServerStableDeviceRescueTest-2041652180-project-member</nova:user>
Dec 06 07:23:46 user nova-compute[75021]:         <nova:project uuid="df6f441403694bda9f8cfcfd2072d41d">tempest-ServerStableDeviceRescueTest-2041652180</nova:project>
Dec 06 07:23:46 user nova-compute[75021]:       </nova:owner>
Dec 06 07:23:46 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:23:46 user nova-compute[75021]:       <nova:ports>
Dec 06 07:23:46 user nova-compute[75021]:         <nova:port uuid="f342e747-6e80-462b-8193-7acecbc16a79">
Dec 06 07:23:46 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 07:23:46 user nova-compute[75021]:         </nova:port>
Dec 06 07:23:46 user nova-compute[75021]:       </nova:ports>
Dec 06 07:23:46 user nova-compute[75021]:     </nova:instance>
Dec 06 07:23:46 user nova-compute[75021]:   </metadata>
Dec 06 07:23:46 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:23:46 user nova-compute[75021]:     <system>
Dec 06 07:23:46 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:23:46 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:23:46 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:23:46 user nova-compute[75021]:       <entry name="serial">5a0c7109-a15e-440b-b0f3-785721e55627</entry>
Dec 06 07:23:46 user nova-compute[75021]:       <entry name="uuid">5a0c7109-a15e-440b-b0f3-785721e55627</entry>
Dec 06 07:23:46 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:23:46 user nova-compute[75021]:     </system>
Dec 06 07:23:46 user nova-compute[75021]:   </sysinfo>
Dec 06 07:23:46 user nova-compute[75021]:   <os>
Dec 06 07:23:46 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:23:46 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:23:46 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:23:46 user nova-compute[75021]:   </os>
Dec 06 07:23:46 user nova-compute[75021]:   <features>
Dec 06 07:23:46 user nova-compute[75021]:     <acpi/>
Dec 06 07:23:46 user nova-compute[75021]:     <apic/>
Dec 06 07:23:46 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:23:46 user nova-compute[75021]:   </features>
Dec 06 07:23:46 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:23:46 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:23:46 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:23:46 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:23:46 user nova-compute[75021]:   </clock>
Dec 06 07:23:46 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:23:46 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:23:46 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:23:46 user nova-compute[75021]:   </cpu>
Dec 06 07:23:46 user nova-compute[75021]:   <devices>
Dec 06 07:23:46 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:23:46 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:23:46 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk"/>
Dec 06 07:23:46 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:23:46 user nova-compute[75021]:     </disk>
Dec 06 07:23:46 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:23:46 user nova-compute[75021]:       <mac address="fa:16:3e:59:be:5b"/>
Dec 06 07:23:46 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:23:46 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:23:46 user nova-compute[75021]:       <target dev="tapf342e747-6e"/>
Dec 06 07:23:46 user nova-compute[75021]:     </interface>
Dec 06 07:23:46 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:23:46 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/console.log" append="off"/>
Dec 06 07:23:46 user nova-compute[75021]:     </serial>
Dec 06 07:23:46 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:23:46 user nova-compute[75021]:     <video>
Dec 06 07:23:46 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:23:46 user nova-compute[75021]:     </video>
Dec 06 07:23:46 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:23:46 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:23:46 user nova-compute[75021]:     </rng>
Dec 06 07:23:46 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:23:46 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:23:46 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:23:46 user nova-compute[75021]:     </memballoon>
Dec 06 07:23:46 user nova-compute[75021]:   </devices>
Dec 06 07:23:46 user nova-compute[75021]: </domain>
Dec 06 07:23:46 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1422117388',display_name='tempest-ServerStableDeviceRescueTest-server-1422117388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1422117388',id=42,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTyp1mNeRSFaOYhXh+upqAV91SqE5x6NiN1WeH04nh4B1+8t2m3RL1LSWF5730zfUczB8J0EeJcJ9Iizt0jKnjrFxRButr7rRwhlV+HlM+0niNeMPoFEDoamYa8Sf2mYw==',key_name='tempest-keypair-91380679',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df6f441403694bda9f8cfcfd2072d41d',ramdisk_id='',reservation_id='r-395d200m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2041652180',owner_user_name='tempest-ServerStableDeviceRescueTest-2041652180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa0d7066c737488faa4d0465e7046be4',uuid=5a0c7109-a15e-440b-b0f3-785721e55627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Converting VIF {"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:be:5b,bridge_name='br-int',has_traffic_filtering=True,id=f342e747-6e80-462b-8193-7acecbc16a79,network=Network(2baad0e4-f46e-44a8-9967-4191ab3dab95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf342e747-6e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG os_vif [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:be:5b,bridge_name='br-int',has_traffic_filtering=True,id=f342e747-6e80-462b-8193-7acecbc16a79,network=Network(2baad0e4-f46e-44a8-9967-4191ab3dab95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf342e747-6e') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ed2d92f-4341-574a-a398-c5c411d332f3', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf342e747-6e, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf342e747-6e, col_values=(('qos', UUID('68f19dda-9bd0-435e-9920-1a91ca047376')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf342e747-6e, col_values=(('external_ids', {'iface-id': 'f342e747-6e80-462b-8193-7acecbc16a79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:be:5b', 'vm-uuid': '5a0c7109-a15e-440b-b0f3-785721e55627'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:46 user nova-compute[75021]: INFO os_vif [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:be:5b,bridge_name='br-int',has_traffic_filtering=True,id=f342e747-6e80-462b-8193-7acecbc16a79,network=Network(2baad0e4-f46e-44a8-9967-4191ab3dab95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf342e747-6e')
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] No VIF found with MAC fa:16:3e:59:be:5b, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.network.neutron [req-0dd48c18-5b0b-4131-a56b-2090e98b25a7 req-0c6b781d-245d-41ed-ac57-4f715eafdc75 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updated VIF entry in instance network info cache for port f342e747-6e80-462b-8193-7acecbc16a79. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG nova.network.neutron [req-0dd48c18-5b0b-4131-a56b-2090e98b25a7 req-0c6b781d-245d-41ed-ac57-4f715eafdc75 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updating instance_info_cache with network_info: [{"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:23:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0dd48c18-5b0b-4131-a56b-2090e98b25a7 req-0c6b781d-245d-41ed-ac57-4f715eafdc75 service nova] Releasing lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG os_brick.utils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be8fc10-6e37-4be2-b375-062ba2462b11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[129d1050-761e-4ab3-ad34-367bd0b43c54]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[df122c7e-63c7-4af7-8bb2-39bfa83790cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f9d523-5597-4353-93f7-3bbd4729b52f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:23:47 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f98af4-3e1e-407d-b81c-3e658fb8f9b1]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG os_brick.utils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Updating existing volume attachment record: fd02b47d-ae43-41cd-95bb-2287b428c86b {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-ac3e1e5d-8a5e-4ef0-9778-f68423c30a9e req-7975ba7d-629d-4b24-801b-a0e47733d6c9 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ac3e1e5d-8a5e-4ef0-9778-f68423c30a9e req-7975ba7d-629d-4b24-801b-a0e47733d6c9 service nova] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ac3e1e5d-8a5e-4ef0-9778-f68423c30a9e req-7975ba7d-629d-4b24-801b-a0e47733d6c9 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ac3e1e5d-8a5e-4ef0-9778-f68423c30a9e req-7975ba7d-629d-4b24-801b-a0e47733d6c9 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-ac3e1e5d-8a5e-4ef0-9778-f68423c30a9e req-7975ba7d-629d-4b24-801b-a0e47733d6c9 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] No waiting events found dispatching network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:23:47 user nova-compute[75021]: WARNING nova.compute.manager [req-ac3e1e5d-8a5e-4ef0-9778-f68423c30a9e req-7975ba7d-629d-4b24-801b-a0e47733d6c9 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received unexpected event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 for instance with vm_state building and task_state spawning.
Dec 06 07:23:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-155c82d9-af2a-4e05-81df-f714847d0aa5 req-68d7e6e7-7988-4d67-b676-6a13d9e31ca7 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:23:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-155c82d9-af2a-4e05-81df-f714847d0aa5 req-68d7e6e7-7988-4d67-b676-6a13d9e31ca7 service nova] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-155c82d9-af2a-4e05-81df-f714847d0aa5 req-68d7e6e7-7988-4d67-b676-6a13d9e31ca7 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-155c82d9-af2a-4e05-81df-f714847d0aa5 req-68d7e6e7-7988-4d67-b676-6a13d9e31ca7 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-155c82d9-af2a-4e05-81df-f714847d0aa5 req-68d7e6e7-7988-4d67-b676-6a13d9e31ca7 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] No waiting events found dispatching network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:23:49 user nova-compute[75021]: WARNING nova.compute.manager [req-155c82d9-af2a-4e05-81df-f714847d0aa5 req-68d7e6e7-7988-4d67-b676-6a13d9e31ca7 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received unexpected event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 for instance with vm_state building and task_state spawning.
Dec 06 07:23:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:23:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:23:49 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Instance spawned successfully.
Dec 06 07:23:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:23:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:23:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:23:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:23:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:23:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:23:49 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:23:49 user nova-compute[75021]: INFO nova.compute.manager [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Took 5.42 seconds to spawn the instance on the hypervisor.
Dec 06 07:23:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:23:50 user nova-compute[75021]: INFO nova.compute.manager [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Took 6.17 seconds to build instance.
Dec 06 07:23:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7bc643e9-06d5-4a65-bc38-d87f02e6582d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "5a0c7109-a15e-440b-b0f3-785721e55627" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.271s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.compute.manager [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:23:57 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Creating image(s)
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Ensure instance console log exists: /opt/stack/data/nova/instances/f0793413-e2d1-49f8-b5c1-9e5fa6c34531/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Start _get_guest_xml network_info=[{"id": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "address": "fa:16:3e:b8:3c:2f", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa324ccb-28", "ovs_interfaceid": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fd02b47d-ae43-41cd-95bb-2287b428c86b', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msPtkfQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0793413-e2d1-49f8-b5c1-9e5fa6c34531', 'attached_at': '', 'detached_at': '', 'volume_id': 'dbe53363-f596-4995-90da-84de1157b024', 'serial': 'dbe53363-f596-4995-90da-84de1157b024'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:23:57 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:23:57 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msPtkfQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:23:57 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:23:57 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:23:57 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6096533-d535-41c3-9a16-892b3d79dcc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:23:57 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b65782-2d63-4009-abdd-4c549ff0f554]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024] added
Dec 06 07:23:57 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8520b6fc-f8e4-49f3-a1ed-1967add625b9]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ff6242-c518-4dec-8523-2b1b9b73a89a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msPtkfQl {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msPtkfQl" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14c79a6-ff31-47a5-bf76-d945d6b04b87]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'msPtkfQl'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaa063d-a176-4c9f-b4aa-6c47b5917f69]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61f5809-2d35-474f-b15d-08f6880834e7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:23:57 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:23:57 user nova-compute[75021]:  {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:23:57 user nova-compute[75021]: WARNING os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 07:23:57 user nova-compute[75021]: 
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae601321-83a1-483f-8311-7f5ce571c917]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024, portal: 172.16.0.220,3260]
Dec 06 07:23:57 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024, portal: 172.16.0.220,3260] successful.
Dec 06 07:23:57 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25e41ff-5fe6-4278-b39c-705839f1f176]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf78aac-c562-45f4-bf3f-f1e95b8108cf]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 (non-flash)
Dec 06 07:23:57 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 (non-flash)
Dec 06 07:23:57 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8b3bd7-b97b-48d4-a3a7-a32196ad99c6]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:23:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msPtkfQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:23:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26631393562323537', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631393562323537', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:23:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-774413655',display_name='tempest-TestVolumeBootPattern-server-774413655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-774413655',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-gwxxw0cb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:23:42Z,user_data=None,user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=f0793413-e2d1-49f8-b5c1-9e5fa6c34531,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "address": "fa:16:3e:b8:3c:2f", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa324ccb-28", "ovs_interfaceid": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "address": "fa:16:3e:b8:3c:2f", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa324ccb-28", "ovs_interfaceid": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:3c:2f,bridge_name='br-int',has_traffic_filtering=True,id=fa324ccb-28ee-4d6f-83fd-c559cd6fe20b,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa324ccb-28') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG nova.objects.instance [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lazy-loading 'pci_devices' on Instance uuid f0793413-e2d1-49f8-b5c1-9e5fa6c34531 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:23:59 user nova-compute[75021]:   <uuid>f0793413-e2d1-49f8-b5c1-9e5fa6c34531</uuid>
Dec 06 07:23:59 user nova-compute[75021]:   <name>instance-00000029</name>
Dec 06 07:23:59 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:23:59 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:23:59 user nova-compute[75021]:   <metadata>
Dec 06 07:23:59 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:23:59 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:23:59 user nova-compute[75021]:       <nova:name>tempest-TestVolumeBootPattern-server-774413655</nova:name>
Dec 06 07:23:59 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:23:57</nova:creationTime>
Dec 06 07:23:59 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:23:59 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:23:59 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:23:59 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:23:59 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:23:59 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:23:59 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:23:59 user nova-compute[75021]:       <nova:owner>
Dec 06 07:23:59 user nova-compute[75021]:         <nova:user uuid="b39552dec3964bf69ed87b5ca130fe5f">tempest-TestVolumeBootPattern-1013845055-project-member</nova:user>
Dec 06 07:23:59 user nova-compute[75021]:         <nova:project uuid="00ddfde019af4962929aa2c8cfa84b35">tempest-TestVolumeBootPattern-1013845055</nova:project>
Dec 06 07:23:59 user nova-compute[75021]:       </nova:owner>
Dec 06 07:23:59 user nova-compute[75021]:       <nova:ports>
Dec 06 07:23:59 user nova-compute[75021]:         <nova:port uuid="fa324ccb-28ee-4d6f-83fd-c559cd6fe20b">
Dec 06 07:23:59 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 07:23:59 user nova-compute[75021]:         </nova:port>
Dec 06 07:23:59 user nova-compute[75021]:       </nova:ports>
Dec 06 07:23:59 user nova-compute[75021]:     </nova:instance>
Dec 06 07:23:59 user nova-compute[75021]:   </metadata>
Dec 06 07:23:59 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:23:59 user nova-compute[75021]:     <system>
Dec 06 07:23:59 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:23:59 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:23:59 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:23:59 user nova-compute[75021]:       <entry name="serial">f0793413-e2d1-49f8-b5c1-9e5fa6c34531</entry>
Dec 06 07:23:59 user nova-compute[75021]:       <entry name="uuid">f0793413-e2d1-49f8-b5c1-9e5fa6c34531</entry>
Dec 06 07:23:59 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:23:59 user nova-compute[75021]:     </system>
Dec 06 07:23:59 user nova-compute[75021]:   </sysinfo>
Dec 06 07:23:59 user nova-compute[75021]:   <os>
Dec 06 07:23:59 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:23:59 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:23:59 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:23:59 user nova-compute[75021]:   </os>
Dec 06 07:23:59 user nova-compute[75021]:   <features>
Dec 06 07:23:59 user nova-compute[75021]:     <acpi/>
Dec 06 07:23:59 user nova-compute[75021]:     <apic/>
Dec 06 07:23:59 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:23:59 user nova-compute[75021]:   </features>
Dec 06 07:23:59 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:23:59 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:23:59 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:23:59 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:23:59 user nova-compute[75021]:   </clock>
Dec 06 07:23:59 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:23:59 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:23:59 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:23:59 user nova-compute[75021]:   </cpu>
Dec 06 07:23:59 user nova-compute[75021]:   <devices>
Dec 06 07:23:59 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:23:59 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:23:59 user nova-compute[75021]:       <source dev="/dev/sdb"/>
Dec 06 07:23:59 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:23:59 user nova-compute[75021]:       <serial>dbe53363-f596-4995-90da-84de1157b024</serial>
Dec 06 07:23:59 user nova-compute[75021]:     </disk>
Dec 06 07:23:59 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:23:59 user nova-compute[75021]:       <mac address="fa:16:3e:b8:3c:2f"/>
Dec 06 07:23:59 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:23:59 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:23:59 user nova-compute[75021]:       <target dev="tapfa324ccb-28"/>
Dec 06 07:23:59 user nova-compute[75021]:     </interface>
Dec 06 07:23:59 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:23:59 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/f0793413-e2d1-49f8-b5c1-9e5fa6c34531/console.log" append="off"/>
Dec 06 07:23:59 user nova-compute[75021]:     </serial>
Dec 06 07:23:59 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:23:59 user nova-compute[75021]:     <video>
Dec 06 07:23:59 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:23:59 user nova-compute[75021]:     </video>
Dec 06 07:23:59 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:23:59 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:23:59 user nova-compute[75021]:     </rng>
Dec 06 07:23:59 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:23:59 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:23:59 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:23:59 user nova-compute[75021]:     </memballoon>
Dec 06 07:23:59 user nova-compute[75021]:   </devices>
Dec 06 07:23:59 user nova-compute[75021]: </domain>
Dec 06 07:23:59 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:23:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-774413655',display_name='tempest-TestVolumeBootPattern-server-774413655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-774413655',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-gwxxw0cb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:23:42Z,user_data=None,user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=f0793413-e2d1-49f8-b5c1-9e5fa6c34531,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "address": "fa:16:3e:b8:3c:2f", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa324ccb-28", "ovs_interfaceid": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "address": "fa:16:3e:b8:3c:2f", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa324ccb-28", "ovs_interfaceid": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:3c:2f,bridge_name='br-int',has_traffic_filtering=True,id=fa324ccb-28ee-4d6f-83fd-c559cd6fe20b,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa324ccb-28') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG os_vif [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:3c:2f,bridge_name='br-int',has_traffic_filtering=True,id=fa324ccb-28ee-4d6f-83fd-c559cd6fe20b,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa324ccb-28') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '254dfecc-bcef-5fbb-81ea-1136bf56cdfd', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa324ccb-28, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa324ccb-28, col_values=(('qos', UUID('a29f297a-885d-42ac-9ca2-3b9676b08f4e')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa324ccb-28, col_values=(('external_ids', {'iface-id': 'fa324ccb-28ee-4d6f-83fd-c559cd6fe20b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:3c:2f', 'vm-uuid': 'f0793413-e2d1-49f8-b5c1-9e5fa6c34531'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:59 user nova-compute[75021]: INFO os_vif [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:3c:2f,bridge_name='br-int',has_traffic_filtering=True,id=fa324ccb-28ee-4d6f-83fd-c559cd6fe20b,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa324ccb-28')
Dec 06 07:23:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] No VIF found with MAC fa:16:3e:b8:3c:2f, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:23:59 user nova-compute[75021]: INFO nova.compute.manager [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Terminating instance
Dec 06 07:23:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:23:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-c7dd2167-d03c-4ba3-a5b6-2664a8eca4ed req-36b3d19e-381c-45e1-b930-951120520765 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-unplugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c7dd2167-d03c-4ba3-a5b6-2664a8eca4ed req-36b3d19e-381c-45e1-b930-951120520765 service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c7dd2167-d03c-4ba3-a5b6-2664a8eca4ed req-36b3d19e-381c-45e1-b930-951120520765 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c7dd2167-d03c-4ba3-a5b6-2664a8eca4ed req-36b3d19e-381c-45e1-b930-951120520765 service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-c7dd2167-d03c-4ba3-a5b6-2664a8eca4ed req-36b3d19e-381c-45e1-b930-951120520765 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-unplugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG nova.compute.manager [req-c7dd2167-d03c-4ba3-a5b6-2664a8eca4ed req-36b3d19e-381c-45e1-b930-951120520765 service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-unplugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:00 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Instance destroyed successfully.
Dec 06 07:24:00 user nova-compute[75021]: DEBUG nova.objects.instance [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'resources' on Instance uuid 0dc18c93-5a40-4c98-a6bf-7422e45b245d {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-964895959',display_name='tempest-AttachVolumeTestJSON-server-964895959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-964895959',id=33,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXnsp33Va88K9HMduz0isu8LdTEYh6ifTevR8F0QY6TmOty18bkV5GKJPhgdUF5uYfbmmBq+t2VYhMvKtNZZK1CejSjAntwpRgpOFPsHdEq6Y3WTe/qlOipA1Kn8ihHeQ==',key_name='tempest-keypair-645111669',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:14:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0a2ff3d04db4832a990891c79df356c',ramdisk_id='',reservation_id='r-9za7bkf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280062788',owner_user_name='tempest-AttachVolumeTestJSON-280062788-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9947f4c20feb463fb485de2a7d4bbef5',uuid=0dc18c93-5a40-4c98-a6bf-7422e45b245d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converting VIF {"id": "ac69c289-818f-48bb-a95e-2e72646ef67e", "address": "fa:16:3e:4f:e9:89", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac69c289-81", "ovs_interfaceid": "ac69c289-818f-48bb-a95e-2e72646ef67e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG os_vif [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac69c289-81, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a29349d-5630-466d-9d0c-09468edb2070) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:24:00 user nova-compute[75021]: INFO os_vif [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=ac69c289-818f-48bb-a95e-2e72646ef67e,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac69c289-81')
Dec 06 07:24:00 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Deleting instance files /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d_del
Dec 06 07:24:00 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Deletion of /opt/stack/data/nova/instances/0dc18c93-5a40-4c98-a6bf-7422e45b245d_del complete
Dec 06 07:24:00 user nova-compute[75021]: INFO nova.compute.manager [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Took 1.35 seconds to destroy the instance on the hypervisor.
Dec 06 07:24:00 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:24:00 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:24:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-ca2bb675-e51b-4614-a6eb-542ae0846feb req-2fb2d399-3e6f-4306-bee9-9c911b94bafc service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Received event network-vif-plugged-fa324ccb-28ee-4d6f-83fd-c559cd6fe20b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:24:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ca2bb675-e51b-4614-a6eb-542ae0846feb req-2fb2d399-3e6f-4306-bee9-9c911b94bafc service nova] Acquiring lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ca2bb675-e51b-4614-a6eb-542ae0846feb req-2fb2d399-3e6f-4306-bee9-9c911b94bafc service nova] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ca2bb675-e51b-4614-a6eb-542ae0846feb req-2fb2d399-3e6f-4306-bee9-9c911b94bafc service nova] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-ca2bb675-e51b-4614-a6eb-542ae0846feb req-2fb2d399-3e6f-4306-bee9-9c911b94bafc service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] No waiting events found dispatching network-vif-plugged-fa324ccb-28ee-4d6f-83fd-c559cd6fe20b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:24:01 user nova-compute[75021]: WARNING nova.compute.manager [req-ca2bb675-e51b-4614-a6eb-542ae0846feb req-2fb2d399-3e6f-4306-bee9-9c911b94bafc service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Received unexpected event network-vif-plugged-fa324ccb-28ee-4d6f-83fd-c559cd6fe20b for instance with vm_state building and task_state spawning.
Dec 06 07:24:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:01 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:24:01 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Took 0.91 seconds to deallocate network for instance.
Dec 06 07:24:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:24:02 user nova-compute[75021]: WARNING nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received unexpected event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with vm_state deleted and task_state None.
Dec 06 07:24:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:24:02 user nova-compute[75021]: WARNING nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received unexpected event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with vm_state deleted and task_state None.
Dec 06 07:24:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:24:02 user nova-compute[75021]: WARNING nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received unexpected event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with vm_state deleted and task_state None.
Dec 06 07:24:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-unplugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-unplugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:24:02 user nova-compute[75021]: WARNING nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received unexpected event network-vif-unplugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with vm_state deleted and task_state None.
Dec 06 07:24:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] Acquiring lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] No waiting events found dispatching network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:24:02 user nova-compute[75021]: WARNING nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received unexpected event network-vif-plugged-ac69c289-818f-48bb-a95e-2e72646ef67e for instance with vm_state deleted and task_state None.
Dec 06 07:24:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-80dcb9c1-7b58-44ac-b64d-b5216d881c6a req-4bef2dd9-94f3-4c31-b9a7-fe24b640818c service nova] [instance: 0dc18c93-5a40-4c98-a6bf-7422e45b245d] Received event network-vif-deleted-ac69c289-818f-48bb-a95e-2e72646ef67e {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:02 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Deleted allocations for instance 0dc18c93-5a40-4c98-a6bf-7422e45b245d
Dec 06 07:24:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-7d7ad9fc-13ef-4764-8c06-7e1bdb011e94 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "0dc18c93-5a40-4c98-a6bf-7422e45b245d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.823s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:24:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:24:03 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Instance spawned successfully.
Dec 06 07:24:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:24:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:24:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:24:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:24:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:24:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:24:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:24:03 user nova-compute[75021]: INFO nova.compute.manager [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Took 5.66 seconds to spawn the instance on the hypervisor.
Dec 06 07:24:03 user nova-compute[75021]: DEBUG nova.compute.manager [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:24:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-fa2ddc3b-a6f3-49a5-afed-0aa1a4150026 req-07d1b1d5-0d02-45ca-a5dd-aa281a3c53a6 service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Received event network-vif-plugged-fa324ccb-28ee-4d6f-83fd-c559cd6fe20b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:24:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fa2ddc3b-a6f3-49a5-afed-0aa1a4150026 req-07d1b1d5-0d02-45ca-a5dd-aa281a3c53a6 service nova] Acquiring lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fa2ddc3b-a6f3-49a5-afed-0aa1a4150026 req-07d1b1d5-0d02-45ca-a5dd-aa281a3c53a6 service nova] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fa2ddc3b-a6f3-49a5-afed-0aa1a4150026 req-07d1b1d5-0d02-45ca-a5dd-aa281a3c53a6 service nova] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-fa2ddc3b-a6f3-49a5-afed-0aa1a4150026 req-07d1b1d5-0d02-45ca-a5dd-aa281a3c53a6 service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] No waiting events found dispatching network-vif-plugged-fa324ccb-28ee-4d6f-83fd-c559cd6fe20b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:24:03 user nova-compute[75021]: WARNING nova.compute.manager [req-fa2ddc3b-a6f3-49a5-afed-0aa1a4150026 req-07d1b1d5-0d02-45ca-a5dd-aa281a3c53a6 service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Received unexpected event network-vif-plugged-fa324ccb-28ee-4d6f-83fd-c559cd6fe20b for instance with vm_state building and task_state spawning.
Dec 06 07:24:03 user nova-compute[75021]: INFO nova.compute.manager [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Took 22.31 seconds to build instance.
Dec 06 07:24:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4ca53d00-4a29-454c-a61c-3018da9e8286 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.449s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "b9372825-c75d-45a3-a48c-e111869d97a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "b9372825-c75d-45a3-a48c-e111869d97a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "b9372825-c75d-45a3-a48c-e111869d97a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "b9372825-c75d-45a3-a48c-e111869d97a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "b9372825-c75d-45a3-a48c-e111869d97a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:06 user nova-compute[75021]: INFO nova.compute.manager [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Terminating instance
Dec 06 07:24:06 user nova-compute[75021]: DEBUG nova.compute.manager [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:24:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-4fbde92f-187e-48c5-ab25-70aecd9c16e2 req-fdce716a-ee66-4ba3-81c9-3c7f68ea0edf service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Received event network-vif-unplugged-94c8a95e-1a3a-435e-9f29-9acee536f79f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:24:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4fbde92f-187e-48c5-ab25-70aecd9c16e2 req-fdce716a-ee66-4ba3-81c9-3c7f68ea0edf service nova] Acquiring lock "b9372825-c75d-45a3-a48c-e111869d97a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4fbde92f-187e-48c5-ab25-70aecd9c16e2 req-fdce716a-ee66-4ba3-81c9-3c7f68ea0edf service nova] Lock "b9372825-c75d-45a3-a48c-e111869d97a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4fbde92f-187e-48c5-ab25-70aecd9c16e2 req-fdce716a-ee66-4ba3-81c9-3c7f68ea0edf service nova] Lock "b9372825-c75d-45a3-a48c-e111869d97a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-4fbde92f-187e-48c5-ab25-70aecd9c16e2 req-fdce716a-ee66-4ba3-81c9-3c7f68ea0edf service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] No waiting events found dispatching network-vif-unplugged-94c8a95e-1a3a-435e-9f29-9acee536f79f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:24:06 user nova-compute[75021]: DEBUG nova.compute.manager [req-4fbde92f-187e-48c5-ab25-70aecd9c16e2 req-fdce716a-ee66-4ba3-81c9-3c7f68ea0edf service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Received event network-vif-unplugged-94c8a95e-1a3a-435e-9f29-9acee536f79f for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:24:07 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Instance destroyed successfully.
Dec 06 07:24:07 user nova-compute[75021]: DEBUG nova.objects.instance [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lazy-loading 'resources' on Instance uuid b9372825-c75d-45a3-a48c-e111869d97a5 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:24:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:04:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-906679252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-906679252',id=19,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:04:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9895e43bf76d4760a26a5e64ea6d4e14',ramdisk_id='',reservation_id='r-2dqgtfat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:06:25Z,user_data=None,user_id='c0774aa1e3ee4b69b195b575d116ee96',uuid=b9372825-c75d-45a3-a48c-e111869d97a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "address": "fa:16:3e:fb:4a:05", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c8a95e-1a", "ovs_interfaceid": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:24:07 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converting VIF {"id": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "address": "fa:16:3e:fb:4a:05", "network": {"id": "fad96c74-d290-4862-b617-3918f516c498", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2081979004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9895e43bf76d4760a26a5e64ea6d4e14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c8a95e-1a", "ovs_interfaceid": "94c8a95e-1a3a-435e-9f29-9acee536f79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:24:07 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:4a:05,bridge_name='br-int',has_traffic_filtering=True,id=94c8a95e-1a3a-435e-9f29-9acee536f79f,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c8a95e-1a') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:24:07 user nova-compute[75021]: DEBUG os_vif [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:4a:05,bridge_name='br-int',has_traffic_filtering=True,id=94c8a95e-1a3a-435e-9f29-9acee536f79f,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c8a95e-1a') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:24:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94c8a95e-1a, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:24:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:24:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37335de7-9ba4-4061-b46e-a90d6de78054) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:24:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:24:07 user nova-compute[75021]: INFO os_vif [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:4a:05,bridge_name='br-int',has_traffic_filtering=True,id=94c8a95e-1a3a-435e-9f29-9acee536f79f,network=Network(fad96c74-d290-4862-b617-3918f516c498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c8a95e-1a')
Dec 06 07:24:07 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Deleting instance files /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5_del
Dec 06 07:24:07 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Deletion of /opt/stack/data/nova/instances/b9372825-c75d-45a3-a48c-e111869d97a5_del complete
Dec 06 07:24:07 user nova-compute[75021]: INFO nova.compute.manager [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Took 1.15 seconds to destroy the instance on the hypervisor.
Dec 06 07:24:07 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:24:07 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:24:07 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:24:08 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:24:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-551c6e31-7bfc-42f2-a635-94d2614cecbe req-97618bd2-3615-4ec6-8243-7bb589820944 service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Received event network-vif-plugged-94c8a95e-1a3a-435e-9f29-9acee536f79f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:24:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-551c6e31-7bfc-42f2-a635-94d2614cecbe req-97618bd2-3615-4ec6-8243-7bb589820944 service nova] Acquiring lock "b9372825-c75d-45a3-a48c-e111869d97a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-551c6e31-7bfc-42f2-a635-94d2614cecbe req-97618bd2-3615-4ec6-8243-7bb589820944 service nova] Lock "b9372825-c75d-45a3-a48c-e111869d97a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-551c6e31-7bfc-42f2-a635-94d2614cecbe req-97618bd2-3615-4ec6-8243-7bb589820944 service nova] Lock "b9372825-c75d-45a3-a48c-e111869d97a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-551c6e31-7bfc-42f2-a635-94d2614cecbe req-97618bd2-3615-4ec6-8243-7bb589820944 service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] No waiting events found dispatching network-vif-plugged-94c8a95e-1a3a-435e-9f29-9acee536f79f {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:24:08 user nova-compute[75021]: WARNING nova.compute.manager [req-551c6e31-7bfc-42f2-a635-94d2614cecbe req-97618bd2-3615-4ec6-8243-7bb589820944 service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Received unexpected event network-vif-plugged-94c8a95e-1a3a-435e-9f29-9acee536f79f for instance with vm_state active and task_state deleting.
Dec 06 07:24:08 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Took 1.18 seconds to deallocate network for instance.
Dec 06 07:24:08 user nova-compute[75021]: DEBUG nova.compute.manager [req-3819b5c9-545b-4170-b6be-bd7be5eeb239 req-5da0b2b0-2b58-44a5-80cd-d86ddcd8a97e service nova] [instance: b9372825-c75d-45a3-a48c-e111869d97a5] Received event network-vif-deleted-94c8a95e-1a3a-435e-9f29-9acee536f79f {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:24:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:08 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:24:08 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:24:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:09 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Deleted allocations for instance b9372825-c75d-45a3-a48c-e111869d97a5
Dec 06 07:24:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-fcedbd1b-15cf-4c0c-ab5c-c14abcdb56d3 tempest-ServerBootFromVolumeStableRescueTest-1272250883 tempest-ServerBootFromVolumeStableRescueTest-1272250883-project-member] Lock "b9372825-c75d-45a3-a48c-e111869d97a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.726s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:15 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:24:15 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:24:15 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:24:17 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:24:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:24:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:24:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:24:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:24:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:24:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:24:18 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:24:18 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:24:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8591MB free_disk=25.316757202148438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:24:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance f0793413-e2d1-49f8-b5c1-9e5fa6c34531 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:24:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5a0c7109-a15e-440b-b0f3-785721e55627 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:24:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:24:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:24:18 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:24:18 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:24:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:24:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:24:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:24:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 07:24:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:24:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:24:20 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:24:20 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:24:21 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:24:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:24:53 user nova-compute[75021]: INFO nova.compute.claims [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Claim successful on node user
Dec 06 07:24:53 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG nova.network.neutron [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:24:53 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:24:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:24:53 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Creating image(s)
Dec 06 07:24:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "/opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "/opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG nova.policy [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9947f4c20feb463fb485de2a7d4bbef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a2ff3d04db4832a990891c79df356c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.190s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk 1073741824" returned: 0 in 0.056s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.172s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG nova.network.neutron [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Successfully created port: 3dcc8cb9-4843-41a8-b7be-28b096f782e7 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Cannot resize image /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Ensure instance console log exists: /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.network.neutron [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Successfully updated port: 3dcc8cb9-4843-41a8-b7be-28b096f782e7 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "refresh_cache-9fe9bf1d-78d1-4e46-825c-bb98245de86f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquired lock "refresh_cache-9fe9bf1d-78d1-4e46-825c-bb98245de86f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.network.neutron [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-1c86dfe7-6982-4e74-8df5-9f039daf708c req-4cfec086-a70b-4927-b9d7-c3c8b31fa82e service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Received event network-changed-3dcc8cb9-4843-41a8-b7be-28b096f782e7 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.compute.manager [req-1c86dfe7-6982-4e74-8df5-9f039daf708c req-4cfec086-a70b-4927-b9d7-c3c8b31fa82e service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Refreshing instance network info cache due to event network-changed-3dcc8cb9-4843-41a8-b7be-28b096f782e7. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1c86dfe7-6982-4e74-8df5-9f039daf708c req-4cfec086-a70b-4927-b9d7-c3c8b31fa82e service nova] Acquiring lock "refresh_cache-9fe9bf1d-78d1-4e46-825c-bb98245de86f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.network.neutron [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.network.neutron [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Updating instance_info_cache with network_info: [{"id": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "address": "fa:16:3e:f7:29:3a", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcc8cb9-48", "ovs_interfaceid": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Releasing lock "refresh_cache-9fe9bf1d-78d1-4e46-825c-bb98245de86f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Instance network_info: |[{"id": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "address": "fa:16:3e:f7:29:3a", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcc8cb9-48", "ovs_interfaceid": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1c86dfe7-6982-4e74-8df5-9f039daf708c req-4cfec086-a70b-4927-b9d7-c3c8b31fa82e service nova] Acquired lock "refresh_cache-9fe9bf1d-78d1-4e46-825c-bb98245de86f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.network.neutron [req-1c86dfe7-6982-4e74-8df5-9f039daf708c req-4cfec086-a70b-4927-b9d7-c3c8b31fa82e service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Refreshing network info cache for port 3dcc8cb9-4843-41a8-b7be-28b096f782e7 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Start _get_guest_xml network_info=[{"id": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "address": "fa:16:3e:f7:29:3a", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcc8cb9-48", "ovs_interfaceid": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:24:55 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:24:55 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1709808972',display_name='tempest-AttachVolumeTestJSON-server-1709808972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1709808972',id=43,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJ+KXeJODumjlDd6jRjNsA12jHuqNdF7LgK5HoRS0XlyiFWPsrLxBN53u4Lj+H+FMW68FReRN3GCieZxZMwIVyIV1Pt/j2A8NcpgcMAfDJtHsyAaAI1AQPxIeb15zGkjw==',key_name='tempest-keypair-450775644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0a2ff3d04db4832a990891c79df356c',ramdisk_id='',reservation_id='r-dvmd3an5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-280062788',owner_user_name='tempest-AttachVolumeTestJSON-280062788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9947f4c20feb463fb485de2a7d4bbef5',uuid=9fe9bf1d-78d1-4e46-825c-bb98245de86f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "address": "fa:16:3e:f7:29:3a", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcc8cb9-48", "ovs_interfaceid": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converting VIF {"id": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "address": "fa:16:3e:f7:29:3a", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcc8cb9-48", "ovs_interfaceid": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:29:3a,bridge_name='br-int',has_traffic_filtering=True,id=3dcc8cb9-4843-41a8-b7be-28b096f782e7,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dcc8cb9-48') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.objects.instance [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fe9bf1d-78d1-4e46-825c-bb98245de86f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:24:55 user nova-compute[75021]:   <uuid>9fe9bf1d-78d1-4e46-825c-bb98245de86f</uuid>
Dec 06 07:24:55 user nova-compute[75021]:   <name>instance-0000002b</name>
Dec 06 07:24:55 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:24:55 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:24:55 user nova-compute[75021]:   <metadata>
Dec 06 07:24:55 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:24:55 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:24:55 user nova-compute[75021]:       <nova:name>tempest-AttachVolumeTestJSON-server-1709808972</nova:name>
Dec 06 07:24:55 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:24:55</nova:creationTime>
Dec 06 07:24:55 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:24:55 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:24:55 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:24:55 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:24:55 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:24:55 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:24:55 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:24:55 user nova-compute[75021]:       <nova:owner>
Dec 06 07:24:55 user nova-compute[75021]:         <nova:user uuid="9947f4c20feb463fb485de2a7d4bbef5">tempest-AttachVolumeTestJSON-280062788-project-member</nova:user>
Dec 06 07:24:55 user nova-compute[75021]:         <nova:project uuid="f0a2ff3d04db4832a990891c79df356c">tempest-AttachVolumeTestJSON-280062788</nova:project>
Dec 06 07:24:55 user nova-compute[75021]:       </nova:owner>
Dec 06 07:24:55 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:24:55 user nova-compute[75021]:       <nova:ports>
Dec 06 07:24:55 user nova-compute[75021]:         <nova:port uuid="3dcc8cb9-4843-41a8-b7be-28b096f782e7">
Dec 06 07:24:55 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 07:24:55 user nova-compute[75021]:         </nova:port>
Dec 06 07:24:55 user nova-compute[75021]:       </nova:ports>
Dec 06 07:24:55 user nova-compute[75021]:     </nova:instance>
Dec 06 07:24:55 user nova-compute[75021]:   </metadata>
Dec 06 07:24:55 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:24:55 user nova-compute[75021]:     <system>
Dec 06 07:24:55 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:24:55 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:24:55 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:24:55 user nova-compute[75021]:       <entry name="serial">9fe9bf1d-78d1-4e46-825c-bb98245de86f</entry>
Dec 06 07:24:55 user nova-compute[75021]:       <entry name="uuid">9fe9bf1d-78d1-4e46-825c-bb98245de86f</entry>
Dec 06 07:24:55 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:24:55 user nova-compute[75021]:     </system>
Dec 06 07:24:55 user nova-compute[75021]:   </sysinfo>
Dec 06 07:24:55 user nova-compute[75021]:   <os>
Dec 06 07:24:55 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:24:55 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:24:55 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:24:55 user nova-compute[75021]:   </os>
Dec 06 07:24:55 user nova-compute[75021]:   <features>
Dec 06 07:24:55 user nova-compute[75021]:     <acpi/>
Dec 06 07:24:55 user nova-compute[75021]:     <apic/>
Dec 06 07:24:55 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:24:55 user nova-compute[75021]:   </features>
Dec 06 07:24:55 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:24:55 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:24:55 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:24:55 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:24:55 user nova-compute[75021]:   </clock>
Dec 06 07:24:55 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:24:55 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:24:55 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:24:55 user nova-compute[75021]:   </cpu>
Dec 06 07:24:55 user nova-compute[75021]:   <devices>
Dec 06 07:24:55 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:24:55 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:24:55 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk"/>
Dec 06 07:24:55 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:24:55 user nova-compute[75021]:     </disk>
Dec 06 07:24:55 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:24:55 user nova-compute[75021]:       <mac address="fa:16:3e:f7:29:3a"/>
Dec 06 07:24:55 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:24:55 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:24:55 user nova-compute[75021]:       <target dev="tap3dcc8cb9-48"/>
Dec 06 07:24:55 user nova-compute[75021]:     </interface>
Dec 06 07:24:55 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:24:55 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/console.log" append="off"/>
Dec 06 07:24:55 user nova-compute[75021]:     </serial>
Dec 06 07:24:55 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:24:55 user nova-compute[75021]:     <video>
Dec 06 07:24:55 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:24:55 user nova-compute[75021]:     </video>
Dec 06 07:24:55 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:24:55 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:24:55 user nova-compute[75021]:     </rng>
Dec 06 07:24:55 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:24:55 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:24:55 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:24:55 user nova-compute[75021]:     </memballoon>
Dec 06 07:24:55 user nova-compute[75021]:   </devices>
Dec 06 07:24:55 user nova-compute[75021]: </domain>
Dec 06 07:24:55 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1709808972',display_name='tempest-AttachVolumeTestJSON-server-1709808972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1709808972',id=43,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJ+KXeJODumjlDd6jRjNsA12jHuqNdF7LgK5HoRS0XlyiFWPsrLxBN53u4Lj+H+FMW68FReRN3GCieZxZMwIVyIV1Pt/j2A8NcpgcMAfDJtHsyAaAI1AQPxIeb15zGkjw==',key_name='tempest-keypair-450775644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0a2ff3d04db4832a990891c79df356c',ramdisk_id='',reservation_id='r-dvmd3an5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-280062788',owner_user_name='tempest-AttachVolumeTestJSON-280062788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9947f4c20feb463fb485de2a7d4bbef5',uuid=9fe9bf1d-78d1-4e46-825c-bb98245de86f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "address": "fa:16:3e:f7:29:3a", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcc8cb9-48", "ovs_interfaceid": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converting VIF {"id": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "address": "fa:16:3e:f7:29:3a", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcc8cb9-48", "ovs_interfaceid": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:29:3a,bridge_name='br-int',has_traffic_filtering=True,id=3dcc8cb9-4843-41a8-b7be-28b096f782e7,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dcc8cb9-48') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG os_vif [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:29:3a,bridge_name='br-int',has_traffic_filtering=True,id=3dcc8cb9-4843-41a8-b7be-28b096f782e7,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dcc8cb9-48') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '950aa6c4-6ae4-5478-b1e9-3356293971d7', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dcc8cb9-48, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3dcc8cb9-48, col_values=(('qos', UUID('d2cd6768-9a32-4cd0-a6c4-38d3525f8809')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3dcc8cb9-48, col_values=(('external_ids', {'iface-id': '3dcc8cb9-4843-41a8-b7be-28b096f782e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:29:3a', 'vm-uuid': '9fe9bf1d-78d1-4e46-825c-bb98245de86f'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:55 user nova-compute[75021]: INFO os_vif [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:29:3a,bridge_name='br-int',has_traffic_filtering=True,id=3dcc8cb9-4843-41a8-b7be-28b096f782e7,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dcc8cb9-48')
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:24:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] No VIF found with MAC fa:16:3e:f7:29:3a, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:24:56 user nova-compute[75021]: DEBUG nova.network.neutron [req-1c86dfe7-6982-4e74-8df5-9f039daf708c req-4cfec086-a70b-4927-b9d7-c3c8b31fa82e service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Updated VIF entry in instance network info cache for port 3dcc8cb9-4843-41a8-b7be-28b096f782e7. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:24:56 user nova-compute[75021]: DEBUG nova.network.neutron [req-1c86dfe7-6982-4e74-8df5-9f039daf708c req-4cfec086-a70b-4927-b9d7-c3c8b31fa82e service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Updating instance_info_cache with network_info: [{"id": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "address": "fa:16:3e:f7:29:3a", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcc8cb9-48", "ovs_interfaceid": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:24:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1c86dfe7-6982-4e74-8df5-9f039daf708c req-4cfec086-a70b-4927-b9d7-c3c8b31fa82e service nova] Releasing lock "refresh_cache-9fe9bf1d-78d1-4e46-825c-bb98245de86f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:24:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:57 user nova-compute[75021]: DEBUG nova.compute.manager [req-d29ffd79-0695-4127-bea0-50b782e481db req-3b51e948-9787-489e-9eb9-4c0b7633629f service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Received event network-vif-plugged-3dcc8cb9-4843-41a8-b7be-28b096f782e7 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:24:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d29ffd79-0695-4127-bea0-50b782e481db req-3b51e948-9787-489e-9eb9-4c0b7633629f service nova] Acquiring lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d29ffd79-0695-4127-bea0-50b782e481db req-3b51e948-9787-489e-9eb9-4c0b7633629f service nova] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d29ffd79-0695-4127-bea0-50b782e481db req-3b51e948-9787-489e-9eb9-4c0b7633629f service nova] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:57 user nova-compute[75021]: DEBUG nova.compute.manager [req-d29ffd79-0695-4127-bea0-50b782e481db req-3b51e948-9787-489e-9eb9-4c0b7633629f service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] No waiting events found dispatching network-vif-plugged-3dcc8cb9-4843-41a8-b7be-28b096f782e7 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:24:57 user nova-compute[75021]: WARNING nova.compute.manager [req-d29ffd79-0695-4127-bea0-50b782e481db req-3b51e948-9787-489e-9eb9-4c0b7633629f service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Received unexpected event network-vif-plugged-3dcc8cb9-4843-41a8-b7be-28b096f782e7 for instance with vm_state building and task_state spawning.
Dec 06 07:24:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:24:59 user nova-compute[75021]: DEBUG nova.compute.manager [req-c2b30ca6-a201-4f20-9d36-f075ea699191 req-844eb94e-a08c-45a3-b8bb-87013b518a9f service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Received event network-vif-plugged-3dcc8cb9-4843-41a8-b7be-28b096f782e7 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:24:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c2b30ca6-a201-4f20-9d36-f075ea699191 req-844eb94e-a08c-45a3-b8bb-87013b518a9f service nova] Acquiring lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:24:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c2b30ca6-a201-4f20-9d36-f075ea699191 req-844eb94e-a08c-45a3-b8bb-87013b518a9f service nova] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:24:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c2b30ca6-a201-4f20-9d36-f075ea699191 req-844eb94e-a08c-45a3-b8bb-87013b518a9f service nova] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:24:59 user nova-compute[75021]: DEBUG nova.compute.manager [req-c2b30ca6-a201-4f20-9d36-f075ea699191 req-844eb94e-a08c-45a3-b8bb-87013b518a9f service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] No waiting events found dispatching network-vif-plugged-3dcc8cb9-4843-41a8-b7be-28b096f782e7 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:24:59 user nova-compute[75021]: WARNING nova.compute.manager [req-c2b30ca6-a201-4f20-9d36-f075ea699191 req-844eb94e-a08c-45a3-b8bb-87013b518a9f service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Received unexpected event network-vif-plugged-3dcc8cb9-4843-41a8-b7be-28b096f782e7 for instance with vm_state building and task_state spawning.
Dec 06 07:24:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:24:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:24:59 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Instance spawned successfully.
Dec 06 07:24:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:24:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:24:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:24:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:24:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:24:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:24:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:24:59 user nova-compute[75021]: INFO nova.compute.manager [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Took 6.01 seconds to spawn the instance on the hypervisor.
Dec 06 07:24:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:25:00 user nova-compute[75021]: INFO nova.compute.manager [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Took 6.58 seconds to build instance.
Dec 06 07:25:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-3d1b8e1b-85eb-4801-89f8-4e8a6cf3f0fb tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.672s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:25:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:04 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:25:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:25:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:25:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:25:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:25:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:25:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:16 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:25:17 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:25:17 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:25:17 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:25:17 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:25:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:25:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:25:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:25:17 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:25:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:25:18 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:25:18 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:25:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8597MB free_disk=25.286026000976562GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:25:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:25:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:25:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance f0793413-e2d1-49f8-b5c1-9e5fa6c34531 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:25:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5a0c7109-a15e-440b-b0f3-785721e55627 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:25:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:25:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:25:18 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:25:19 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:25:19 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:25:19 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:25:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:25:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:20 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:25:20 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:25:20 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:25:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-f0793413-e2d1-49f8-b5c1-9e5fa6c34531" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:25:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-f0793413-e2d1-49f8-b5c1-9e5fa6c34531" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:25:20 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:25:20 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid f0793413-e2d1-49f8-b5c1-9e5fa6c34531 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:25:20 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Updating instance_info_cache with network_info: [{"id": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "address": "fa:16:3e:b8:3c:2f", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa324ccb-28", "ovs_interfaceid": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:25:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-f0793413-e2d1-49f8-b5c1-9e5fa6c34531" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:25:20 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:25:20 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:25:20 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:25:20 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:25:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:21 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:25:22 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:25:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:27 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:25:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:30 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:25:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75021) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 07:25:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:25:32 user nova-compute[75021]: INFO nova.compute.manager [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Terminating instance
Dec 06 07:25:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG nova.compute.manager [req-8f6a849f-a37d-4da1-a025-14be77815e24 req-18fe0e04-b974-4eca-95ad-56838dc458d5 service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Received event network-vif-unplugged-fa324ccb-28ee-4d6f-83fd-c559cd6fe20b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8f6a849f-a37d-4da1-a025-14be77815e24 req-18fe0e04-b974-4eca-95ad-56838dc458d5 service nova] Acquiring lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8f6a849f-a37d-4da1-a025-14be77815e24 req-18fe0e04-b974-4eca-95ad-56838dc458d5 service nova] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8f6a849f-a37d-4da1-a025-14be77815e24 req-18fe0e04-b974-4eca-95ad-56838dc458d5 service nova] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG nova.compute.manager [req-8f6a849f-a37d-4da1-a025-14be77815e24 req-18fe0e04-b974-4eca-95ad-56838dc458d5 service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] No waiting events found dispatching network-vif-unplugged-fa324ccb-28ee-4d6f-83fd-c559cd6fe20b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG nova.compute.manager [req-8f6a849f-a37d-4da1-a025-14be77815e24 req-18fe0e04-b974-4eca-95ad-56838dc458d5 service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Received event network-vif-unplugged-fa324ccb-28ee-4d6f-83fd-c559cd6fe20b for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:32 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Instance destroyed successfully.
Dec 06 07:25:32 user nova-compute[75021]: DEBUG nova.objects.instance [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lazy-loading 'resources' on Instance uuid f0793413-e2d1-49f8-b5c1-9e5fa6c34531 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:23:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-774413655',display_name='tempest-TestVolumeBootPattern-server-774413655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-774413655',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:24:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-gwxxw0cb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:24:03Z,user_data=None,user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=f0793413-e2d1-49f8-b5c1-9e5fa6c34531,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "address": "fa:16:3e:b8:3c:2f", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa324ccb-28", "ovs_interfaceid": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "address": "fa:16:3e:b8:3c:2f", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa324ccb-28", "ovs_interfaceid": "fa324ccb-28ee-4d6f-83fd-c559cd6fe20b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:3c:2f,bridge_name='br-int',has_traffic_filtering=True,id=fa324ccb-28ee-4d6f-83fd-c559cd6fe20b,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa324ccb-28') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG os_vif [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:3c:2f,bridge_name='br-int',has_traffic_filtering=True,id=fa324ccb-28ee-4d6f-83fd-c559cd6fe20b,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa324ccb-28') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa324ccb-28, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a29f297a-885d-42ac-9ca2-3b9676b08f4e) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:25:32 user nova-compute[75021]: INFO os_vif [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:3c:2f,bridge_name='br-int',has_traffic_filtering=True,id=fa324ccb-28ee-4d6f-83fd-c559cd6fe20b,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa324ccb-28')
Dec 06 07:25:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msPtkfQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:25:32 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:25:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d3ddc5-4f36-4307-8edd-e91b0f28efce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:25:32 user nova-compute[75021]: No targets found.
Dec 06 07:25:32 user nova-compute[75021]: iSNS:
Dec 06 07:25:32 user nova-compute[75021]: No targets found.
Dec 06 07:25:32 user nova-compute[75021]: STATIC:
Dec 06 07:25:32 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024
Dec 06 07:25:32 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:25:32 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:25:32 user nova-compute[75021]: FIRMWARE:
Dec 06 07:25:32 user nova-compute[75021]: No targets found.
Dec 06 07:25:32 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:25:32 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:25:32 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d242af-fcf5-4c70-82c3-0cf2a3aefc2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[109062b8-7232-44ac-a002-3ccdb5d22064]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 (non-flash)
Dec 06 07:25:32 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 (non-flash)
Dec 06 07:25:32 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b4765d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:25:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6e00da-c8b0-4c04-874b-8b269e7fafc7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a1b01d-7e42-489b-8f09-8c500e23d4ad]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3293ae9-d9d0-420c-8bfe-1c400d200593]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7f2066-b30f-4007-9cd8-7c422bb6b691]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8baf0587', '/dev/disk/by-id/scsi-26631393562323537', '/dev/disk/by-id/scsi-1SCST_BIO8baf0587-f195b25709040e0a') {{(pid=86148) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[958f1aec-c76a-496c-808d-b052c8027f6c]: (4, None) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5960bff5-6658-49ce-863c-eeb010da8b37]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb569017-7e9a-4446-89ef-596a3e1993c1]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024, portal: 172.16.0.220,3260]
Dec 06 07:25:33 user nova-compute[75021]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024, portal: 172.16.0.220,3260] successful.
Dec 06 07:25:33 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe53363-f596-4995-90da-84de1157b024 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[66044283-f090-4b33-bc60-19cf14081b01]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== disconnect_volume: return (327ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:25:33 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Deleting instance files /opt/stack/data/nova/instances/f0793413-e2d1-49f8-b5c1-9e5fa6c34531_del
Dec 06 07:25:33 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Deletion of /opt/stack/data/nova/instances/f0793413-e2d1-49f8-b5c1-9e5fa6c34531_del complete
Dec 06 07:25:33 user nova-compute[75021]: INFO nova.compute.manager [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Took 1.22 seconds to destroy the instance on the hypervisor.
Dec 06 07:25:33 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:25:33 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-4f608ca0-8c27-4dc1-8e39-75c331d053f2 req-e08a4c8b-b6b6-41ad-a5a9-da98162fb7fa service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Received event network-vif-deleted-fa324ccb-28ee-4d6f-83fd-c559cd6fe20b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:25:34 user nova-compute[75021]: INFO nova.compute.manager [req-4f608ca0-8c27-4dc1-8e39-75c331d053f2 req-e08a4c8b-b6b6-41ad-a5a9-da98162fb7fa service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Neutron deleted interface fa324ccb-28ee-4d6f-83fd-c559cd6fe20b; detaching it from the instance and deleting it from the info cache
Dec 06 07:25:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-4f608ca0-8c27-4dc1-8e39-75c331d053f2 req-e08a4c8b-b6b6-41ad-a5a9-da98162fb7fa service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:25:34 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Took 0.75 seconds to deallocate network for instance.
Dec 06 07:25:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-4f608ca0-8c27-4dc1-8e39-75c331d053f2 req-e08a4c8b-b6b6-41ad-a5a9-da98162fb7fa service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Detach interface failed, port_id=fa324ccb-28ee-4d6f-83fd-c559cd6fe20b, reason: Instance f0793413-e2d1-49f8-b5c1-9e5fa6c34531 could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:25:34 user nova-compute[75021]: WARNING nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Dec 06 07:25:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 9fe9bf1d-78d1-4e46-825c-bb98245de86f {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid f0793413-e2d1-49f8-b5c1-9e5fa6c34531 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "5a0c7109-a15e-440b-b0f3-785721e55627" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "5a0c7109-a15e-440b-b0f3-785721e55627" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-f8bff5d9-f19f-47c8-9312-d52dbad6af23 req-fd6bfdd0-cd96-47c0-b880-49bf70bb8c9d service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Received event network-vif-plugged-fa324ccb-28ee-4d6f-83fd-c559cd6fe20b {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f8bff5d9-f19f-47c8-9312-d52dbad6af23 req-fd6bfdd0-cd96-47c0-b880-49bf70bb8c9d service nova] Acquiring lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f8bff5d9-f19f-47c8-9312-d52dbad6af23 req-fd6bfdd0-cd96-47c0-b880-49bf70bb8c9d service nova] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f8bff5d9-f19f-47c8-9312-d52dbad6af23 req-fd6bfdd0-cd96-47c0-b880-49bf70bb8c9d service nova] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:25:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-f8bff5d9-f19f-47c8-9312-d52dbad6af23 req-fd6bfdd0-cd96-47c0-b880-49bf70bb8c9d service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] No waiting events found dispatching network-vif-plugged-fa324ccb-28ee-4d6f-83fd-c559cd6fe20b {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:25:34 user nova-compute[75021]: WARNING nova.compute.manager [req-f8bff5d9-f19f-47c8-9312-d52dbad6af23 req-fd6bfdd0-cd96-47c0-b880-49bf70bb8c9d service nova] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Received unexpected event network-vif-plugged-fa324ccb-28ee-4d6f-83fd-c559cd6fe20b for instance with vm_state active and task_state deleting.
Dec 06 07:25:34 user nova-compute[75021]: INFO nova.compute.manager [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Took 0.85 seconds to detach 1 volumes for instance.
Dec 06 07:25:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] Deleting volume: dbe53363-f596-4995-90da-84de1157b024 {{(pid=75021) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 07:25:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:25:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:25:35 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:25:35 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:25:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:25:35 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Deleted allocations for instance f0793413-e2d1-49f8-b5c1-9e5fa6c34531
Dec 06 07:25:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c13b44ba-fe3e-41e0-90db-c6238710ebc2 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.357s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:25:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.105s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:25:35 user nova-compute[75021]: INFO nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: f0793413-e2d1-49f8-b5c1-9e5fa6c34531] During sync_power_state the instance has a pending task (deleting). Skip.
Dec 06 07:25:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "f0793413-e2d1-49f8-b5c1-9e5fa6c34531" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:25:35 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:25:35 user nova-compute[75021]: INFO nova.compute.manager [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] instance snapshotting
Dec 06 07:25:35 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Beginning live snapshot process
Dec 06 07:25:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json -f qcow2 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json -f qcow2 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-b4b0ac0c-0273-4a14-bdf2-e4b51f0d111e req-3b44754b-6d0c-4149-b6e2-f285244a823b service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-changed-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:25:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-b4b0ac0c-0273-4a14-bdf2-e4b51f0d111e req-3b44754b-6d0c-4149-b6e2-f285244a823b service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Refreshing instance network info cache due to event network-changed-f342e747-6e80-462b-8193-7acecbc16a79. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:25:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b4b0ac0c-0273-4a14-bdf2-e4b51f0d111e req-3b44754b-6d0c-4149-b6e2-f285244a823b service nova] Acquiring lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:25:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b4b0ac0c-0273-4a14-bdf2-e4b51f0d111e req-3b44754b-6d0c-4149-b6e2-f285244a823b service nova] Acquired lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:25:36 user nova-compute[75021]: DEBUG nova.network.neutron [req-b4b0ac0c-0273-4a14-bdf2-e4b51f0d111e req-3b44754b-6d0c-4149-b6e2-f285244a823b service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Refreshing network info cache for port f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:25:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.190s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv59j0my_/3e3ce3470ec54458a771648a6b9623fe.delta 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv59j0my_/3e3ce3470ec54458a771648a6b9623fe.delta 1073741824" returned: 0 in 0.059s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:36 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 06 07:25:37 user nova-compute[75021]: DEBUG nova.network.neutron [req-b4b0ac0c-0273-4a14-bdf2-e4b51f0d111e req-3b44754b-6d0c-4149-b6e2-f285244a823b service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updated VIF entry in instance network info cache for port f342e747-6e80-462b-8193-7acecbc16a79. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:25:37 user nova-compute[75021]: DEBUG nova.network.neutron [req-b4b0ac0c-0273-4a14-bdf2-e4b51f0d111e req-3b44754b-6d0c-4149-b6e2-f285244a823b service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updating instance_info_cache with network_info: [{"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:25:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b4b0ac0c-0273-4a14-bdf2-e4b51f0d111e req-3b44754b-6d0c-4149-b6e2-f285244a823b service nova] Releasing lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:25:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:25:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75021) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 06 07:25:38 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 06 07:25:38 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 07:25:38 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv59j0my_/3e3ce3470ec54458a771648a6b9623fe.delta /opt/stack/data/nova/instances/snapshots/tmpv59j0my_/3e3ce3470ec54458a771648a6b9623fe {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:25:38 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv59j0my_/3e3ce3470ec54458a771648a6b9623fe.delta /opt/stack/data/nova/instances/snapshots/tmpv59j0my_/3e3ce3470ec54458a771648a6b9623fe" returned: 0 in 0.525s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:25:38 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Snapshot extracted, beginning image upload
Dec 06 07:25:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:41 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Snapshot image upload complete
Dec 06 07:25:41 user nova-compute[75021]: INFO nova.compute.manager [None req-6e858ff8-fba8-477e-8c7b-82e3b169745d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Took 5.48 seconds to snapshot the instance on the hypervisor.
Dec 06 07:25:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:25:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 07:25:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] There are 0 instances to clean {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 07:25:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:25:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:17 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:26:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:18 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:26:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:26:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:26:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:26:18 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:26:19 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updating instance_info_cache with network_info: [{"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:26:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:26:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:26:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:26:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:26:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:26:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:26:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:26:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:26:19 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:26:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:20 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:26:20 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:26:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8749MB free_disk=25.20853042602539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5a0c7109-a15e-440b-b0f3-785721e55627 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing inventories for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Updating ProviderTree inventory for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Updating inventory in ProviderTree for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing aggregate associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, aggregates: None {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing trait associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, traits: HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:26:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:26:21 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:26:22 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:26:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:22 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:26:22 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:26:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:23 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:26:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "d994eb8e-4831-4731-80e8-036c55d3922f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "d994eb8e-4831-4731-80e8-036c55d3922f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:26:28 user nova-compute[75021]: INFO nova.compute.claims [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Claim successful on node user
Dec 06 07:26:28 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG nova.network.neutron [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:26:28 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:26:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG nova.policy [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f86b8a1612164096bdfb4fa242e95bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ac7f58dce14545bb9b45b3a94309b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:26:28 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Creating image(s)
Dec 06 07:26:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "/opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "/opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "/opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:26:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.176s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/disk 1073741824" returned: 0 in 0.055s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG nova.network.neutron [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Successfully created port: 4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Cannot resize image /opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Ensure instance console log exists: /opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG nova.network.neutron [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Successfully updated port: 4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "refresh_cache-d994eb8e-4831-4731-80e8-036c55d3922f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquired lock "refresh_cache-d994eb8e-4831-4731-80e8-036c55d3922f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:26:29 user nova-compute[75021]: DEBUG nova.network.neutron [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.network.neutron [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.compute.manager [req-d04b4d99-13ed-4d54-ba45-630a7b60d25d req-7ded1c0f-26be-4573-8021-e0bebeb5daa6 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Received event network-changed-4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.compute.manager [req-d04b4d99-13ed-4d54-ba45-630a7b60d25d req-7ded1c0f-26be-4573-8021-e0bebeb5daa6 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Refreshing instance network info cache due to event network-changed-4773b8d7-f8f6-4ccb-ba84-6b87b13a9335. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d04b4d99-13ed-4d54-ba45-630a7b60d25d req-7ded1c0f-26be-4573-8021-e0bebeb5daa6 service nova] Acquiring lock "refresh_cache-d994eb8e-4831-4731-80e8-036c55d3922f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.network.neutron [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Updating instance_info_cache with network_info: [{"id": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "address": "fa:16:3e:20:e1:2e", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4773b8d7-f8", "ovs_interfaceid": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Releasing lock "refresh_cache-d994eb8e-4831-4731-80e8-036c55d3922f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Instance network_info: |[{"id": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "address": "fa:16:3e:20:e1:2e", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4773b8d7-f8", "ovs_interfaceid": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d04b4d99-13ed-4d54-ba45-630a7b60d25d req-7ded1c0f-26be-4573-8021-e0bebeb5daa6 service nova] Acquired lock "refresh_cache-d994eb8e-4831-4731-80e8-036c55d3922f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.network.neutron [req-d04b4d99-13ed-4d54-ba45-630a7b60d25d req-7ded1c0f-26be-4573-8021-e0bebeb5daa6 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Refreshing network info cache for port 4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Start _get_guest_xml network_info=[{"id": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "address": "fa:16:3e:20:e1:2e", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4773b8d7-f8", "ovs_interfaceid": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:26:30 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:26:30 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-981783174',display_name='tempest-VolumesActionsTest-instance-981783174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-981783174',id=44,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5ac7f58dce14545bb9b45b3a94309b1',ramdisk_id='',reservation_id='r-yxjsjrg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1127490927',owner_user_name='tempest-VolumesActionsTest-1127490927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:26:29Z,user_data=None,user_id='f86b8a1612164096bdfb4fa242e95bb1',uuid=d994eb8e-4831-4731-80e8-036c55d3922f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "address": "fa:16:3e:20:e1:2e", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4773b8d7-f8", "ovs_interfaceid": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Converting VIF {"id": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "address": "fa:16:3e:20:e1:2e", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4773b8d7-f8", "ovs_interfaceid": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:e1:2e,bridge_name='br-int',has_traffic_filtering=True,id=4773b8d7-f8f6-4ccb-ba84-6b87b13a9335,network=Network(39ddcfc4-035c-49a7-94ae-ba86737c00ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4773b8d7-f8') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.objects.instance [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lazy-loading 'pci_devices' on Instance uuid d994eb8e-4831-4731-80e8-036c55d3922f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:26:30 user nova-compute[75021]:   <uuid>d994eb8e-4831-4731-80e8-036c55d3922f</uuid>
Dec 06 07:26:30 user nova-compute[75021]:   <name>instance-0000002c</name>
Dec 06 07:26:30 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:26:30 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:26:30 user nova-compute[75021]:   <metadata>
Dec 06 07:26:30 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:26:30 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:26:30 user nova-compute[75021]:       <nova:name>tempest-VolumesActionsTest-instance-981783174</nova:name>
Dec 06 07:26:30 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:26:30</nova:creationTime>
Dec 06 07:26:30 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:26:30 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:26:30 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:26:30 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:26:30 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:26:30 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:26:30 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:26:30 user nova-compute[75021]:       <nova:owner>
Dec 06 07:26:30 user nova-compute[75021]:         <nova:user uuid="f86b8a1612164096bdfb4fa242e95bb1">tempest-VolumesActionsTest-1127490927-project-member</nova:user>
Dec 06 07:26:30 user nova-compute[75021]:         <nova:project uuid="a5ac7f58dce14545bb9b45b3a94309b1">tempest-VolumesActionsTest-1127490927</nova:project>
Dec 06 07:26:30 user nova-compute[75021]:       </nova:owner>
Dec 06 07:26:30 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:26:30 user nova-compute[75021]:       <nova:ports>
Dec 06 07:26:30 user nova-compute[75021]:         <nova:port uuid="4773b8d7-f8f6-4ccb-ba84-6b87b13a9335">
Dec 06 07:26:30 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 06 07:26:30 user nova-compute[75021]:         </nova:port>
Dec 06 07:26:30 user nova-compute[75021]:       </nova:ports>
Dec 06 07:26:30 user nova-compute[75021]:     </nova:instance>
Dec 06 07:26:30 user nova-compute[75021]:   </metadata>
Dec 06 07:26:30 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:26:30 user nova-compute[75021]:     <system>
Dec 06 07:26:30 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:26:30 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:26:30 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:26:30 user nova-compute[75021]:       <entry name="serial">d994eb8e-4831-4731-80e8-036c55d3922f</entry>
Dec 06 07:26:30 user nova-compute[75021]:       <entry name="uuid">d994eb8e-4831-4731-80e8-036c55d3922f</entry>
Dec 06 07:26:30 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:26:30 user nova-compute[75021]:     </system>
Dec 06 07:26:30 user nova-compute[75021]:   </sysinfo>
Dec 06 07:26:30 user nova-compute[75021]:   <os>
Dec 06 07:26:30 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:26:30 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:26:30 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:26:30 user nova-compute[75021]:   </os>
Dec 06 07:26:30 user nova-compute[75021]:   <features>
Dec 06 07:26:30 user nova-compute[75021]:     <acpi/>
Dec 06 07:26:30 user nova-compute[75021]:     <apic/>
Dec 06 07:26:30 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:26:30 user nova-compute[75021]:   </features>
Dec 06 07:26:30 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:26:30 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:26:30 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:26:30 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:26:30 user nova-compute[75021]:   </clock>
Dec 06 07:26:30 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:26:30 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:26:30 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:26:30 user nova-compute[75021]:   </cpu>
Dec 06 07:26:30 user nova-compute[75021]:   <devices>
Dec 06 07:26:30 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:26:30 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:26:30 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/disk"/>
Dec 06 07:26:30 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:26:30 user nova-compute[75021]:     </disk>
Dec 06 07:26:30 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:26:30 user nova-compute[75021]:       <mac address="fa:16:3e:20:e1:2e"/>
Dec 06 07:26:30 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:26:30 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:26:30 user nova-compute[75021]:       <target dev="tap4773b8d7-f8"/>
Dec 06 07:26:30 user nova-compute[75021]:     </interface>
Dec 06 07:26:30 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:26:30 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/console.log" append="off"/>
Dec 06 07:26:30 user nova-compute[75021]:     </serial>
Dec 06 07:26:30 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:26:30 user nova-compute[75021]:     <video>
Dec 06 07:26:30 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:26:30 user nova-compute[75021]:     </video>
Dec 06 07:26:30 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:26:30 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:26:30 user nova-compute[75021]:     </rng>
Dec 06 07:26:30 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:26:30 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:26:30 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:26:30 user nova-compute[75021]:     </memballoon>
Dec 06 07:26:30 user nova-compute[75021]:   </devices>
Dec 06 07:26:30 user nova-compute[75021]: </domain>
Dec 06 07:26:30 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-981783174',display_name='tempest-VolumesActionsTest-instance-981783174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-981783174',id=44,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5ac7f58dce14545bb9b45b3a94309b1',ramdisk_id='',reservation_id='r-yxjsjrg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1127490927',owner_user_name='tempest-VolumesActionsTest-1127490927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:26:29Z,user_data=None,user_id='f86b8a1612164096bdfb4fa242e95bb1',uuid=d994eb8e-4831-4731-80e8-036c55d3922f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "address": "fa:16:3e:20:e1:2e", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4773b8d7-f8", "ovs_interfaceid": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Converting VIF {"id": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "address": "fa:16:3e:20:e1:2e", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4773b8d7-f8", "ovs_interfaceid": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:e1:2e,bridge_name='br-int',has_traffic_filtering=True,id=4773b8d7-f8f6-4ccb-ba84-6b87b13a9335,network=Network(39ddcfc4-035c-49a7-94ae-ba86737c00ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4773b8d7-f8') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG os_vif [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:e1:2e,bridge_name='br-int',has_traffic_filtering=True,id=4773b8d7-f8f6-4ccb-ba84-6b87b13a9335,network=Network(39ddcfc4-035c-49a7-94ae-ba86737c00ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4773b8d7-f8') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52a50787-6da8-5f70-b360-470f904dee14', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4773b8d7-f8, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4773b8d7-f8, col_values=(('qos', UUID('c31e9d0e-d202-4069-a855-b773fc3a0021')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4773b8d7-f8, col_values=(('external_ids', {'iface-id': '4773b8d7-f8f6-4ccb-ba84-6b87b13a9335', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:e1:2e', 'vm-uuid': 'd994eb8e-4831-4731-80e8-036c55d3922f'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:30 user nova-compute[75021]: INFO os_vif [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:e1:2e,bridge_name='br-int',has_traffic_filtering=True,id=4773b8d7-f8f6-4ccb-ba84-6b87b13a9335,network=Network(39ddcfc4-035c-49a7-94ae-ba86737c00ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4773b8d7-f8')
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] No VIF found with MAC fa:16:3e:20:e1:2e, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.network.neutron [req-d04b4d99-13ed-4d54-ba45-630a7b60d25d req-7ded1c0f-26be-4573-8021-e0bebeb5daa6 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Updated VIF entry in instance network info cache for port 4773b8d7-f8f6-4ccb-ba84-6b87b13a9335. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG nova.network.neutron [req-d04b4d99-13ed-4d54-ba45-630a7b60d25d req-7ded1c0f-26be-4573-8021-e0bebeb5daa6 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Updating instance_info_cache with network_info: [{"id": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "address": "fa:16:3e:20:e1:2e", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4773b8d7-f8", "ovs_interfaceid": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:26:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d04b4d99-13ed-4d54-ba45-630a7b60d25d req-7ded1c0f-26be-4573-8021-e0bebeb5daa6 service nova] Releasing lock "refresh_cache-d994eb8e-4831-4731-80e8-036c55d3922f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:26:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-1fe0a128-d679-47cc-89a6-34e5cf63814a req-9a7e8f54-9274-4387-869e-abd579f277c8 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Received event network-vif-plugged-4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:26:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1fe0a128-d679-47cc-89a6-34e5cf63814a req-9a7e8f54-9274-4387-869e-abd579f277c8 service nova] Acquiring lock "d994eb8e-4831-4731-80e8-036c55d3922f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:26:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1fe0a128-d679-47cc-89a6-34e5cf63814a req-9a7e8f54-9274-4387-869e-abd579f277c8 service nova] Lock "d994eb8e-4831-4731-80e8-036c55d3922f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:26:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1fe0a128-d679-47cc-89a6-34e5cf63814a req-9a7e8f54-9274-4387-869e-abd579f277c8 service nova] Lock "d994eb8e-4831-4731-80e8-036c55d3922f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:26:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-1fe0a128-d679-47cc-89a6-34e5cf63814a req-9a7e8f54-9274-4387-869e-abd579f277c8 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] No waiting events found dispatching network-vif-plugged-4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:26:31 user nova-compute[75021]: WARNING nova.compute.manager [req-1fe0a128-d679-47cc-89a6-34e5cf63814a req-9a7e8f54-9274-4387-869e-abd579f277c8 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Received unexpected event network-vif-plugged-4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 for instance with vm_state building and task_state spawning.
Dec 06 07:26:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:26:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:26:33 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Instance spawned successfully.
Dec 06 07:26:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:26:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:26:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:26:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:26:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:26:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:26:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:26:33 user nova-compute[75021]: INFO nova.compute.manager [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Took 5.23 seconds to spawn the instance on the hypervisor.
Dec 06 07:26:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:26:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-7e69a549-9d24-48d9-9f06-ee9948dd96e3 req-25633582-5a27-482d-bbe3-864024505f46 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Received event network-vif-plugged-4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:26:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7e69a549-9d24-48d9-9f06-ee9948dd96e3 req-25633582-5a27-482d-bbe3-864024505f46 service nova] Acquiring lock "d994eb8e-4831-4731-80e8-036c55d3922f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:26:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7e69a549-9d24-48d9-9f06-ee9948dd96e3 req-25633582-5a27-482d-bbe3-864024505f46 service nova] Lock "d994eb8e-4831-4731-80e8-036c55d3922f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:26:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7e69a549-9d24-48d9-9f06-ee9948dd96e3 req-25633582-5a27-482d-bbe3-864024505f46 service nova] Lock "d994eb8e-4831-4731-80e8-036c55d3922f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:26:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-7e69a549-9d24-48d9-9f06-ee9948dd96e3 req-25633582-5a27-482d-bbe3-864024505f46 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] No waiting events found dispatching network-vif-plugged-4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:26:34 user nova-compute[75021]: WARNING nova.compute.manager [req-7e69a549-9d24-48d9-9f06-ee9948dd96e3 req-25633582-5a27-482d-bbe3-864024505f46 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Received unexpected event network-vif-plugged-4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 for instance with vm_state active and task_state None.
Dec 06 07:26:34 user nova-compute[75021]: INFO nova.compute.manager [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Took 5.86 seconds to build instance.
Dec 06 07:26:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-215f4af5-4d64-42ec-9b7c-bdfbdd2a0a20 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "d994eb8e-4831-4731-80e8-036c55d3922f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.983s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:26:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-a626e6e8-b390-478c-8f4f-14cc8ef04cfd req-aa778be3-abd7-46e0-88b9-0268d68400f5 service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Received event network-changed-3dcc8cb9-4843-41a8-b7be-28b096f782e7 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:26:44 user nova-compute[75021]: DEBUG nova.compute.manager [req-a626e6e8-b390-478c-8f4f-14cc8ef04cfd req-aa778be3-abd7-46e0-88b9-0268d68400f5 service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Refreshing instance network info cache due to event network-changed-3dcc8cb9-4843-41a8-b7be-28b096f782e7. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:26:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a626e6e8-b390-478c-8f4f-14cc8ef04cfd req-aa778be3-abd7-46e0-88b9-0268d68400f5 service nova] Acquiring lock "refresh_cache-9fe9bf1d-78d1-4e46-825c-bb98245de86f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:26:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a626e6e8-b390-478c-8f4f-14cc8ef04cfd req-aa778be3-abd7-46e0-88b9-0268d68400f5 service nova] Acquired lock "refresh_cache-9fe9bf1d-78d1-4e46-825c-bb98245de86f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:26:44 user nova-compute[75021]: DEBUG nova.network.neutron [req-a626e6e8-b390-478c-8f4f-14cc8ef04cfd req-aa778be3-abd7-46e0-88b9-0268d68400f5 service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Refreshing network info cache for port 3dcc8cb9-4843-41a8-b7be-28b096f782e7 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:26:44 user nova-compute[75021]: DEBUG nova.network.neutron [req-a626e6e8-b390-478c-8f4f-14cc8ef04cfd req-aa778be3-abd7-46e0-88b9-0268d68400f5 service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Updated VIF entry in instance network info cache for port 3dcc8cb9-4843-41a8-b7be-28b096f782e7. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:26:44 user nova-compute[75021]: DEBUG nova.network.neutron [req-a626e6e8-b390-478c-8f4f-14cc8ef04cfd req-aa778be3-abd7-46e0-88b9-0268d68400f5 service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Updating instance_info_cache with network_info: [{"id": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "address": "fa:16:3e:f7:29:3a", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcc8cb9-48", "ovs_interfaceid": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:26:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a626e6e8-b390-478c-8f4f-14cc8ef04cfd req-aa778be3-abd7-46e0-88b9-0268d68400f5 service nova] Releasing lock "refresh_cache-9fe9bf1d-78d1-4e46-825c-bb98245de86f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:26:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG nova.objects.instance [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'flavor' on Instance uuid 9fe9bf1d-78d1-4e46-825c-bb98245de86f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:26:47 user nova-compute[75021]: INFO nova.compute.manager [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Attaching volume a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb to /dev/vdb
Dec 06 07:26:47 user nova-compute[75021]: DEBUG os_brick.utils [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[77235f9b-f4af-4f2b-ab0f-755ccb08d5f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4895b874-86f7-4e07-ac7b-624ca1aaaf8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb46d938-f856-423c-ba47-5b6ea58fd976]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce53aca8-76d8-42f2-8f79-dc94335d1eb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:26:47 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:26:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5327499f-733b-4d9f-8097-ca5eee2b8a9f]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG os_brick.utils [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:26:47 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Updating existing volume attachment record: d002ccf6-6797-4bfc-ab00-26c784afb084 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:26:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "be4426d8-f8fa-4c62-bfa6-74944341d938" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:26:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "be4426d8-f8fa-4c62-bfa6-74944341d938" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:26:48 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:26:49 user nova-compute[75021]: INFO nova.compute.claims [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Claim successful on node user
Dec 06 07:26:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:26:49 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:26:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG nova.policy [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b39552dec3964bf69ed87b5ca130fe5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddfde019af4962929aa2c8cfa84b35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:26:49 user nova-compute[75021]: INFO nova.virt.block_device [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Booting with volume ec9a4f62-08cb-4162-b6bf-56d29376c703 at /dev/vda
Dec 06 07:26:49 user nova-compute[75021]: DEBUG os_brick.utils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bc45db-f560-4c21-9cb5-d715e5c411f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[824491e3-ad39-484b-97c6-e65f543f46f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0102f1ea-f674-4623-bcbd-41b75e639d18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca23954-1802-4d94-9cb0-5f6a51651917]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:26:49 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:26:49 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6883539c-3a3d-4510-80bc-5fcf4acff3d7]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG os_brick.utils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:26:49 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Updating existing volume attachment record: c5a2f8b2-b9cb-4244-9c68-7ff4eae1aebd {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:26:50 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Successfully created port: 3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:26:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:50 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Successfully updated port: 3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:26:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "refresh_cache-be4426d8-f8fa-4c62-bfa6-74944341d938" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:26:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquired lock "refresh_cache-be4426d8-f8fa-4c62-bfa6-74944341d938" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:26:50 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:26:50 user nova-compute[75021]: DEBUG nova.compute.manager [req-ccedabac-6990-490a-8894-1cfdf499dbf2 req-2f24df5c-14ca-4c2a-b011-41f0684eed8a service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Received event network-changed-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:26:50 user nova-compute[75021]: DEBUG nova.compute.manager [req-ccedabac-6990-490a-8894-1cfdf499dbf2 req-2f24df5c-14ca-4c2a-b011-41f0684eed8a service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Refreshing instance network info cache due to event network-changed-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:26:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ccedabac-6990-490a-8894-1cfdf499dbf2 req-2f24df5c-14ca-4c2a-b011-41f0684eed8a service nova] Acquiring lock "refresh_cache-be4426d8-f8fa-4c62-bfa6-74944341d938" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:26:50 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:26:51 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Updating instance_info_cache with network_info: [{"id": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "address": "fa:16:3e:ca:09:be", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bba7a6d-ec", "ovs_interfaceid": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:26:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Releasing lock "refresh_cache-be4426d8-f8fa-4c62-bfa6-74944341d938" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:26:51 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Instance network_info: |[{"id": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "address": "fa:16:3e:ca:09:be", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bba7a6d-ec", "ovs_interfaceid": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:26:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ccedabac-6990-490a-8894-1cfdf499dbf2 req-2f24df5c-14ca-4c2a-b011-41f0684eed8a service nova] Acquired lock "refresh_cache-be4426d8-f8fa-4c62-bfa6-74944341d938" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:26:51 user nova-compute[75021]: DEBUG nova.network.neutron [req-ccedabac-6990-490a-8894-1cfdf499dbf2 req-2f24df5c-14ca-4c2a-b011-41f0684eed8a service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Refreshing network info cache for port 3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:26:51 user nova-compute[75021]: DEBUG nova.network.neutron [req-ccedabac-6990-490a-8894-1cfdf499dbf2 req-2f24df5c-14ca-4c2a-b011-41f0684eed8a service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Updated VIF entry in instance network info cache for port 3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:26:51 user nova-compute[75021]: DEBUG nova.network.neutron [req-ccedabac-6990-490a-8894-1cfdf499dbf2 req-2f24df5c-14ca-4c2a-b011-41f0684eed8a service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Updating instance_info_cache with network_info: [{"id": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "address": "fa:16:3e:ca:09:be", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bba7a6d-ec", "ovs_interfaceid": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:26:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ccedabac-6990-490a-8894-1cfdf499dbf2 req-2f24df5c-14ca-4c2a-b011-41f0684eed8a service nova] Releasing lock "refresh_cache-be4426d8-f8fa-4c62-bfa6-74944341d938" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:26:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZsiMTGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:26:57 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:26:57 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:26:57 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b19d86c-9049-414c-b612-0efa3fd7b86c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:26:57 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[723c4033-f2fb-4873-a639-e81076888347]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb] added
Dec 06 07:26:57 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaeed7d-68e8-4080-b387-412ce3794114]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[974d9292-a1fc-4eb6-9da0-3a4f1db98a37]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qZsiMTGX {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qZsiMTGX" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04beaae-ba65-47c0-95ae-692f55996348]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qZsiMTGX'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[26405182-91f4-4bd4-b8aa-724f51ebc994]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b742f4c9-4113-4ff3-bbde-e5cd91bae88d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:26:57 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:26:57 user nova-compute[75021]:  {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:26:57 user nova-compute[75021]: WARNING os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 07:26:57 user nova-compute[75021]: 
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00c7d34-f4ef-4c22-ba19-aaa86f88ae0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb, portal: 172.16.0.220,3260]
Dec 06 07:26:57 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb, portal: 172.16.0.220,3260] successful.
Dec 06 07:26:57 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ca3d9a-5d8b-48a4-9419-a3010489b218]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a71b65-9ace-470f-a600-7d5d26392230]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:26:57 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:26:57 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab32a1e-b69b-4249-a6d9-5a7beda8dd4d]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:26:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZsiMTGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:26:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:26:58 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23262376636653031', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:26:58 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262376636653031', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:26:58 user nova-compute[75021]: DEBUG nova.objects.instance [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'flavor' on Instance uuid 9fe9bf1d-78d1-4e46-825c-bb98245de86f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:26:59 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:26:59 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:26:59 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:26:59 user nova-compute[75021]:   <serial>a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb</serial>
Dec 06 07:26:59 user nova-compute[75021]: </disk>
Dec 06 07:26:59 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] No VIF found with MAC fa:16:3e:f7:29:3a, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-86a1c122-d931-477f-be65-50d0b3979872 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.922s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:26:59 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Creating image(s)
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Ensure instance console log exists: /opt/stack/data/nova/instances/be4426d8-f8fa-4c62-bfa6-74944341d938/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Start _get_guest_xml network_info=[{"id": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "address": "fa:16:3e:ca:09:be", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bba7a6d-ec", "ovs_interfaceid": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c5a2f8b2-b9cb-4244-9c68-7ff4eae1aebd', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqBbAKGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'be4426d8-f8fa-4c62-bfa6-74944341d938', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec9a4f62-08cb-4162-b6bf-56d29376c703', 'serial': 'ec9a4f62-08cb-4162-b6bf-56d29376c703'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:26:59 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:26:59 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqBbAKGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:26:59 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:26:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:26:59 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:26:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:26:59 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f49035-1333-4979-8b6d-142ebe22ff6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:26:59 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[acac02e1-1349-4aa1-8ffe-818c283da71e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703] added
Dec 06 07:26:59 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c9be50-6f94-4da5-a1f8-785102bdf141]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff173a03-80c4-490c-bdfc-9b0c27669b28]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqBbAKGx {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqBbAKGx" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb72229-8447-4760-9328-222190058622]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oqBbAKGx'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ffcc47-8447-4a42-9005-b2fa9eb9dee1]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:26:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaefa11-7395-4368-9bc4-4d6b63772db1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:27:00 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:27:00 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbfeef5-9dd5-4a56-a3b5-f32a28ebd5a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703, portal: 172.16.0.220,3260]
Dec 06 07:27:00 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703, portal: 172.16.0.220,3260] successful.
Dec 06 07:27:00 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[119bd2bd-67f5-475f-b914-98db6284bb0b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a058a35-b60e-476c-8dce-55108c9f17ea]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:27:00 user nova-compute[75021]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:27:00 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:27:00 user nova-compute[75021]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:27:00 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39df13b-1982-429f-b9af-ec0d7df2bcaf]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:27:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqBbAKGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23838623236633435', 'path': '/dev/sdc'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838623236633435', 'path': '/dev/sdc'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:26:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-786834580',display_name='tempest-TestVolumeBootPattern-volume-backed-server-786834580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-786834580',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc9ciKYAca/PoqsCjeRvcV/xVS4uaoiDM0GM/iRqM7z4TT4ad1HDmewFT6DrO84vZAt+mMFHouzdLwDoZ5vMG47JpudMLLN2eYJQWcHC1HxgjroAod35srzrFkg8dFC5Q==',key_name='tempest-keypair-251491758',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-gb7my2qd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:26:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=be4426d8-f8fa-4c62-bfa6-74944341d938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "address": "fa:16:3e:ca:09:be", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bba7a6d-ec", "ovs_interfaceid": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "address": "fa:16:3e:ca:09:be", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bba7a6d-ec", "ovs_interfaceid": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:09:be,bridge_name='br-int',has_traffic_filtering=True,id=3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bba7a6d-ec') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG nova.objects.instance [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lazy-loading 'pci_devices' on Instance uuid be4426d8-f8fa-4c62-bfa6-74944341d938 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:27:01 user nova-compute[75021]:   <uuid>be4426d8-f8fa-4c62-bfa6-74944341d938</uuid>
Dec 06 07:27:01 user nova-compute[75021]:   <name>instance-0000002d</name>
Dec 06 07:27:01 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:27:01 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:27:01 user nova-compute[75021]:   <metadata>
Dec 06 07:27:01 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:27:01 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:27:01 user nova-compute[75021]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-786834580</nova:name>
Dec 06 07:27:01 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:26:59</nova:creationTime>
Dec 06 07:27:01 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:27:01 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:27:01 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:27:01 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:27:01 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:27:01 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:27:01 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:27:01 user nova-compute[75021]:       <nova:owner>
Dec 06 07:27:01 user nova-compute[75021]:         <nova:user uuid="b39552dec3964bf69ed87b5ca130fe5f">tempest-TestVolumeBootPattern-1013845055-project-member</nova:user>
Dec 06 07:27:01 user nova-compute[75021]:         <nova:project uuid="00ddfde019af4962929aa2c8cfa84b35">tempest-TestVolumeBootPattern-1013845055</nova:project>
Dec 06 07:27:01 user nova-compute[75021]:       </nova:owner>
Dec 06 07:27:01 user nova-compute[75021]:       <nova:ports>
Dec 06 07:27:01 user nova-compute[75021]:         <nova:port uuid="3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c">
Dec 06 07:27:01 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 06 07:27:01 user nova-compute[75021]:         </nova:port>
Dec 06 07:27:01 user nova-compute[75021]:       </nova:ports>
Dec 06 07:27:01 user nova-compute[75021]:     </nova:instance>
Dec 06 07:27:01 user nova-compute[75021]:   </metadata>
Dec 06 07:27:01 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:27:01 user nova-compute[75021]:     <system>
Dec 06 07:27:01 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:27:01 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:27:01 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:27:01 user nova-compute[75021]:       <entry name="serial">be4426d8-f8fa-4c62-bfa6-74944341d938</entry>
Dec 06 07:27:01 user nova-compute[75021]:       <entry name="uuid">be4426d8-f8fa-4c62-bfa6-74944341d938</entry>
Dec 06 07:27:01 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:27:01 user nova-compute[75021]:     </system>
Dec 06 07:27:01 user nova-compute[75021]:   </sysinfo>
Dec 06 07:27:01 user nova-compute[75021]:   <os>
Dec 06 07:27:01 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:27:01 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:27:01 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:27:01 user nova-compute[75021]:   </os>
Dec 06 07:27:01 user nova-compute[75021]:   <features>
Dec 06 07:27:01 user nova-compute[75021]:     <acpi/>
Dec 06 07:27:01 user nova-compute[75021]:     <apic/>
Dec 06 07:27:01 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:27:01 user nova-compute[75021]:   </features>
Dec 06 07:27:01 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:27:01 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:27:01 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:27:01 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:27:01 user nova-compute[75021]:   </clock>
Dec 06 07:27:01 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:27:01 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:27:01 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:27:01 user nova-compute[75021]:   </cpu>
Dec 06 07:27:01 user nova-compute[75021]:   <devices>
Dec 06 07:27:01 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:27:01 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:27:01 user nova-compute[75021]:       <source dev="/dev/sdc"/>
Dec 06 07:27:01 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:27:01 user nova-compute[75021]:       <serial>ec9a4f62-08cb-4162-b6bf-56d29376c703</serial>
Dec 06 07:27:01 user nova-compute[75021]:     </disk>
Dec 06 07:27:01 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:27:01 user nova-compute[75021]:       <mac address="fa:16:3e:ca:09:be"/>
Dec 06 07:27:01 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:27:01 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:27:01 user nova-compute[75021]:       <target dev="tap3bba7a6d-ec"/>
Dec 06 07:27:01 user nova-compute[75021]:     </interface>
Dec 06 07:27:01 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:27:01 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/be4426d8-f8fa-4c62-bfa6-74944341d938/console.log" append="off"/>
Dec 06 07:27:01 user nova-compute[75021]:     </serial>
Dec 06 07:27:01 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:27:01 user nova-compute[75021]:     <video>
Dec 06 07:27:01 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:27:01 user nova-compute[75021]:     </video>
Dec 06 07:27:01 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:27:01 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:27:01 user nova-compute[75021]:     </rng>
Dec 06 07:27:01 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:27:01 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:27:01 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:27:01 user nova-compute[75021]:     </memballoon>
Dec 06 07:27:01 user nova-compute[75021]:   </devices>
Dec 06 07:27:01 user nova-compute[75021]: </domain>
Dec 06 07:27:01 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:26:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-786834580',display_name='tempest-TestVolumeBootPattern-volume-backed-server-786834580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-786834580',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc9ciKYAca/PoqsCjeRvcV/xVS4uaoiDM0GM/iRqM7z4TT4ad1HDmewFT6DrO84vZAt+mMFHouzdLwDoZ5vMG47JpudMLLN2eYJQWcHC1HxgjroAod35srzrFkg8dFC5Q==',key_name='tempest-keypair-251491758',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-gb7my2qd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:26:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=be4426d8-f8fa-4c62-bfa6-74944341d938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "address": "fa:16:3e:ca:09:be", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bba7a6d-ec", "ovs_interfaceid": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "address": "fa:16:3e:ca:09:be", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bba7a6d-ec", "ovs_interfaceid": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:09:be,bridge_name='br-int',has_traffic_filtering=True,id=3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bba7a6d-ec') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG os_vif [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:09:be,bridge_name='br-int',has_traffic_filtering=True,id=3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bba7a6d-ec') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd43db29-0a29-5371-a07b-73749fde695e', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bba7a6d-ec, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3bba7a6d-ec, col_values=(('qos', UUID('9e1f4d6d-a23b-4413-8d26-04fa57a4a9f0')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3bba7a6d-ec, col_values=(('external_ids', {'iface-id': '3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:09:be', 'vm-uuid': 'be4426d8-f8fa-4c62-bfa6-74944341d938'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:01 user nova-compute[75021]: INFO os_vif [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:09:be,bridge_name='br-int',has_traffic_filtering=True,id=3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bba7a6d-ec')
Dec 06 07:27:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:27:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] No VIF found with MAC fa:16:3e:ca:09:be, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:27:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-d531f467-e4b5-4169-9c7b-845328968809 req-447961ce-6265-4966-a8de-182a1c0f7833 service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Received event network-vif-plugged-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:27:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d531f467-e4b5-4169-9c7b-845328968809 req-447961ce-6265-4966-a8de-182a1c0f7833 service nova] Acquiring lock "be4426d8-f8fa-4c62-bfa6-74944341d938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d531f467-e4b5-4169-9c7b-845328968809 req-447961ce-6265-4966-a8de-182a1c0f7833 service nova] Lock "be4426d8-f8fa-4c62-bfa6-74944341d938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d531f467-e4b5-4169-9c7b-845328968809 req-447961ce-6265-4966-a8de-182a1c0f7833 service nova] Lock "be4426d8-f8fa-4c62-bfa6-74944341d938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-d531f467-e4b5-4169-9c7b-845328968809 req-447961ce-6265-4966-a8de-182a1c0f7833 service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] No waiting events found dispatching network-vif-plugged-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:27:03 user nova-compute[75021]: WARNING nova.compute.manager [req-d531f467-e4b5-4169-9c7b-845328968809 req-447961ce-6265-4966-a8de-182a1c0f7833 service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Received unexpected event network-vif-plugged-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c for instance with vm_state building and task_state spawning.
Dec 06 07:27:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:04 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'flavor' on Instance uuid 9fe9bf1d-78d1-4e46-825c-bb98245de86f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:27:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:04 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:27:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:27:04 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Instance spawned successfully.
Dec 06 07:27:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:27:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:27:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:27:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:27:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:27:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:27:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:27:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:04 user nova-compute[75021]: INFO nova.compute.manager [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Attaching volume df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 to /dev/vdc
Dec 06 07:27:05 user nova-compute[75021]: INFO nova.compute.manager [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Took 5.23 seconds to spawn the instance on the hypervisor.
Dec 06 07:27:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG os_brick.utils [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcfdde1-8e81-4ade-8395-c1a414613877]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfa7f2e-7e54-4b04-87e8-14709d9852ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3d93c0-a52e-4e0a-a90d-c4a8b555dd2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f2c7f1-ebfe-4ad5-b29b-042eaa625db7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-d3f92a87-8ca3-4f46-ad17-df5c273b5420 req-47de06dc-21e4-4fb5-8577-df2728acb726 service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Received event network-vif-plugged-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d3f92a87-8ca3-4f46-ad17-df5c273b5420 req-47de06dc-21e4-4fb5-8577-df2728acb726 service nova] Acquiring lock "be4426d8-f8fa-4c62-bfa6-74944341d938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d3f92a87-8ca3-4f46-ad17-df5c273b5420 req-47de06dc-21e4-4fb5-8577-df2728acb726 service nova] Lock "be4426d8-f8fa-4c62-bfa6-74944341d938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d3f92a87-8ca3-4f46-ad17-df5c273b5420 req-47de06dc-21e4-4fb5-8577-df2728acb726 service nova] Lock "be4426d8-f8fa-4c62-bfa6-74944341d938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-d3f92a87-8ca3-4f46-ad17-df5c273b5420 req-47de06dc-21e4-4fb5-8577-df2728acb726 service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] No waiting events found dispatching network-vif-plugged-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:27:05 user nova-compute[75021]: WARNING nova.compute.manager [req-d3f92a87-8ca3-4f46-ad17-df5c273b5420 req-47de06dc-21e4-4fb5-8577-df2728acb726 service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Received unexpected event network-vif-plugged-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c for instance with vm_state building and task_state spawning.
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:27:05 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[00371fdf-7658-43c1-9bbe-a20ab5c0d1ce]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG os_brick.utils [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:27:05 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Updating existing volume attachment record: 321ecdd6-549b-405e-ad7e-29da2b650d08 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:27:05 user nova-compute[75021]: INFO nova.compute.manager [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Took 16.26 seconds to build instance.
Dec 06 07:27:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f50624fa-cb4b-4e86-b53b-369ece1aa7a6 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "be4426d8-f8fa-4c62-bfa6-74944341d938" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.363s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmibsEJN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:27:15 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:27:15 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:27:15 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2766bb59-06d5-4007-aec0-9128e2139403]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:27:15 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[690e4fdd-7d6f-4175-afba-b8814f813f5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008] added
Dec 06 07:27:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af0a2ed-eee7-4dbb-9651-85adf75aea20]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9919b0-3cd0-477a-9617-22bcd17e1904]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PmibsEJN {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PmibsEJN" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6c1725-e283-48a0-ab51-cde50664ea10]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PmibsEJN'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c700e50-59f9-46dc-8035-70c45896dd99]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8043b36-5192-4977-bd1c-30171a017bf6]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:27:15 user nova-compute[75021]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:27:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:27:15 user nova-compute[75021]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:27:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00084d1-901e-4faf-ab17-e0f309fafebf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008, portal: 172.16.0.220,3260]
Dec 06 07:27:15 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008, portal: 172.16.0.220,3260] successful.
Dec 06 07:27:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b2a1be-76d9-4d84-83a1-52bea939cc61]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e91d17-5522-4385-a796-e0956df9914e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:27:15 user nova-compute[75021]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:27:15 user nova-compute[75021]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)
Dec 06 07:27:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:27:15 user nova-compute[75021]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:27:15 user nova-compute[75021]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)
Dec 06 07:27:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[befe9269-d34f-4e59-b90a-72f56e02f09c]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:27:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:27:16 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:27:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmibsEJN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:27:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:27:16 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26534373761383461', 'path': '/dev/sdd'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:27:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534373761383461', 'path': '/dev/sdd'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:27:16 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'flavor' on Instance uuid 9fe9bf1d-78d1-4e46-825c-bb98245de86f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:27:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:27:16 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:27:16 user nova-compute[75021]:   <source dev="/dev/sdd"/>
Dec 06 07:27:16 user nova-compute[75021]:   <target dev="vdc" bus="virtio"/>
Dec 06 07:27:16 user nova-compute[75021]:   <serial>df3fb437-0186-4ed1-b2c6-f8f4ffe9c008</serial>
Dec 06 07:27:16 user nova-compute[75021]: </disk>
Dec 06 07:27:16 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:27:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:27:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:27:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:27:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] No VIF found with MAC fa:16:3e:f7:29:3a, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:27:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9a0af8a6-b002-4c8e-a102-0326f4f790ce tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.164s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:18 user nova-compute[75021]: INFO nova.compute.manager [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Detaching volume a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb
Dec 06 07:27:18 user nova-compute[75021]: INFO nova.virt.block_device [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Attempting to driver detach volume a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb from mountpoint /dev/vdb
Dec 06 07:27:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Attempting to detach device vdb from instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:27:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:27:18 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:27:18 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:27:18 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:27:18 user nova-compute[75021]:   <serial>a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb</serial>
Dec 06 07:27:18 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:27:18 user nova-compute[75021]: </disk>
Dec 06 07:27:18 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:27:18 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Successfully detached device vdb from instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f from the persistent domain config.
Dec 06 07:27:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:27:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:27:18 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:27:18 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:27:18 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:27:18 user nova-compute[75021]:   <serial>a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb</serial>
Dec 06 07:27:18 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:27:18 user nova-compute[75021]: </disk>
Dec 06 07:27:18 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:27:20 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:27:20 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:27:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8395MB free_disk=25.166542053222656GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:27:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5a0c7109-a15e-440b-b0f3-785721e55627 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:27:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:27:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance d994eb8e-4831-4731-80e8-036c55d3922f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:27:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance be4426d8-f8fa-4c62-bfa6-74944341d938 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:27:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:27:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:27:21 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:27:21 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:27:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:27:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:22 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:27:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:27:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-9fe9bf1d-78d1-4e46-825c-bb98245de86f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:27:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-9fe9bf1d-78d1-4e46-825c-bb98245de86f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:27:22 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:27:22 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Updating instance_info_cache with network_info: [{"id": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "address": "fa:16:3e:f7:29:3a", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcc8cb9-48", "ovs_interfaceid": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:27:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-9fe9bf1d-78d1-4e46-825c-bb98245de86f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:27:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:27:22 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:27:22 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:27:23 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:27:24 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:27:24 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:27:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "5a0c7109-a15e-440b-b0f3-785721e55627" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG nova.objects.instance [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lazy-loading 'flavor' on Instance uuid 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "5a0c7109-a15e-440b-b0f3-785721e55627" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "5a0c7109-a15e-440b-b0f3-785721e55627" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:27 user nova-compute[75021]: INFO nova.compute.manager [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Attaching volume 4cf89dc4-c18e-4313-a159-d451f051c7e7 to /dev/vdb
Dec 06 07:27:27 user nova-compute[75021]: DEBUG os_brick.utils [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a2b1e7-8268-4163-8e15-41ce9b1b06ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcad8a4e-de1f-4206-a18c-8e09cf82b482]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dbf93f-c397-447a-8756-5a57f0942578]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[44330fb1-acff-4fbd-a593-7200363f4ae2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:27:27 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:27:27 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[45234977-07e0-495c-b93c-1b734b1b52dd]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG os_brick.utils [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:27:27 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updating existing volume attachment record: cafc876c-fa1e-4ba9-8102-6dfa6c08211c {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:27:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:32 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:27:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsGLqfWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:27:37 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:27:37 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:27:37 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a80a8b-2ea2-4df2-ab41-7e9d5fd09a67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:27:37 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cbbd28-96d6-476d-9b89-ecc78c0a73c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7] added
Dec 06 07:27:37 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.064s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2347620-cc79-486c-9872-a1f9cf750563]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e694525-fac1-490a-87df-f8d89d70bab3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RsGLqfWl {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RsGLqfWl" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0170c76-817c-425c-a02f-5f67a6b960f2]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RsGLqfWl'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[066666be-4f3d-44f8-82cb-29778df53bbd]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[468736eb-3fd7-4349-8423-c979efbf6749]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:27:37 user nova-compute[75021]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:27:37 user nova-compute[75021]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)
Dec 06 07:27:37 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:27:37 user nova-compute[75021]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:27:37 user nova-compute[75021]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)
Dec 06 07:27:37 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe1e111-8bca-43c4-a2b6-5214b75b7948]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7, portal: 172.16.0.220,3260]
Dec 06 07:27:37 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7, portal: 172.16.0.220,3260] successful.
Dec 06 07:27:37 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1beef8-48c7-4931-99ed-bd6b002645a5]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc782545-21d2-4d0a-9b85-5a725eaf2dfd]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:27:37 user nova-compute[75021]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:27:37 user nova-compute[75021]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)
Dec 06 07:27:37 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:27:37 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:27:37 user nova-compute[75021]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:27:37 user nova-compute[75021]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)
Dec 06 07:27:37 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:27:37 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada3280c-687e-4e67-97cc-527b67b8a787]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:37 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:27:38 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:27:38 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsGLqfWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:27:38 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:27:38 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23932623337656133', 'path': '/dev/sde'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:27:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932623337656133', 'path': '/dev/sde'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:27:38 user nova-compute[75021]: DEBUG nova.objects.instance [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lazy-loading 'flavor' on Instance uuid 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:27:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:27:38 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:27:38 user nova-compute[75021]:   <source dev="/dev/sde"/>
Dec 06 07:27:38 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:27:38 user nova-compute[75021]:   <serial>4cf89dc4-c18e-4313-a159-d451f051c7e7</serial>
Dec 06 07:27:38 user nova-compute[75021]: </disk>
Dec 06 07:27:38 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:27:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:27:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:27:38 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] No VIF found with MAC fa:16:3e:59:be:5b, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-46725fb7-a4db-49a0-9eb3-aa32f354a04d tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "5a0c7109-a15e-440b-b0f3-785721e55627" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.827s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:39 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f is timed out.
Dec 06 07:27:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Successfully detached device vdb from instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f from the live domain config.
Dec 06 07:27:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZsiMTGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:27:39 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4463b996-442a-4c29-946f-3fbb71d48784]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:27:39 user nova-compute[75021]: No targets found.
Dec 06 07:27:39 user nova-compute[75021]: iSNS:
Dec 06 07:27:39 user nova-compute[75021]: No targets found.
Dec 06 07:27:39 user nova-compute[75021]: STATIC:
Dec 06 07:27:39 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7
Dec 06 07:27:39 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:27:39 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:27:39 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008
Dec 06 07:27:39 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:27:39 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:27:39 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703
Dec 06 07:27:39 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:27:39 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:27:39 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb
Dec 06 07:27:39 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:27:39 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:27:39 user nova-compute[75021]: FIRMWARE:
Dec 06 07:27:39 user nova-compute[75021]: No targets found.
Dec 06 07:27:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:27:39 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:27:39 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fe4276-75cf-4413-9688-c31b2d26b5c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94c383d-9f29-4161-bc2d-0448880948b2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:27:39 user nova-compute[75021]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:27:39 user nova-compute[75021]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)
Dec 06 07:27:39 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:27:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb (non-flash)
Dec 06 07:27:39 user nova-compute[75021]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:27:39 user nova-compute[75021]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)
Dec 06 07:27:39 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:27:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b46e7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[388a8636-de9f-4362-9f55-1e0726e120db]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f74e45-0cbd-4de6-abcd-e95e014c9bdf]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca116ba4-16f8-4643-99b0-8679a957a56e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da89280-a3d8-4bfb-b348-9c57578f00a0]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bc5e7e-84b6-42dc-bb91-a4b6eb4e7f53]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a055d28f-0cd5-441f-9df3-8532c3ea6a83]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb, portal: 172.16.0.220,3260]
Dec 06 07:27:39 user nova-compute[75021]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb, portal: 172.16.0.220,3260] successful.
Dec 06 07:27:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e9c001-e4b9-4b7d-ac47-716d1d6b95bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b232e7-ce5e-4adb-ad5d-f5c9a1c38778]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] <== disconnect_volume: return (327ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:27:39 user nova-compute[75021]: INFO nova.compute.manager [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Rescuing
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquired lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:27:39 user nova-compute[75021]: DEBUG nova.network.neutron [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:27:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updating instance_info_cache with network_info: [{"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:27:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Releasing lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:27:40 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'flavor' on Instance uuid 9fe9bf1d-78d1-4e46-825c-bb98245de86f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:27:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e35d1edd-a546-4091-be34-f3150304cc8a tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.788s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-ce7380ed-be61-4610-b862-e415d837aa7c req-4189ef65-f7c3-4cc5-9dc0-ae7ef1fd11b1 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-vif-unplugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:27:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ce7380ed-be61-4610-b862-e415d837aa7c req-4189ef65-f7c3-4cc5-9dc0-ae7ef1fd11b1 service nova] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ce7380ed-be61-4610-b862-e415d837aa7c req-4189ef65-f7c3-4cc5-9dc0-ae7ef1fd11b1 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ce7380ed-be61-4610-b862-e415d837aa7c req-4189ef65-f7c3-4cc5-9dc0-ae7ef1fd11b1 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-ce7380ed-be61-4610-b862-e415d837aa7c req-4189ef65-f7c3-4cc5-9dc0-ae7ef1fd11b1 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] No waiting events found dispatching network-vif-unplugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:27:40 user nova-compute[75021]: WARNING nova.compute.manager [req-ce7380ed-be61-4610-b862-e415d837aa7c req-4189ef65-f7c3-4cc5-9dc0-ae7ef1fd11b1 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received unexpected event network-vif-unplugged-f342e747-6e80-462b-8193-7acecbc16a79 for instance with vm_state active and task_state rescuing.
Dec 06 07:27:41 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Instance destroyed successfully.
Dec 06 07:27:41 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Attempting a stable device rescue
Dec 06 07:27:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75021) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 06 07:27:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Instance directory exists: not creating {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Dec 06 07:27:41 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Creating image(s)
Dec 06 07:27:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "/opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "/opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:41 user nova-compute[75021]: DEBUG nova.objects.instance [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:27:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "d309896c33440fe0b28d4affd4373a57447bb3c3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "d309896c33440fe0b28d4affd4373a57447bb3c3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:41 user nova-compute[75021]: INFO nova.compute.manager [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Detaching volume df3fb437-0186-4ed1-b2c6-f8f4ffe9c008
Dec 06 07:27:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d309896c33440fe0b28d4affd4373a57447bb3c3.part --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:42 user nova-compute[75021]: INFO nova.virt.block_device [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Attempting to driver detach volume df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 from mountpoint /dev/vdc
Dec 06 07:27:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Attempting to detach device vdc from instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:27:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:27:42 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:27:42 user nova-compute[75021]:   <source dev="/dev/sdd"/>
Dec 06 07:27:42 user nova-compute[75021]:   <target dev="vdc" bus="virtio"/>
Dec 06 07:27:42 user nova-compute[75021]:   <serial>df3fb437-0186-4ed1-b2c6-f8f4ffe9c008</serial>
Dec 06 07:27:42 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 07:27:42 user nova-compute[75021]: </disk>
Dec 06 07:27:42 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:27:42 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Successfully detached device vdc from instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f from the persistent domain config.
Dec 06 07:27:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:27:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:27:42 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:27:42 user nova-compute[75021]:   <source dev="/dev/sdd"/>
Dec 06 07:27:42 user nova-compute[75021]:   <target dev="vdc" bus="virtio"/>
Dec 06 07:27:42 user nova-compute[75021]:   <serial>df3fb437-0186-4ed1-b2c6-f8f4ffe9c008</serial>
Dec 06 07:27:42 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 06 07:27:42 user nova-compute[75021]: </disk>
Dec 06 07:27:42 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:27:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d309896c33440fe0b28d4affd4373a57447bb3c3.part --force-share --output=json" returned: 0 in 0.199s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:42 user nova-compute[75021]: DEBUG nova.virt.images [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] 28412ac2-7826-4463-ab4c-4a2b60fe0073 was qcow2, converting to raw {{(pid=75021) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 06 07:27:42 user nova-compute[75021]: DEBUG nova.privsep.utils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75021) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 06 07:27:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d309896c33440fe0b28d4affd4373a57447bb3c3.part /opt/stack/data/nova/instances/_base/d309896c33440fe0b28d4affd4373a57447bb3c3.converted {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:42 user nova-compute[75021]: DEBUG nova.compute.manager [req-8ae089c0-7052-4377-a350-3b09c02d1a23 req-9ad1e8e2-74ff-433b-8490-244cb59044eb service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:27:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8ae089c0-7052-4377-a350-3b09c02d1a23 req-9ad1e8e2-74ff-433b-8490-244cb59044eb service nova] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8ae089c0-7052-4377-a350-3b09c02d1a23 req-9ad1e8e2-74ff-433b-8490-244cb59044eb service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-8ae089c0-7052-4377-a350-3b09c02d1a23 req-9ad1e8e2-74ff-433b-8490-244cb59044eb service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:42 user nova-compute[75021]: DEBUG nova.compute.manager [req-8ae089c0-7052-4377-a350-3b09c02d1a23 req-9ad1e8e2-74ff-433b-8490-244cb59044eb service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] No waiting events found dispatching network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:27:42 user nova-compute[75021]: WARNING nova.compute.manager [req-8ae089c0-7052-4377-a350-3b09c02d1a23 req-9ad1e8e2-74ff-433b-8490-244cb59044eb service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received unexpected event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 for instance with vm_state active and task_state rescuing.
Dec 06 07:27:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:27:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d309896c33440fe0b28d4affd4373a57447bb3c3.part /opt/stack/data/nova/instances/_base/d309896c33440fe0b28d4affd4373a57447bb3c3.converted" returned: 0 in 0.466s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d309896c33440fe0b28d4affd4373a57447bb3c3.converted --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d309896c33440fe0b28d4affd4373a57447bb3c3.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "d309896c33440fe0b28d4affd4373a57447bb3c3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.889s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "d309896c33440fe0b28d4affd4373a57447bb3c3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "d309896c33440fe0b28d4affd4373a57447bb3c3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d309896c33440fe0b28d4affd4373a57447bb3c3 --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d309896c33440fe0b28d4affd4373a57447bb3c3 --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d309896c33440fe0b28d4affd4373a57447bb3c3,backing_fmt=raw /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.rescue {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d309896c33440fe0b28d4affd4373a57447bb3c3,backing_fmt=raw /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.rescue" returned: 0 in 0.061s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "d309896c33440fe0b28d4affd4373a57447bb3c3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.objects.instance [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lazy-loading 'migration_context' on Instance uuid 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.objects.base [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Object Instance<5a0c7109-a15e-440b-b0f3-785721e55627> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Start _get_guest_xml network_info=[{"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "vif_mac": "fa:16:3e:59:be:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '28412ac2-7826-4463-ab4c-4a2b60fe0073', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cafc876c-fa1e-4ba9-8102-6dfa6c08211c', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsGLqfWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '5a0c7109-a15e-440b-b0f3-785721e55627', 'attached_at': '', 'detached_at': '', 'volume_id': '4cf89dc4-c18e-4313-a159-d451f051c7e7', 'serial': '4cf89dc4-c18e-4313-a159-d451f051c7e7'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.objects.instance [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lazy-loading 'resources' on Instance uuid 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.objects.base [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Object Instance<5a0c7109-a15e-440b-b0f3-785721e55627> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.objects.instance [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lazy-loading 'numa_topology' on Instance uuid 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.objects.base [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Object Instance<5a0c7109-a15e-440b-b0f3-785721e55627> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:27:43 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:27:43 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.objects.instance [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.objects.base [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Object Instance<5a0c7109-a15e-440b-b0f3-785721e55627> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsGLqfWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:27:43 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:27:43 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:27:43 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c4d248-0791-43b8-b460-34a88ba90def]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RsGLqfWl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 06 07:27:43 user nova-compute[75021]: node.name = iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7
Dec 06 07:27:43 user nova-compute[75021]: node.tpgt = -1
Dec 06 07:27:43 user nova-compute[75021]: node.startup = automatic
Dec 06 07:27:43 user nova-compute[75021]: node.leading_login = No
Dec 06 07:27:43 user nova-compute[75021]: iface.iscsi_ifacename = default
Dec 06 07:27:43 user nova-compute[75021]: iface.net_ifacename = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.ipaddress = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.prefix_len = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.hwaddress = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.transport_name = tcp
Dec 06 07:27:43 user nova-compute[75021]: iface.initiatorname = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.state = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.vlan_id = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.vlan_priority = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.vlan_state = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.iface_num = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.mtu = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.port = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.bootproto = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.subnet_mask = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.gateway = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.dhcp_alt_client_id_state = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.dhcp_alt_client_id = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.dhcp_dns = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.dhcp_learn_iqn = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.dhcp_req_vendor_id_state = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.dhcp_vendor_id_state = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.dhcp_vendor_id = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.dhcp_slp_da = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.fragmentation = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.gratuitous_arp = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.incoming_forwarding = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.tos_state = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.tos = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.ttl = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.delayed_ack = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.tcp_nagle = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.tcp_wsf_state = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.tcp_wsf = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.tcp_timer_scale = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.tcp_timestamp = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.redirect = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.def_task_mgmt_timeout = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.header_digest = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.data_digest = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.immediate_data = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.initial_r2t = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.data_seq_inorder = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.data_pdu_inorder = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.erl = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.max_receive_data_len = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.first_burst_len = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.max_outstanding_r2t = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.max_burst_len = 0
Dec 06 07:27:43 user nova-compute[75021]: iface.chap_auth = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.bidi_chap = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.strict_login_compliance = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.discovery_auth = <empty>
Dec 06 07:27:43 user nova-compute[75021]: iface.discovery_logout = <empty>
Dec 06 07:27:43 user nova-compute[75021]: node.discovery_address = <empty>
Dec 06 07:27:43 user nova-compute[75021]: node.discovery_port = 0
Dec 06 07:27:43 user nova-compute[75021]: node.discovery_type = static
Dec 06 07:27:43 user nova-compute[75021]: node.session.initial_cmdsn = 0
Dec 06 07:27:43 user nova-compute[75021]: node.session.initial_login_retry_max = 8
Dec 06 07:27:43 user nova-compute[75021]: node.session.xmit_thread_priority = -20
Dec 06 07:27:43 user nova-compute[75021]: node.session.cmds_max = 128
Dec 06 07:27:43 user nova-compute[75021]: node.session.queue_depth = 32
Dec 06 07:27:43 user nova-compute[75021]: node.session.nr_sessions = 1
Dec 06 07:27:43 user nova-compute[75021]: node.session.auth.authmethod = CHAP
Dec 06 07:27:43 user nova-compute[75021]: node.session.auth.username = RsGLqfWl
Dec 06 07:27:43 user nova-compute[75021]: node.session.auth.password = ***
Dec 06 07:27:43 user nova-compute[75021]: node.session.auth.username_in = <empty>
Dec 06 07:27:43 user nova-compute[75021]: node.session.auth.password_in = <empty>
Dec 06 07:27:43 user nova-compute[75021]: node.session.auth.chap_algs = MD5
Dec 06 07:27:43 user nova-compute[75021]: node.session.timeo.replacement_timeout = 120
Dec 06 07:27:43 user nova-compute[75021]: node.session.err_timeo.abort_timeout = 15
Dec 06 07:27:43 user nova-compute[75021]: node.session.err_timeo.lu_reset_timeout = 30
Dec 06 07:27:43 user nova-compute[75021]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 06 07:27:43 user nova-compute[75021]: node.session.err_timeo.host_reset_timeout = 60
Dec 06 07:27:43 user nova-compute[75021]: node.session.iscsi.FastAbort = Yes
Dec 06 07:27:43 user nova-compute[75021]: node.session.iscsi.InitialR2T = No
Dec 06 07:27:43 user nova-compute[75021]: node.session.iscsi.ImmediateData = Yes
Dec 06 07:27:43 user nova-compute[75021]: node.session.iscsi.FirstBurstLength = 262144
Dec 06 07:27:43 user nova-compute[75021]: node.session.iscsi.MaxBurstLength = 16776192
Dec 06 07:27:43 user nova-compute[75021]: node.session.iscsi.DefaultTime2Retain = 0
Dec 06 07:27:43 user nova-compute[75021]: node.session.iscsi.DefaultTime2Wait = 2
Dec 06 07:27:43 user nova-compute[75021]: node.session.iscsi.MaxConnections = 1
Dec 06 07:27:43 user nova-compute[75021]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 06 07:27:43 user nova-compute[75021]: node.session.iscsi.ERL = 0
Dec 06 07:27:43 user nova-compute[75021]: node.session.scan = manual
Dec 06 07:27:43 user nova-compute[75021]: node.session.reopen_max = 0
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].address = 172.16.0.220
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].port = 3260
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].startup = manual
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].tcp.window_size = 524288
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].tcp.type_of_service = 0
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].timeo.logout_timeout = 15
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].timeo.login_timeout = 15
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].timeo.auth_timeout = 45
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].timeo.noop_out_interval = 5
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].timeo.noop_out_timeout = 5
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].iscsi.HeaderDigest = None
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].iscsi.DataDigest = None
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].iscsi.IFMarker = No
Dec 06 07:27:43 user nova-compute[75021]: node.conn[0].iscsi.OFMarker = No
Dec 06 07:27:43 user nova-compute[75021]: # END RECORD
Dec 06 07:27:43 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcef222d-7868-4f8d-acf0-f8dcc4c16706]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccdb75a-a4c0-4422-b1f7-10d979492a06]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RsGLqfWl {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RsGLqfWl" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8189ad-9fa5-4a24-af5c-92a6db7c3747]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RsGLqfWl'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[463518fb-1efe-4dc7-b7d5-3c29d284a873]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead7bc97-d61c-43ca-beef-e874fbaaae69]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:27:43 user nova-compute[75021]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)
Dec 06 07:27:43 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:27:43 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:27:43 user nova-compute[75021]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)
Dec 06 07:27:43 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:27:43 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] HCTL ('36', '0', '0', 0) found on session 56 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c30bc6-dced-461f-9020-9500cc18667d]: (4, ('0 0 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Searching for a device in session 56 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsGLqfWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.199s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] <== connect_volume: return (200ms) {'type': 'block', 'scsi_wwn': '23932623337656133', 'path': '/dev/sde'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932623337656133', 'path': '/dev/sde'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1422117388',display_name='tempest-ServerStableDeviceRescueTest-server-1422117388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1422117388',id=42,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTyp1mNeRSFaOYhXh+upqAV91SqE5x6NiN1WeH04nh4B1+8t2m3RL1LSWF5730zfUczB8J0EeJcJ9Iizt0jKnjrFxRButr7rRwhlV+HlM+0niNeMPoFEDoamYa8Sf2mYw==',key_name='tempest-keypair-91380679',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:23:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df6f441403694bda9f8cfcfd2072d41d',ramdisk_id='',reservation_id='r-395d200m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2041652180',owner_user_name='tempest-ServerStableDeviceRescueTest-2041652180-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:25:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa0d7066c737488faa4d0465e7046be4',uuid=5a0c7109-a15e-440b-b0f3-785721e55627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "vif_mac": "fa:16:3e:59:be:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Converting VIF {"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "vif_mac": "fa:16:3e:59:be:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:be:5b,bridge_name='br-int',has_traffic_filtering=True,id=f342e747-6e80-462b-8193-7acecbc16a79,network=Network(2baad0e4-f46e-44a8-9967-4191ab3dab95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf342e747-6e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.objects.instance [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.objects.base [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Object Instance<5a0c7109-a15e-440b-b0f3-785721e55627> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:27:43 user nova-compute[75021]:   <uuid>5a0c7109-a15e-440b-b0f3-785721e55627</uuid>
Dec 06 07:27:43 user nova-compute[75021]:   <name>instance-0000002a</name>
Dec 06 07:27:43 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:27:43 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:27:43 user nova-compute[75021]:   <metadata>
Dec 06 07:27:43 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:27:43 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:27:43 user nova-compute[75021]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1422117388</nova:name>
Dec 06 07:27:43 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:27:43</nova:creationTime>
Dec 06 07:27:43 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:27:43 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:27:43 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:27:43 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:27:43 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:27:43 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:27:43 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:27:43 user nova-compute[75021]:       <nova:owner>
Dec 06 07:27:43 user nova-compute[75021]:         <nova:user uuid="fa0d7066c737488faa4d0465e7046be4">tempest-ServerStableDeviceRescueTest-2041652180-project-member</nova:user>
Dec 06 07:27:43 user nova-compute[75021]:         <nova:project uuid="df6f441403694bda9f8cfcfd2072d41d">tempest-ServerStableDeviceRescueTest-2041652180</nova:project>
Dec 06 07:27:43 user nova-compute[75021]:       </nova:owner>
Dec 06 07:27:43 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:27:43 user nova-compute[75021]:       <nova:ports>
Dec 06 07:27:43 user nova-compute[75021]:         <nova:port uuid="f342e747-6e80-462b-8193-7acecbc16a79">
Dec 06 07:27:43 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 06 07:27:43 user nova-compute[75021]:         </nova:port>
Dec 06 07:27:43 user nova-compute[75021]:       </nova:ports>
Dec 06 07:27:43 user nova-compute[75021]:     </nova:instance>
Dec 06 07:27:43 user nova-compute[75021]:   </metadata>
Dec 06 07:27:43 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:27:43 user nova-compute[75021]:     <system>
Dec 06 07:27:43 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:27:43 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:27:43 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:27:43 user nova-compute[75021]:       <entry name="serial">5a0c7109-a15e-440b-b0f3-785721e55627</entry>
Dec 06 07:27:43 user nova-compute[75021]:       <entry name="uuid">5a0c7109-a15e-440b-b0f3-785721e55627</entry>
Dec 06 07:27:43 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:27:43 user nova-compute[75021]:     </system>
Dec 06 07:27:43 user nova-compute[75021]:   </sysinfo>
Dec 06 07:27:43 user nova-compute[75021]:   <os>
Dec 06 07:27:43 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:27:43 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:27:43 user nova-compute[75021]:   </os>
Dec 06 07:27:43 user nova-compute[75021]:   <features>
Dec 06 07:27:43 user nova-compute[75021]:     <acpi/>
Dec 06 07:27:43 user nova-compute[75021]:     <apic/>
Dec 06 07:27:43 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:27:43 user nova-compute[75021]:   </features>
Dec 06 07:27:43 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:27:43 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:27:43 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:27:43 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:27:43 user nova-compute[75021]:   </clock>
Dec 06 07:27:43 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:27:43 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:27:43 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:27:43 user nova-compute[75021]:   </cpu>
Dec 06 07:27:43 user nova-compute[75021]:   <devices>
Dec 06 07:27:43 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:27:43 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:27:43 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk"/>
Dec 06 07:27:43 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:27:43 user nova-compute[75021]:     </disk>
Dec 06 07:27:43 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:27:43 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:27:43 user nova-compute[75021]:       <source dev="/dev/sde"/>
Dec 06 07:27:43 user nova-compute[75021]:       <target dev="vdb" bus="virtio"/>
Dec 06 07:27:43 user nova-compute[75021]:       <serial>4cf89dc4-c18e-4313-a159-d451f051c7e7</serial>
Dec 06 07:27:43 user nova-compute[75021]:     </disk>
Dec 06 07:27:43 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:27:43 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:27:43 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.rescue"/>
Dec 06 07:27:43 user nova-compute[75021]:       <target dev="vdc" bus="virtio"/>
Dec 06 07:27:43 user nova-compute[75021]:       <boot order="1"/>
Dec 06 07:27:43 user nova-compute[75021]:     </disk>
Dec 06 07:27:43 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:27:43 user nova-compute[75021]:       <mac address="fa:16:3e:59:be:5b"/>
Dec 06 07:27:43 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:27:43 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:27:43 user nova-compute[75021]:       <target dev="tapf342e747-6e"/>
Dec 06 07:27:43 user nova-compute[75021]:     </interface>
Dec 06 07:27:43 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:27:43 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/console.log" append="off"/>
Dec 06 07:27:43 user nova-compute[75021]:     </serial>
Dec 06 07:27:43 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:27:43 user nova-compute[75021]:     <video>
Dec 06 07:27:43 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:27:43 user nova-compute[75021]:     </video>
Dec 06 07:27:43 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:27:43 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:27:43 user nova-compute[75021]:     </rng>
Dec 06 07:27:43 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:27:43 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:27:43 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:27:43 user nova-compute[75021]:     </memballoon>
Dec 06 07:27:43 user nova-compute[75021]:   </devices>
Dec 06 07:27:43 user nova-compute[75021]: </domain>
Dec 06 07:27:43 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:27:43 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Instance destroyed successfully.
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:27:43 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] No VIF found with MAC fa:16:3e:59:be:5b, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:27:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-f18ff45f-6c61-49b7-9755-18ab51479ecf req-bf48904d-a83b-4649-98b1-8c1d7b3f4dd1 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:27:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f18ff45f-6c61-49b7-9755-18ab51479ecf req-bf48904d-a83b-4649-98b1-8c1d7b3f4dd1 service nova] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f18ff45f-6c61-49b7-9755-18ab51479ecf req-bf48904d-a83b-4649-98b1-8c1d7b3f4dd1 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f18ff45f-6c61-49b7-9755-18ab51479ecf req-bf48904d-a83b-4649-98b1-8c1d7b3f4dd1 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-f18ff45f-6c61-49b7-9755-18ab51479ecf req-bf48904d-a83b-4649-98b1-8c1d7b3f4dd1 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] No waiting events found dispatching network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:27:45 user nova-compute[75021]: WARNING nova.compute.manager [req-f18ff45f-6c61-49b7-9755-18ab51479ecf req-bf48904d-a83b-4649-98b1-8c1d7b3f4dd1 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received unexpected event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 for instance with vm_state active and task_state rescuing.
Dec 06 07:27:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-4ea3973b-5fd9-4ef4-8f49-581d5b10c355 req-436335bb-1364-4231-bd33-f97ee41e3146 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:27:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4ea3973b-5fd9-4ef4-8f49-581d5b10c355 req-436335bb-1364-4231-bd33-f97ee41e3146 service nova] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:27:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4ea3973b-5fd9-4ef4-8f49-581d5b10c355 req-436335bb-1364-4231-bd33-f97ee41e3146 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:27:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4ea3973b-5fd9-4ef4-8f49-581d5b10c355 req-436335bb-1364-4231-bd33-f97ee41e3146 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:27:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-4ea3973b-5fd9-4ef4-8f49-581d5b10c355 req-436335bb-1364-4231-bd33-f97ee41e3146 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] No waiting events found dispatching network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:27:47 user nova-compute[75021]: WARNING nova.compute.manager [req-4ea3973b-5fd9-4ef4-8f49-581d5b10c355 req-436335bb-1364-4231-bd33-f97ee41e3146 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received unexpected event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 for instance with vm_state active and task_state rescuing.
Dec 06 07:27:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-58543861-dbb5-4226-b8fb-4978e8753fb0 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:27:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:27:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:28:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:28:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:28:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:28:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:28:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:02 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f is timed out.
Dec 06 07:28:02 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Successfully detached device vdc from instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f from the live domain config.
Dec 06 07:28:02 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmibsEJN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:28:02 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:28:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf93a38e-d481-428c-8b0d-20efadc74716]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:28:02 user nova-compute[75021]: No targets found.
Dec 06 07:28:02 user nova-compute[75021]: iSNS:
Dec 06 07:28:02 user nova-compute[75021]: No targets found.
Dec 06 07:28:02 user nova-compute[75021]: STATIC:
Dec 06 07:28:02 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7
Dec 06 07:28:02 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:28:02 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:28:02 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008
Dec 06 07:28:02 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:28:02 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:28:02 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703
Dec 06 07:28:02 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:28:02 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:28:02 user nova-compute[75021]: FIRMWARE:
Dec 06 07:28:02 user nova-compute[75021]: No targets found.
Dec 06 07:28:02 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:28:02 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:28:02 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1900c8-9356-453a-a19b-ca42fc7860a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ecdc14-5715-48f0-9a50-d9fe5e16795f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:28:02 user nova-compute[75021]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)
Dec 06 07:28:02 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:28:02 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:28:02 user nova-compute[75021]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 (non-flash)
Dec 06 07:28:02 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:28:02 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b47f2830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008'): ({'sdd'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Removing single pathed devices sdd {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a091f9-5be7-4259-a9f8-33b541d0739b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f6e13e-87af-479d-8ecf-29f9e3db87b2]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Flushing IO for device /dev/sdd {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc20da16-42b8-4c9d-9434-80571c1c4cc9]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[236e8b83-cb6e-4fdc-9127-b7ca007a051d]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:28:02 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0ef4ac-683b-4c6a-bd45-5428cf5eb84a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ba3130-2477-4e78-8d20-972a99d08c48]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008, portal: 172.16.0.220,3260]
Dec 06 07:28:03 user nova-compute[75021]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008, portal: 172.16.0.220,3260] successful.
Dec 06 07:28:03 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df3fb437-0186-4ed1-b2c6-f8f4ffe9c008 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa3b97f-6905-4d33-afa9-4b44bb2f4756]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] <== disconnect_volume: return (294ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG nova.objects.instance [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'flavor' on Instance uuid 9fe9bf1d-78d1-4e46-825c-bb98245de86f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:28:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-03f3c514-f6b5-4cb5-b718-ed71bd61ba54 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.595s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:28:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:28:05 user nova-compute[75021]: INFO nova.compute.manager [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Terminating instance
Dec 06 07:28:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-69c23878-ed9a-4ad7-8690-66d4f22011f9 req-ac9b2fa9-ee54-4b76-9831-8ed341264db7 service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Received event network-vif-unplugged-3dcc8cb9-4843-41a8-b7be-28b096f782e7 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-69c23878-ed9a-4ad7-8690-66d4f22011f9 req-ac9b2fa9-ee54-4b76-9831-8ed341264db7 service nova] Acquiring lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-69c23878-ed9a-4ad7-8690-66d4f22011f9 req-ac9b2fa9-ee54-4b76-9831-8ed341264db7 service nova] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-69c23878-ed9a-4ad7-8690-66d4f22011f9 req-ac9b2fa9-ee54-4b76-9831-8ed341264db7 service nova] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-69c23878-ed9a-4ad7-8690-66d4f22011f9 req-ac9b2fa9-ee54-4b76-9831-8ed341264db7 service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] No waiting events found dispatching network-vif-unplugged-3dcc8cb9-4843-41a8-b7be-28b096f782e7 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG nova.compute.manager [req-69c23878-ed9a-4ad7-8690-66d4f22011f9 req-ac9b2fa9-ee54-4b76-9831-8ed341264db7 service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Received event network-vif-unplugged-3dcc8cb9-4843-41a8-b7be-28b096f782e7 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:06 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Instance destroyed successfully.
Dec 06 07:28:06 user nova-compute[75021]: DEBUG nova.objects.instance [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lazy-loading 'resources' on Instance uuid 9fe9bf1d-78d1-4e46-825c-bb98245de86f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:28:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1709808972',display_name='tempest-AttachVolumeTestJSON-server-1709808972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1709808972',id=43,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJ+KXeJODumjlDd6jRjNsA12jHuqNdF7LgK5HoRS0XlyiFWPsrLxBN53u4Lj+H+FMW68FReRN3GCieZxZMwIVyIV1Pt/j2A8NcpgcMAfDJtHsyAaAI1AQPxIeb15zGkjw==',key_name='tempest-keypair-450775644',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:24:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0a2ff3d04db4832a990891c79df356c',ramdisk_id='',reservation_id='r-dvmd3an5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-280062788',owner_user_name='tempest-AttachVolumeTestJSON-280062788-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9947f4c20feb463fb485de2a7d4bbef5',uuid=9fe9bf1d-78d1-4e46-825c-bb98245de86f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "address": "fa:16:3e:f7:29:3a", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcc8cb9-48", "ovs_interfaceid": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:28:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converting VIF {"id": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "address": "fa:16:3e:f7:29:3a", "network": {"id": "028fd041-7600-47aa-8009-f90a348aabfd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1176606728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0a2ff3d04db4832a990891c79df356c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dcc8cb9-48", "ovs_interfaceid": "3dcc8cb9-4843-41a8-b7be-28b096f782e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:28:06 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:29:3a,bridge_name='br-int',has_traffic_filtering=True,id=3dcc8cb9-4843-41a8-b7be-28b096f782e7,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dcc8cb9-48') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:28:06 user nova-compute[75021]: DEBUG os_vif [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:29:3a,bridge_name='br-int',has_traffic_filtering=True,id=3dcc8cb9-4843-41a8-b7be-28b096f782e7,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dcc8cb9-48') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:28:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dcc8cb9-48, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:28:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:28:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2cd6768-9a32-4cd0-a6c4-38d3525f8809) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:28:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:28:06 user nova-compute[75021]: INFO os_vif [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:29:3a,bridge_name='br-int',has_traffic_filtering=True,id=3dcc8cb9-4843-41a8-b7be-28b096f782e7,network=Network(028fd041-7600-47aa-8009-f90a348aabfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dcc8cb9-48')
Dec 06 07:28:06 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Deleting instance files /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f_del
Dec 06 07:28:06 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Deletion of /opt/stack/data/nova/instances/9fe9bf1d-78d1-4e46-825c-bb98245de86f_del complete
Dec 06 07:28:06 user nova-compute[75021]: INFO nova.compute.manager [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 06 07:28:06 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:28:06 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:28:06 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:28:06 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:28:06 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Took 0.70 seconds to deallocate network for instance.
Dec 06 07:28:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:28:06 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:28:07 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:28:07 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:28:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:28:07 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Deleted allocations for instance 9fe9bf1d-78d1-4e46-825c-bb98245de86f
Dec 06 07:28:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ecde4741-2d7d-41ce-a66e-4f7bacd00256 tempest-AttachVolumeTestJSON-280062788 tempest-AttachVolumeTestJSON-280062788-project-member] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.072s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:28:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-daff16a7-f76a-443c-9691-7c52a4d708c7 req-ec2da1e2-a2c3-42a7-8f02-682359c56d9a service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Received event network-vif-plugged-3dcc8cb9-4843-41a8-b7be-28b096f782e7 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:28:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-daff16a7-f76a-443c-9691-7c52a4d708c7 req-ec2da1e2-a2c3-42a7-8f02-682359c56d9a service nova] Acquiring lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:28:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-daff16a7-f76a-443c-9691-7c52a4d708c7 req-ec2da1e2-a2c3-42a7-8f02-682359c56d9a service nova] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:28:07 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-daff16a7-f76a-443c-9691-7c52a4d708c7 req-ec2da1e2-a2c3-42a7-8f02-682359c56d9a service nova] Lock "9fe9bf1d-78d1-4e46-825c-bb98245de86f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:28:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-daff16a7-f76a-443c-9691-7c52a4d708c7 req-ec2da1e2-a2c3-42a7-8f02-682359c56d9a service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] No waiting events found dispatching network-vif-plugged-3dcc8cb9-4843-41a8-b7be-28b096f782e7 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:28:07 user nova-compute[75021]: WARNING nova.compute.manager [req-daff16a7-f76a-443c-9691-7c52a4d708c7 req-ec2da1e2-a2c3-42a7-8f02-682359c56d9a service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Received unexpected event network-vif-plugged-3dcc8cb9-4843-41a8-b7be-28b096f782e7 for instance with vm_state deleted and task_state None.
Dec 06 07:28:07 user nova-compute[75021]: DEBUG nova.compute.manager [req-daff16a7-f76a-443c-9691-7c52a4d708c7 req-ec2da1e2-a2c3-42a7-8f02-682359c56d9a service nova] [instance: 9fe9bf1d-78d1-4e46-825c-bb98245de86f] Received event network-vif-deleted-3dcc8cb9-4843-41a8-b7be-28b096f782e7 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:28:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "d994eb8e-4831-4731-80e8-036c55d3922f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "d994eb8e-4831-4731-80e8-036c55d3922f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "d994eb8e-4831-4731-80e8-036c55d3922f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "d994eb8e-4831-4731-80e8-036c55d3922f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "d994eb8e-4831-4731-80e8-036c55d3922f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:28:18 user nova-compute[75021]: INFO nova.compute.manager [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Terminating instance
Dec 06 07:28:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:28:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-9f469994-9886-453b-9cb2-4a85b9673b1a req-1efda96b-0f20-403c-a6eb-4cc7b9a694f3 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Received event network-vif-unplugged-4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9f469994-9886-453b-9cb2-4a85b9673b1a req-1efda96b-0f20-403c-a6eb-4cc7b9a694f3 service nova] Acquiring lock "d994eb8e-4831-4731-80e8-036c55d3922f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9f469994-9886-453b-9cb2-4a85b9673b1a req-1efda96b-0f20-403c-a6eb-4cc7b9a694f3 service nova] Lock "d994eb8e-4831-4731-80e8-036c55d3922f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:28:18 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9f469994-9886-453b-9cb2-4a85b9673b1a req-1efda96b-0f20-403c-a6eb-4cc7b9a694f3 service nova] Lock "d994eb8e-4831-4731-80e8-036c55d3922f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:28:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-9f469994-9886-453b-9cb2-4a85b9673b1a req-1efda96b-0f20-403c-a6eb-4cc7b9a694f3 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] No waiting events found dispatching network-vif-unplugged-4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:28:18 user nova-compute[75021]: DEBUG nova.compute.manager [req-9f469994-9886-453b-9cb2-4a85b9673b1a req-1efda96b-0f20-403c-a6eb-4cc7b9a694f3 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Received event network-vif-unplugged-4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:28:19 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Instance destroyed successfully.
Dec 06 07:28:19 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lazy-loading 'resources' on Instance uuid d994eb8e-4831-4731-80e8-036c55d3922f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-981783174',display_name='tempest-VolumesActionsTest-instance-981783174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-981783174',id=44,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:26:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5ac7f58dce14545bb9b45b3a94309b1',ramdisk_id='',reservation_id='r-yxjsjrg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1127490927',owner_user_name='tempest-VolumesActionsTest-1127490927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:26:34Z,user_data=None,user_id='f86b8a1612164096bdfb4fa242e95bb1',uuid=d994eb8e-4831-4731-80e8-036c55d3922f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "address": "fa:16:3e:20:e1:2e", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4773b8d7-f8", "ovs_interfaceid": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Converting VIF {"id": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "address": "fa:16:3e:20:e1:2e", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4773b8d7-f8", "ovs_interfaceid": "4773b8d7-f8f6-4ccb-ba84-6b87b13a9335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:e1:2e,bridge_name='br-int',has_traffic_filtering=True,id=4773b8d7-f8f6-4ccb-ba84-6b87b13a9335,network=Network(39ddcfc4-035c-49a7-94ae-ba86737c00ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4773b8d7-f8') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG os_vif [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:e1:2e,bridge_name='br-int',has_traffic_filtering=True,id=4773b8d7-f8f6-4ccb-ba84-6b87b13a9335,network=Network(39ddcfc4-035c-49a7-94ae-ba86737c00ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4773b8d7-f8') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4773b8d7-f8, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c31e9d0e-d202-4069-a855-b773fc3a0021) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:19 user nova-compute[75021]: INFO os_vif [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:e1:2e,bridge_name='br-int',has_traffic_filtering=True,id=4773b8d7-f8f6-4ccb-ba84-6b87b13a9335,network=Network(39ddcfc4-035c-49a7-94ae-ba86737c00ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4773b8d7-f8')
Dec 06 07:28:19 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Deleting instance files /opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f_del
Dec 06 07:28:19 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Deletion of /opt/stack/data/nova/instances/d994eb8e-4831-4731-80e8-036c55d3922f_del complete
Dec 06 07:28:19 user nova-compute[75021]: INFO nova.compute.manager [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Took 0.70 seconds to destroy the instance on the hypervisor.
Dec 06 07:28:19 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:19 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Error from libvirt while getting description of instance-0000002c: [Error Code 42] Domain not found: no domain with matching uuid 'd994eb8e-4831-4731-80e8-036c55d3922f' (instance-0000002c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd994eb8e-4831-4731-80e8-036c55d3922f' (instance-0000002c)
Dec 06 07:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-6d1aca85-712b-4fb2-9d0f-94735a94a8a3 req-90cab54f-2b93-454b-bd27-5dce02d88860 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Received event network-vif-deleted-4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:28:20 user nova-compute[75021]: INFO nova.compute.manager [req-6d1aca85-712b-4fb2-9d0f-94735a94a8a3 req-90cab54f-2b93-454b-bd27-5dce02d88860 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Neutron deleted interface 4773b8d7-f8f6-4ccb-ba84-6b87b13a9335; detaching it from the instance and deleting it from the info cache
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.network.neutron [req-6d1aca85-712b-4fb2-9d0f-94735a94a8a3 req-90cab54f-2b93-454b-bd27-5dce02d88860 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:28:20 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:28:20 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8611MB free_disk=25.095291137695312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-6d1aca85-712b-4fb2-9d0f-94735a94a8a3 req-90cab54f-2b93-454b-bd27-5dce02d88860 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Detach interface failed, port_id=4773b8d7-f8f6-4ccb-ba84-6b87b13a9335, reason: Instance d994eb8e-4831-4731-80e8-036c55d3922f could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 07:28:20 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Took 1.21 seconds to deallocate network for instance.
Dec 06 07:28:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5a0c7109-a15e-440b-b0f3-785721e55627 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance d994eb8e-4831-4731-80e8-036c55d3922f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance be4426d8-f8fa-4c62-bfa6-74944341d938 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.175s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-e4b7e483-83dd-4fb8-9683-5c5ced77a94e req-b1002039-2c64-4be6-825f-aa4964883529 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Received event network-vif-plugged-4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e4b7e483-83dd-4fb8-9683-5c5ced77a94e req-b1002039-2c64-4be6-825f-aa4964883529 service nova] Acquiring lock "d994eb8e-4831-4731-80e8-036c55d3922f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e4b7e483-83dd-4fb8-9683-5c5ced77a94e req-b1002039-2c64-4be6-825f-aa4964883529 service nova] Lock "d994eb8e-4831-4731-80e8-036c55d3922f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e4b7e483-83dd-4fb8-9683-5c5ced77a94e req-b1002039-2c64-4be6-825f-aa4964883529 service nova] Lock "d994eb8e-4831-4731-80e8-036c55d3922f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:28:20 user nova-compute[75021]: DEBUG nova.compute.manager [req-e4b7e483-83dd-4fb8-9683-5c5ced77a94e req-b1002039-2c64-4be6-825f-aa4964883529 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] No waiting events found dispatching network-vif-plugged-4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:28:20 user nova-compute[75021]: WARNING nova.compute.manager [req-e4b7e483-83dd-4fb8-9683-5c5ced77a94e req-b1002039-2c64-4be6-825f-aa4964883529 service nova] [instance: d994eb8e-4831-4731-80e8-036c55d3922f] Received unexpected event network-vif-plugged-4773b8d7-f8f6-4ccb-ba84-6b87b13a9335 for instance with vm_state deleted and task_state None.
Dec 06 07:28:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:28:21 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Deleted allocations for instance d994eb8e-4831-4731-80e8-036c55d3922f
Dec 06 07:28:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b9053f4a-cda1-4913-9ee6-d37d9a6ec143 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "d994eb8e-4831-4731-80e8-036c55d3922f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.451s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:28:23 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:28:23 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:28:23 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:28:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:28:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:28:23 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:28:23 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:28:24 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updating instance_info_cache with network_info: [{"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:28:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:28:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:28:24 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:28:24 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:28:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:24 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:28:25 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:28:26 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:28:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:28:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:28:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-7d5dafa2-9107-4bc0-a209-aa5c802d501f req-a15a4d4f-8b20-43cc-bd3f-73da66d36732 service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Received event network-changed-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:28:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-7d5dafa2-9107-4bc0-a209-aa5c802d501f req-a15a4d4f-8b20-43cc-bd3f-73da66d36732 service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Refreshing instance network info cache due to event network-changed-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:28:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7d5dafa2-9107-4bc0-a209-aa5c802d501f req-a15a4d4f-8b20-43cc-bd3f-73da66d36732 service nova] Acquiring lock "refresh_cache-be4426d8-f8fa-4c62-bfa6-74944341d938" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:28:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7d5dafa2-9107-4bc0-a209-aa5c802d501f req-a15a4d4f-8b20-43cc-bd3f-73da66d36732 service nova] Acquired lock "refresh_cache-be4426d8-f8fa-4c62-bfa6-74944341d938" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:28:39 user nova-compute[75021]: DEBUG nova.network.neutron [req-7d5dafa2-9107-4bc0-a209-aa5c802d501f req-a15a4d4f-8b20-43cc-bd3f-73da66d36732 service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Refreshing network info cache for port 3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:28:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-7d5dafa2-9107-4bc0-a209-aa5c802d501f req-a15a4d4f-8b20-43cc-bd3f-73da66d36732 service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Updated VIF entry in instance network info cache for port 3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:28:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-7d5dafa2-9107-4bc0-a209-aa5c802d501f req-a15a4d4f-8b20-43cc-bd3f-73da66d36732 service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Updating instance_info_cache with network_info: [{"id": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "address": "fa:16:3e:ca:09:be", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bba7a6d-ec", "ovs_interfaceid": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:28:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-7d5dafa2-9107-4bc0-a209-aa5c802d501f req-a15a4d4f-8b20-43cc-bd3f-73da66d36732 service nova] Releasing lock "refresh_cache-be4426d8-f8fa-4c62-bfa6-74944341d938" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:28:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:28:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "527ac697-aab8-423e-8e92-16c702670793" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:28:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "527ac697-aab8-423e-8e92-16c702670793" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:28:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:28:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:28:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:28:47 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:28:47 user nova-compute[75021]: INFO nova.compute.claims [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Claim successful on node user
Dec 06 07:28:47 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:28:47 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:28:48 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:28:48 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:28:48 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:28:48 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:28:48 user nova-compute[75021]: DEBUG nova.network.neutron [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:28:48 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:28:48 user nova-compute[75021]: INFO nova.virt.block_device [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Booting with volume snapshot 3161d36b-33a5-402f-bd9a-bc0383eec88b at /dev/vda
Dec 06 07:28:48 user nova-compute[75021]: DEBUG nova.policy [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b39552dec3964bf69ed87b5ca130fe5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddfde019af4962929aa2c8cfa84b35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:28:48 user nova-compute[75021]: DEBUG nova.network.neutron [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Successfully created port: 61fea00a-5787-4441-896a-17321da5e643 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:28:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:49 user nova-compute[75021]: DEBUG nova.network.neutron [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Successfully updated port: 61fea00a-5787-4441-896a-17321da5e643 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "refresh_cache-527ac697-aab8-423e-8e92-16c702670793" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquired lock "refresh_cache-527ac697-aab8-423e-8e92-16c702670793" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:28:49 user nova-compute[75021]: DEBUG nova.network.neutron [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:28:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-2eb2a738-486c-4a5e-9cde-14355c50ff59 req-e25a1a03-780a-450f-80a8-ad87b860431e service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Received event network-changed-61fea00a-5787-4441-896a-17321da5e643 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:28:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-2eb2a738-486c-4a5e-9cde-14355c50ff59 req-e25a1a03-780a-450f-80a8-ad87b860431e service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Refreshing instance network info cache due to event network-changed-61fea00a-5787-4441-896a-17321da5e643. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2eb2a738-486c-4a5e-9cde-14355c50ff59 req-e25a1a03-780a-450f-80a8-ad87b860431e service nova] Acquiring lock "refresh_cache-527ac697-aab8-423e-8e92-16c702670793" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:28:49 user nova-compute[75021]: DEBUG nova.network.neutron [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:28:49 user nova-compute[75021]: DEBUG nova.network.neutron [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Updating instance_info_cache with network_info: [{"id": "61fea00a-5787-4441-896a-17321da5e643", "address": "fa:16:3e:09:15:40", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fea00a-57", "ovs_interfaceid": "61fea00a-5787-4441-896a-17321da5e643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Releasing lock "refresh_cache-527ac697-aab8-423e-8e92-16c702670793" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:28:49 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Instance network_info: |[{"id": "61fea00a-5787-4441-896a-17321da5e643", "address": "fa:16:3e:09:15:40", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fea00a-57", "ovs_interfaceid": "61fea00a-5787-4441-896a-17321da5e643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:28:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2eb2a738-486c-4a5e-9cde-14355c50ff59 req-e25a1a03-780a-450f-80a8-ad87b860431e service nova] Acquired lock "refresh_cache-527ac697-aab8-423e-8e92-16c702670793" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:28:49 user nova-compute[75021]: DEBUG nova.network.neutron [req-2eb2a738-486c-4a5e-9cde-14355c50ff59 req-e25a1a03-780a-450f-80a8-ad87b860431e service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Refreshing network info cache for port 61fea00a-5787-4441-896a-17321da5e643 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:28:50 user nova-compute[75021]: DEBUG nova.network.neutron [req-2eb2a738-486c-4a5e-9cde-14355c50ff59 req-e25a1a03-780a-450f-80a8-ad87b860431e service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Updated VIF entry in instance network info cache for port 61fea00a-5787-4441-896a-17321da5e643. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:28:50 user nova-compute[75021]: DEBUG nova.network.neutron [req-2eb2a738-486c-4a5e-9cde-14355c50ff59 req-e25a1a03-780a-450f-80a8-ad87b860431e service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Updating instance_info_cache with network_info: [{"id": "61fea00a-5787-4441-896a-17321da5e643", "address": "fa:16:3e:09:15:40", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fea00a-57", "ovs_interfaceid": "61fea00a-5787-4441-896a-17321da5e643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:28:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2eb2a738-486c-4a5e-9cde-14355c50ff59 req-e25a1a03-780a-450f-80a8-ad87b860431e service nova] Releasing lock "refresh_cache-527ac697-aab8-423e-8e92-16c702670793" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG os_brick.utils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36b33ac-e39f-4c91-b0ac-72013c6c3fc4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[238df940-7259-4b71-a588-245592f4304d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b01213-c0f8-4b16-af84-b0ab620b79fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3fb8d4-b188-4237-90ce-8fcfa2acb202]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:28:53 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:28:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e536d0cf-26cc-4467-b063-2e70454cc6bb]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG os_brick.utils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:28:53 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Updating existing volume attachment record: b36016e4-4c2f-4b6b-a589-7cdb71f1e813 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:28:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:28:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:28:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:29:09 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Creating image(s)
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Ensure instance console log exists: /opt/stack/data/nova/instances/527ac697-aab8-423e-8e92-16c702670793/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Start _get_guest_xml network_info=[{"id": "61fea00a-5787-4441-896a-17321da5e643", "address": "fa:16:3e:09:15:40", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fea00a-57", "ovs_interfaceid": "61fea00a-5787-4441-896a-17321da5e643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-06T07:28:41Z,direct_url=<?>,disk_format='qcow2',id=dbf71722-12ca-4330-a521-a6f877152f07,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-576112326',owner='00ddfde019af4962929aa2c8cfa84b35',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-06T07:28:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b36016e4-4c2f-4b6b-a589-7cdb71f1e813', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRZHdjQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '527ac697-aab8-423e-8e92-16c702670793', 'attached_at': '', 'detached_at': '', 'volume_id': '43091b3b-2901-4f71-899a-da5be44250ac', 'serial': '43091b3b-2901-4f71-899a-da5be44250ac'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:29:09 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:29:09 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-06T07:28:41Z,direct_url=<?>,disk_format='qcow2',id=dbf71722-12ca-4330-a521-a6f877152f07,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-576112326',owner='00ddfde019af4962929aa2c8cfa84b35',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-06T07:28:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRZHdjQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:29:09 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:29:09 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:29:09 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5e7651-ff26-4b08-b82e-99691bf68886]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:29:09 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2209ebc1-0f45-43ad-ba26-00f75fc9b920]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac] added
Dec 06 07:29:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea04ee21-fede-4099-8a41-0fe80194938d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ad3903-aa3c-4a7f-858f-eed59a99384a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vRZHdjQb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vRZHdjQb" returned: 0 in 0.026s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc873cf-6ece-41d1-bfe4-d03af1dae1bf]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vRZHdjQb'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c933ae60-be71-4a16-9a2a-e88908e21abb]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b2da49-3f73-4fcc-923a-9a03db901020]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:29:09 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:29:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:29:09 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:29:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30b51b1-d4dd-4d12-b46b-7db54271f05d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac, portal: 172.16.0.220,3260]
Dec 06 07:29:09 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac, portal: 172.16.0.220,3260] successful.
Dec 06 07:29:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[caef0dea-6139-485b-ae60-f6878736c9bf]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9a93a3-a313-443f-a32e-3cfe7cc34d0f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:29:09 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:29:09 user nova-compute[75021]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac (non-flash)
Dec 06 07:29:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:29:09 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:29:09 user nova-compute[75021]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac (non-flash)
Dec 06 07:29:09 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf281945-9864-49e7-adb4-516a027c7532]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:09 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "f62bddff-a202-47e7-88b1-d7505eb92731" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "f62bddff-a202-47e7-88b1-d7505eb92731" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:29:10 user nova-compute[75021]: INFO nova.compute.claims [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Claim successful on node user
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRZHdjQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26630346566633665', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630346566633665', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.network.neutron [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1154956034',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1154956034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1154956034',id=46,image_ref='dbf71722-12ca-4330-a521-a6f877152f07',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMEVzWruYyyumq/m30nZGfE8lBn+peIh8M86Qiw/0ulFYqmRElQzi7St8aK8BETCK1M6cn83ts4v2bXLuRuo8edtRmLLwiTdvIkynD/M19goTKBmju8U5Q98Em7sXuVsA==',key_name='tempest-keypair-1281158074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-ymp62iun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1013845055',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=527ac697-aab8-423e-8e92-16c702670793,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61fea00a-5787-4441-896a-17321da5e643", "address": "fa:16:3e:09:15:40", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fea00a-57", "ovs_interfaceid": "61fea00a-5787-4441-896a-17321da5e643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "61fea00a-5787-4441-896a-17321da5e643", "address": "fa:16:3e:09:15:40", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fea00a-57", "ovs_interfaceid": "61fea00a-5787-4441-896a-17321da5e643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:15:40,bridge_name='br-int',has_traffic_filtering=True,id=61fea00a-5787-4441-896a-17321da5e643,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61fea00a-57') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.objects.instance [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lazy-loading 'pci_devices' on Instance uuid 527ac697-aab8-423e-8e92-16c702670793 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:29:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:29:10 user nova-compute[75021]:   <uuid>527ac697-aab8-423e-8e92-16c702670793</uuid>
Dec 06 07:29:10 user nova-compute[75021]:   <name>instance-0000002e</name>
Dec 06 07:29:10 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:29:10 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:29:10 user nova-compute[75021]:   <metadata>
Dec 06 07:29:10 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:29:10 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:29:10 user nova-compute[75021]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1154956034</nova:name>
Dec 06 07:29:10 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:29:09</nova:creationTime>
Dec 06 07:29:10 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:29:10 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:29:10 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:29:10 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:29:10 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:29:10 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:29:10 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:29:10 user nova-compute[75021]:       <nova:owner>
Dec 06 07:29:10 user nova-compute[75021]:         <nova:user uuid="b39552dec3964bf69ed87b5ca130fe5f">tempest-TestVolumeBootPattern-1013845055-project-member</nova:user>
Dec 06 07:29:10 user nova-compute[75021]:         <nova:project uuid="00ddfde019af4962929aa2c8cfa84b35">tempest-TestVolumeBootPattern-1013845055</nova:project>
Dec 06 07:29:10 user nova-compute[75021]:       </nova:owner>
Dec 06 07:29:10 user nova-compute[75021]:       <nova:root type="image" uuid="dbf71722-12ca-4330-a521-a6f877152f07"/>
Dec 06 07:29:10 user nova-compute[75021]:       <nova:ports>
Dec 06 07:29:10 user nova-compute[75021]:         <nova:port uuid="61fea00a-5787-4441-896a-17321da5e643">
Dec 06 07:29:10 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 06 07:29:10 user nova-compute[75021]:         </nova:port>
Dec 06 07:29:10 user nova-compute[75021]:       </nova:ports>
Dec 06 07:29:10 user nova-compute[75021]:     </nova:instance>
Dec 06 07:29:10 user nova-compute[75021]:   </metadata>
Dec 06 07:29:10 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:29:10 user nova-compute[75021]:     <system>
Dec 06 07:29:10 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:29:10 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:29:10 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:29:10 user nova-compute[75021]:       <entry name="serial">527ac697-aab8-423e-8e92-16c702670793</entry>
Dec 06 07:29:10 user nova-compute[75021]:       <entry name="uuid">527ac697-aab8-423e-8e92-16c702670793</entry>
Dec 06 07:29:10 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:29:10 user nova-compute[75021]:     </system>
Dec 06 07:29:10 user nova-compute[75021]:   </sysinfo>
Dec 06 07:29:10 user nova-compute[75021]:   <os>
Dec 06 07:29:10 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:29:10 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:29:10 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:29:10 user nova-compute[75021]:   </os>
Dec 06 07:29:10 user nova-compute[75021]:   <features>
Dec 06 07:29:10 user nova-compute[75021]:     <acpi/>
Dec 06 07:29:10 user nova-compute[75021]:     <apic/>
Dec 06 07:29:10 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:29:10 user nova-compute[75021]:   </features>
Dec 06 07:29:10 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:29:10 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:29:10 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:29:10 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:29:10 user nova-compute[75021]:   </clock>
Dec 06 07:29:10 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:29:10 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:29:10 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:29:10 user nova-compute[75021]:   </cpu>
Dec 06 07:29:10 user nova-compute[75021]:   <devices>
Dec 06 07:29:10 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:29:10 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:29:10 user nova-compute[75021]:       <source dev="/dev/sdb"/>
Dec 06 07:29:10 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:29:10 user nova-compute[75021]:       <serial>43091b3b-2901-4f71-899a-da5be44250ac</serial>
Dec 06 07:29:10 user nova-compute[75021]:     </disk>
Dec 06 07:29:10 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:29:10 user nova-compute[75021]:       <mac address="fa:16:3e:09:15:40"/>
Dec 06 07:29:10 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:29:10 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:29:10 user nova-compute[75021]:       <target dev="tap61fea00a-57"/>
Dec 06 07:29:10 user nova-compute[75021]:     </interface>
Dec 06 07:29:10 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:29:10 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/527ac697-aab8-423e-8e92-16c702670793/console.log" append="off"/>
Dec 06 07:29:10 user nova-compute[75021]:     </serial>
Dec 06 07:29:10 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:29:10 user nova-compute[75021]:     <video>
Dec 06 07:29:10 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:29:10 user nova-compute[75021]:     </video>
Dec 06 07:29:10 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:29:10 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:29:10 user nova-compute[75021]:     </rng>
Dec 06 07:29:10 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:29:10 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:29:10 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:29:10 user nova-compute[75021]:     </memballoon>
Dec 06 07:29:10 user nova-compute[75021]:   </devices>
Dec 06 07:29:10 user nova-compute[75021]: </domain>
Dec 06 07:29:10 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1154956034',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1154956034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1154956034',id=46,image_ref='dbf71722-12ca-4330-a521-a6f877152f07',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMEVzWruYyyumq/m30nZGfE8lBn+peIh8M86Qiw/0ulFYqmRElQzi7St8aK8BETCK1M6cn83ts4v2bXLuRuo8edtRmLLwiTdvIkynD/M19goTKBmju8U5Q98Em7sXuVsA==',key_name='tempest-keypair-1281158074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-ymp62iun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1013845055',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=527ac697-aab8-423e-8e92-16c702670793,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61fea00a-5787-4441-896a-17321da5e643", "address": "fa:16:3e:09:15:40", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fea00a-57", "ovs_interfaceid": "61fea00a-5787-4441-896a-17321da5e643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "61fea00a-5787-4441-896a-17321da5e643", "address": "fa:16:3e:09:15:40", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fea00a-57", "ovs_interfaceid": "61fea00a-5787-4441-896a-17321da5e643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:15:40,bridge_name='br-int',has_traffic_filtering=True,id=61fea00a-5787-4441-896a-17321da5e643,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61fea00a-57') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG os_vif [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:15:40,bridge_name='br-int',has_traffic_filtering=True,id=61fea00a-5787-4441-896a-17321da5e643,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61fea00a-57') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG nova.compute.manager [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5fda733a-bb48-5a98-a54c-9e45ebc3b341', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61fea00a-57, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61fea00a-57, col_values=(('qos', UUID('aa97b0cf-5c22-439f-aaf1-c82db03d10fb')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61fea00a-57, col_values=(('external_ids', {'iface-id': '61fea00a-5787-4441-896a-17321da5e643', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:15:40', 'vm-uuid': '527ac697-aab8-423e-8e92-16c702670793'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:11 user nova-compute[75021]: INFO os_vif [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:15:40,bridge_name='br-int',has_traffic_filtering=True,id=61fea00a-5787-4441-896a-17321da5e643,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61fea00a-57')
Dec 06 07:29:11 user nova-compute[75021]: DEBUG nova.policy [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f86b8a1612164096bdfb4fa242e95bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5ac7f58dce14545bb9b45b3a94309b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] No VIF found with MAC fa:16:3e:09:15:40, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG nova.compute.manager [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:29:11 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Creating image(s)
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "/opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "/opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "/opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk 1073741824" returned: 0 in 0.055s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG nova.network.neutron [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Successfully created port: e41cc83a-c8d7-4c86-9d36-816ef12a3599 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.192s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Cannot resize image /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Ensure instance console log exists: /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:11 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Successfully updated port: e41cc83a-c8d7-4c86-9d36-816ef12a3599 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "refresh_cache-f62bddff-a202-47e7-88b1-d7505eb92731" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquired lock "refresh_cache-f62bddff-a202-47e7-88b1-d7505eb92731" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-fd2a8a6e-8956-49ec-9d65-31fdeba80545 req-9aa17308-2780-4bd1-963e-1b20844ab5d1 service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Received event network-changed-e41cc83a-c8d7-4c86-9d36-816ef12a3599 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-fd2a8a6e-8956-49ec-9d65-31fdeba80545 req-9aa17308-2780-4bd1-963e-1b20844ab5d1 service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Refreshing instance network info cache due to event network-changed-e41cc83a-c8d7-4c86-9d36-816ef12a3599. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fd2a8a6e-8956-49ec-9d65-31fdeba80545 req-9aa17308-2780-4bd1-963e-1b20844ab5d1 service nova] Acquiring lock "refresh_cache-f62bddff-a202-47e7-88b1-d7505eb92731" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-e6096a2f-9067-4207-8981-39b2b1341085 req-0d0e19fc-4935-44ba-9c0b-1c52a68d9e19 service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Received event network-vif-plugged-61fea00a-5787-4441-896a-17321da5e643 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e6096a2f-9067-4207-8981-39b2b1341085 req-0d0e19fc-4935-44ba-9c0b-1c52a68d9e19 service nova] Acquiring lock "527ac697-aab8-423e-8e92-16c702670793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e6096a2f-9067-4207-8981-39b2b1341085 req-0d0e19fc-4935-44ba-9c0b-1c52a68d9e19 service nova] Lock "527ac697-aab8-423e-8e92-16c702670793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e6096a2f-9067-4207-8981-39b2b1341085 req-0d0e19fc-4935-44ba-9c0b-1c52a68d9e19 service nova] Lock "527ac697-aab8-423e-8e92-16c702670793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-e6096a2f-9067-4207-8981-39b2b1341085 req-0d0e19fc-4935-44ba-9c0b-1c52a68d9e19 service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] No waiting events found dispatching network-vif-plugged-61fea00a-5787-4441-896a-17321da5e643 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:29:12 user nova-compute[75021]: WARNING nova.compute.manager [req-e6096a2f-9067-4207-8981-39b2b1341085 req-0d0e19fc-4935-44ba-9c0b-1c52a68d9e19 service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Received unexpected event network-vif-plugged-61fea00a-5787-4441-896a-17321da5e643 for instance with vm_state building and task_state spawning.
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.network.neutron [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Updating instance_info_cache with network_info: [{"id": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "address": "fa:16:3e:c5:e8:c4", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41cc83a-c8", "ovs_interfaceid": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Releasing lock "refresh_cache-f62bddff-a202-47e7-88b1-d7505eb92731" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.compute.manager [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Instance network_info: |[{"id": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "address": "fa:16:3e:c5:e8:c4", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41cc83a-c8", "ovs_interfaceid": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fd2a8a6e-8956-49ec-9d65-31fdeba80545 req-9aa17308-2780-4bd1-963e-1b20844ab5d1 service nova] Acquired lock "refresh_cache-f62bddff-a202-47e7-88b1-d7505eb92731" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.network.neutron [req-fd2a8a6e-8956-49ec-9d65-31fdeba80545 req-9aa17308-2780-4bd1-963e-1b20844ab5d1 service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Refreshing network info cache for port e41cc83a-c8d7-4c86-9d36-816ef12a3599 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Start _get_guest_xml network_info=[{"id": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "address": "fa:16:3e:c5:e8:c4", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41cc83a-c8", "ovs_interfaceid": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:29:12 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:29:12 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1533914723',display_name='tempest-VolumesActionsTest-instance-1533914723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1533914723',id=47,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5ac7f58dce14545bb9b45b3a94309b1',ramdisk_id='',reservation_id='r-3hema5au',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1127490927',owner_user_name='tempest-VolumesActionsTest-1127490927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:29:11Z,user_data=None,user_id='f86b8a1612164096bdfb4fa242e95bb1',uuid=f62bddff-a202-47e7-88b1-d7505eb92731,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "address": "fa:16:3e:c5:e8:c4", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41cc83a-c8", "ovs_interfaceid": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Converting VIF {"id": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "address": "fa:16:3e:c5:e8:c4", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41cc83a-c8", "ovs_interfaceid": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:e8:c4,bridge_name='br-int',has_traffic_filtering=True,id=e41cc83a-c8d7-4c86-9d36-816ef12a3599,network=Network(39ddcfc4-035c-49a7-94ae-ba86737c00ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41cc83a-c8') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.objects.instance [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lazy-loading 'pci_devices' on Instance uuid f62bddff-a202-47e7-88b1-d7505eb92731 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:29:12 user nova-compute[75021]:   <uuid>f62bddff-a202-47e7-88b1-d7505eb92731</uuid>
Dec 06 07:29:12 user nova-compute[75021]:   <name>instance-0000002f</name>
Dec 06 07:29:12 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:29:12 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:29:12 user nova-compute[75021]:   <metadata>
Dec 06 07:29:12 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:29:12 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:29:12 user nova-compute[75021]:       <nova:name>tempest-VolumesActionsTest-instance-1533914723</nova:name>
Dec 06 07:29:12 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:29:12</nova:creationTime>
Dec 06 07:29:12 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:29:12 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:29:12 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:29:12 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:29:12 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:29:12 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:29:12 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:29:12 user nova-compute[75021]:       <nova:owner>
Dec 06 07:29:12 user nova-compute[75021]:         <nova:user uuid="f86b8a1612164096bdfb4fa242e95bb1">tempest-VolumesActionsTest-1127490927-project-member</nova:user>
Dec 06 07:29:12 user nova-compute[75021]:         <nova:project uuid="a5ac7f58dce14545bb9b45b3a94309b1">tempest-VolumesActionsTest-1127490927</nova:project>
Dec 06 07:29:12 user nova-compute[75021]:       </nova:owner>
Dec 06 07:29:12 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:29:12 user nova-compute[75021]:       <nova:ports>
Dec 06 07:29:12 user nova-compute[75021]:         <nova:port uuid="e41cc83a-c8d7-4c86-9d36-816ef12a3599">
Dec 06 07:29:12 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 07:29:12 user nova-compute[75021]:         </nova:port>
Dec 06 07:29:12 user nova-compute[75021]:       </nova:ports>
Dec 06 07:29:12 user nova-compute[75021]:     </nova:instance>
Dec 06 07:29:12 user nova-compute[75021]:   </metadata>
Dec 06 07:29:12 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:29:12 user nova-compute[75021]:     <system>
Dec 06 07:29:12 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:29:12 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:29:12 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:29:12 user nova-compute[75021]:       <entry name="serial">f62bddff-a202-47e7-88b1-d7505eb92731</entry>
Dec 06 07:29:12 user nova-compute[75021]:       <entry name="uuid">f62bddff-a202-47e7-88b1-d7505eb92731</entry>
Dec 06 07:29:12 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:29:12 user nova-compute[75021]:     </system>
Dec 06 07:29:12 user nova-compute[75021]:   </sysinfo>
Dec 06 07:29:12 user nova-compute[75021]:   <os>
Dec 06 07:29:12 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:29:12 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:29:12 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:29:12 user nova-compute[75021]:   </os>
Dec 06 07:29:12 user nova-compute[75021]:   <features>
Dec 06 07:29:12 user nova-compute[75021]:     <acpi/>
Dec 06 07:29:12 user nova-compute[75021]:     <apic/>
Dec 06 07:29:12 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:29:12 user nova-compute[75021]:   </features>
Dec 06 07:29:12 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:29:12 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:29:12 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:29:12 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:29:12 user nova-compute[75021]:   </clock>
Dec 06 07:29:12 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:29:12 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:29:12 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:29:12 user nova-compute[75021]:   </cpu>
Dec 06 07:29:12 user nova-compute[75021]:   <devices>
Dec 06 07:29:12 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:29:12 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:29:12 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk"/>
Dec 06 07:29:12 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:29:12 user nova-compute[75021]:     </disk>
Dec 06 07:29:12 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:29:12 user nova-compute[75021]:       <mac address="fa:16:3e:c5:e8:c4"/>
Dec 06 07:29:12 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:29:12 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:29:12 user nova-compute[75021]:       <target dev="tape41cc83a-c8"/>
Dec 06 07:29:12 user nova-compute[75021]:     </interface>
Dec 06 07:29:12 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:29:12 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/console.log" append="off"/>
Dec 06 07:29:12 user nova-compute[75021]:     </serial>
Dec 06 07:29:12 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:29:12 user nova-compute[75021]:     <video>
Dec 06 07:29:12 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:29:12 user nova-compute[75021]:     </video>
Dec 06 07:29:12 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:29:12 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:29:12 user nova-compute[75021]:     </rng>
Dec 06 07:29:12 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:29:12 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:29:12 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:29:12 user nova-compute[75021]:     </memballoon>
Dec 06 07:29:12 user nova-compute[75021]:   </devices>
Dec 06 07:29:12 user nova-compute[75021]: </domain>
Dec 06 07:29:12 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1533914723',display_name='tempest-VolumesActionsTest-instance-1533914723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1533914723',id=47,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5ac7f58dce14545bb9b45b3a94309b1',ramdisk_id='',reservation_id='r-3hema5au',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1127490927',owner_user_name='tempest-VolumesActionsTest-1127490927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:29:11Z,user_data=None,user_id='f86b8a1612164096bdfb4fa242e95bb1',uuid=f62bddff-a202-47e7-88b1-d7505eb92731,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "address": "fa:16:3e:c5:e8:c4", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41cc83a-c8", "ovs_interfaceid": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Converting VIF {"id": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "address": "fa:16:3e:c5:e8:c4", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41cc83a-c8", "ovs_interfaceid": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:e8:c4,bridge_name='br-int',has_traffic_filtering=True,id=e41cc83a-c8d7-4c86-9d36-816ef12a3599,network=Network(39ddcfc4-035c-49a7-94ae-ba86737c00ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41cc83a-c8') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG os_vif [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:e8:c4,bridge_name='br-int',has_traffic_filtering=True,id=e41cc83a-c8d7-4c86-9d36-816ef12a3599,network=Network(39ddcfc4-035c-49a7-94ae-ba86737c00ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41cc83a-c8') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15a01bf5-a45f-5cba-9035-4df3f5be083f', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape41cc83a-c8, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape41cc83a-c8, col_values=(('qos', UUID('dbf608e6-5beb-470d-ac36-4a950bfe1cb9')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape41cc83a-c8, col_values=(('external_ids', {'iface-id': 'e41cc83a-c8d7-4c86-9d36-816ef12a3599', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:e8:c4', 'vm-uuid': 'f62bddff-a202-47e7-88b1-d7505eb92731'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:29:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:12 user nova-compute[75021]: INFO os_vif [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:e8:c4,bridge_name='br-int',has_traffic_filtering=True,id=e41cc83a-c8d7-4c86-9d36-816ef12a3599,network=Network(39ddcfc4-035c-49a7-94ae-ba86737c00ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41cc83a-c8')
Dec 06 07:29:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:29:13 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] No VIF found with MAC fa:16:3e:c5:e8:c4, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:29:13 user nova-compute[75021]: DEBUG nova.network.neutron [req-fd2a8a6e-8956-49ec-9d65-31fdeba80545 req-9aa17308-2780-4bd1-963e-1b20844ab5d1 service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Updated VIF entry in instance network info cache for port e41cc83a-c8d7-4c86-9d36-816ef12a3599. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:29:13 user nova-compute[75021]: DEBUG nova.network.neutron [req-fd2a8a6e-8956-49ec-9d65-31fdeba80545 req-9aa17308-2780-4bd1-963e-1b20844ab5d1 service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Updating instance_info_cache with network_info: [{"id": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "address": "fa:16:3e:c5:e8:c4", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41cc83a-c8", "ovs_interfaceid": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:29:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fd2a8a6e-8956-49ec-9d65-31fdeba80545 req-9aa17308-2780-4bd1-963e-1b20844ab5d1 service nova] Releasing lock "refresh_cache-f62bddff-a202-47e7-88b1-d7505eb92731" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-4b6ed285-2ab2-4ac8-9704-712148dd3d6b req-fc853854-d787-416f-bdb9-53ba2ebffa0e service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Received event network-vif-plugged-e41cc83a-c8d7-4c86-9d36-816ef12a3599 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4b6ed285-2ab2-4ac8-9704-712148dd3d6b req-fc853854-d787-416f-bdb9-53ba2ebffa0e service nova] Acquiring lock "f62bddff-a202-47e7-88b1-d7505eb92731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4b6ed285-2ab2-4ac8-9704-712148dd3d6b req-fc853854-d787-416f-bdb9-53ba2ebffa0e service nova] Lock "f62bddff-a202-47e7-88b1-d7505eb92731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4b6ed285-2ab2-4ac8-9704-712148dd3d6b req-fc853854-d787-416f-bdb9-53ba2ebffa0e service nova] Lock "f62bddff-a202-47e7-88b1-d7505eb92731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-4b6ed285-2ab2-4ac8-9704-712148dd3d6b req-fc853854-d787-416f-bdb9-53ba2ebffa0e service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] No waiting events found dispatching network-vif-plugged-e41cc83a-c8d7-4c86-9d36-816ef12a3599 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:29:14 user nova-compute[75021]: WARNING nova.compute.manager [req-4b6ed285-2ab2-4ac8-9704-712148dd3d6b req-fc853854-d787-416f-bdb9-53ba2ebffa0e service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Received unexpected event network-vif-plugged-e41cc83a-c8d7-4c86-9d36-816ef12a3599 for instance with vm_state building and task_state spawning.
Dec 06 07:29:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-1d057d35-b871-460d-a47b-2136a77e4b4b req-0aef4390-e220-42f2-b8c2-b30bd5208981 service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Received event network-vif-plugged-61fea00a-5787-4441-896a-17321da5e643 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1d057d35-b871-460d-a47b-2136a77e4b4b req-0aef4390-e220-42f2-b8c2-b30bd5208981 service nova] Acquiring lock "527ac697-aab8-423e-8e92-16c702670793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1d057d35-b871-460d-a47b-2136a77e4b4b req-0aef4390-e220-42f2-b8c2-b30bd5208981 service nova] Lock "527ac697-aab8-423e-8e92-16c702670793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1d057d35-b871-460d-a47b-2136a77e4b4b req-0aef4390-e220-42f2-b8c2-b30bd5208981 service nova] Lock "527ac697-aab8-423e-8e92-16c702670793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-1d057d35-b871-460d-a47b-2136a77e4b4b req-0aef4390-e220-42f2-b8c2-b30bd5208981 service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] No waiting events found dispatching network-vif-plugged-61fea00a-5787-4441-896a-17321da5e643 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:29:14 user nova-compute[75021]: WARNING nova.compute.manager [req-1d057d35-b871-460d-a47b-2136a77e4b4b req-0aef4390-e220-42f2-b8c2-b30bd5208981 service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Received unexpected event network-vif-plugged-61fea00a-5787-4441-896a-17321da5e643 for instance with vm_state building and task_state spawning.
Dec 06 07:29:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:29:14 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 527ac697-aab8-423e-8e92-16c702670793] Instance spawned successfully.
Dec 06 07:29:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:29:14 user nova-compute[75021]: INFO nova.compute.manager [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Took 5.36 seconds to spawn the instance on the hypervisor.
Dec 06 07:29:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:14 user nova-compute[75021]: INFO nova.compute.manager [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Took 27.22 seconds to build instance.
Dec 06 07:29:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-6803f25c-06ac-4542-b37c-c877dfb810d9 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "527ac697-aab8-423e-8e92-16c702670793" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.328s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-e0bedc02-1be2-451d-87b5-b74534d38298 req-e3fafe07-3bad-4242-81ea-3a2818f69847 service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Received event network-vif-plugged-e41cc83a-c8d7-4c86-9d36-816ef12a3599 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:29:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e0bedc02-1be2-451d-87b5-b74534d38298 req-e3fafe07-3bad-4242-81ea-3a2818f69847 service nova] Acquiring lock "f62bddff-a202-47e7-88b1-d7505eb92731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e0bedc02-1be2-451d-87b5-b74534d38298 req-e3fafe07-3bad-4242-81ea-3a2818f69847 service nova] Lock "f62bddff-a202-47e7-88b1-d7505eb92731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-e0bedc02-1be2-451d-87b5-b74534d38298 req-e3fafe07-3bad-4242-81ea-3a2818f69847 service nova] Lock "f62bddff-a202-47e7-88b1-d7505eb92731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-e0bedc02-1be2-451d-87b5-b74534d38298 req-e3fafe07-3bad-4242-81ea-3a2818f69847 service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] No waiting events found dispatching network-vif-plugged-e41cc83a-c8d7-4c86-9d36-816ef12a3599 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:29:16 user nova-compute[75021]: WARNING nova.compute.manager [req-e0bedc02-1be2-451d-87b5-b74534d38298 req-e3fafe07-3bad-4242-81ea-3a2818f69847 service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Received unexpected event network-vif-plugged-e41cc83a-c8d7-4c86-9d36-816ef12a3599 for instance with vm_state building and task_state spawning.
Dec 06 07:29:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:29:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:29:16 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Instance spawned successfully.
Dec 06 07:29:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:29:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:29:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:29:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:29:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:29:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:29:16 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:29:16 user nova-compute[75021]: INFO nova.compute.manager [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Took 5.72 seconds to spawn the instance on the hypervisor.
Dec 06 07:29:16 user nova-compute[75021]: DEBUG nova.compute.manager [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:29:16 user nova-compute[75021]: INFO nova.compute.manager [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Took 6.32 seconds to build instance.
Dec 06 07:29:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-de52fc2a-c1e1-48fb-b6d5-31e11c35fa44 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "f62bddff-a202-47e7-88b1-d7505eb92731" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.414s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:19 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:19 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:19 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:29:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.rescue --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:29:21 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:29:21 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:29:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8684MB free_disk=25.11867904663086GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:29:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5a0c7109-a15e-440b-b0f3-785721e55627 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:29:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance be4426d8-f8fa-4c62-bfa6-74944341d938 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:29:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 527ac697-aab8-423e-8e92-16c702670793 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:29:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance f62bddff-a202-47e7-88b1-d7505eb92731 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:29:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:29:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:29:21 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:29:21 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:29:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:29:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:22 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:29:22 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:29:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:29:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:24 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:29:24 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:29:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:29:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-be4426d8-f8fa-4c62-bfa6-74944341d938" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:29:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-be4426d8-f8fa-4c62-bfa6-74944341d938" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:29:24 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:29:24 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Updating instance_info_cache with network_info: [{"id": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "address": "fa:16:3e:ca:09:be", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bba7a6d-ec", "ovs_interfaceid": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:29:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-be4426d8-f8fa-4c62-bfa6-74944341d938" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:29:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:29:24 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:29:25 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:29:25 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:29:27 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:29:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:30 user nova-compute[75021]: INFO nova.compute.manager [None req-925aece3-18a6-4cdd-938f-88c74bfab871 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Unrescuing
Dec 06 07:29:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-925aece3-18a6-4cdd-938f-88c74bfab871 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:29:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-925aece3-18a6-4cdd-938f-88c74bfab871 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquired lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:29:30 user nova-compute[75021]: DEBUG nova.network.neutron [None req-925aece3-18a6-4cdd-938f-88c74bfab871 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG nova.network.neutron [None req-925aece3-18a6-4cdd-938f-88c74bfab871 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updating instance_info_cache with network_info: [{"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-925aece3-18a6-4cdd-938f-88c74bfab871 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Releasing lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG nova.objects.instance [None req-925aece3-18a6-4cdd-938f-88c74bfab871 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lazy-loading 'flavor' on Instance uuid 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-a4893d4a-03fb-442b-b244-ccf06fea491f req-3826faef-8889-4084-8977-7e905014c197 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-vif-unplugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a4893d4a-03fb-442b-b244-ccf06fea491f req-3826faef-8889-4084-8977-7e905014c197 service nova] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a4893d4a-03fb-442b-b244-ccf06fea491f req-3826faef-8889-4084-8977-7e905014c197 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a4893d4a-03fb-442b-b244-ccf06fea491f req-3826faef-8889-4084-8977-7e905014c197 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-a4893d4a-03fb-442b-b244-ccf06fea491f req-3826faef-8889-4084-8977-7e905014c197 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] No waiting events found dispatching network-vif-unplugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:29:31 user nova-compute[75021]: WARNING nova.compute.manager [req-a4893d4a-03fb-442b-b244-ccf06fea491f req-3826faef-8889-4084-8977-7e905014c197 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received unexpected event network-vif-unplugged-f342e747-6e80-462b-8193-7acecbc16a79 for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:29:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-5423e7a4-901a-4611-b8d1-45b5f51c39d7 req-f05c5257-5e99-42c3-ba43-761b5fc9625b service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-changed-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-5423e7a4-901a-4611-b8d1-45b5f51c39d7 req-f05c5257-5e99-42c3-ba43-761b5fc9625b service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Refreshing instance network info cache due to event network-changed-f342e747-6e80-462b-8193-7acecbc16a79. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5423e7a4-901a-4611-b8d1-45b5f51c39d7 req-f05c5257-5e99-42c3-ba43-761b5fc9625b service nova] Acquiring lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5423e7a4-901a-4611-b8d1-45b5f51c39d7 req-f05c5257-5e99-42c3-ba43-761b5fc9625b service nova] Acquired lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:29:31 user nova-compute[75021]: DEBUG nova.network.neutron [req-5423e7a4-901a-4611-b8d1-45b5f51c39d7 req-f05c5257-5e99-42c3-ba43-761b5fc9625b service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Refreshing network info cache for port f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:29:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:32 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Instance destroyed successfully.
Dec 06 07:29:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:32 user nova-compute[75021]: DEBUG nova.network.neutron [req-5423e7a4-901a-4611-b8d1-45b5f51c39d7 req-f05c5257-5e99-42c3-ba43-761b5fc9625b service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updated VIF entry in instance network info cache for port f342e747-6e80-462b-8193-7acecbc16a79. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:29:32 user nova-compute[75021]: DEBUG nova.network.neutron [req-5423e7a4-901a-4611-b8d1-45b5f51c39d7 req-f05c5257-5e99-42c3-ba43-761b5fc9625b service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updating instance_info_cache with network_info: [{"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:29:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5423e7a4-901a-4611-b8d1-45b5f51c39d7 req-f05c5257-5e99-42c3-ba43-761b5fc9625b service nova] Releasing lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:29:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:33 user nova-compute[75021]: DEBUG nova.compute.manager [req-2a1666b9-d0c8-4760-85f3-95bd46bd6e8c req-73317de4-1897-40e3-9033-b28a88b5b7d2 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:29:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2a1666b9-d0c8-4760-85f3-95bd46bd6e8c req-73317de4-1897-40e3-9033-b28a88b5b7d2 service nova] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2a1666b9-d0c8-4760-85f3-95bd46bd6e8c req-73317de4-1897-40e3-9033-b28a88b5b7d2 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2a1666b9-d0c8-4760-85f3-95bd46bd6e8c req-73317de4-1897-40e3-9033-b28a88b5b7d2 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:33 user nova-compute[75021]: DEBUG nova.compute.manager [req-2a1666b9-d0c8-4760-85f3-95bd46bd6e8c req-73317de4-1897-40e3-9033-b28a88b5b7d2 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] No waiting events found dispatching network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:29:33 user nova-compute[75021]: WARNING nova.compute.manager [req-2a1666b9-d0c8-4760-85f3-95bd46bd6e8c req-73317de4-1897-40e3-9033-b28a88b5b7d2 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received unexpected event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:29:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-96ecefe5-1109-4c9d-9697-950f164646de req-fdde8cc8-c06c-48de-b284-ecbf225821dc service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-changed-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:29:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-96ecefe5-1109-4c9d-9697-950f164646de req-fdde8cc8-c06c-48de-b284-ecbf225821dc service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Refreshing instance network info cache due to event network-changed-f342e747-6e80-462b-8193-7acecbc16a79. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:29:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-96ecefe5-1109-4c9d-9697-950f164646de req-fdde8cc8-c06c-48de-b284-ecbf225821dc service nova] Acquiring lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:29:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-96ecefe5-1109-4c9d-9697-950f164646de req-fdde8cc8-c06c-48de-b284-ecbf225821dc service nova] Acquired lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:29:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-96ecefe5-1109-4c9d-9697-950f164646de req-fdde8cc8-c06c-48de-b284-ecbf225821dc service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Refreshing network info cache for port f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:29:34 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:29:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-96ecefe5-1109-4c9d-9697-950f164646de req-fdde8cc8-c06c-48de-b284-ecbf225821dc service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updated VIF entry in instance network info cache for port f342e747-6e80-462b-8193-7acecbc16a79. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:29:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-96ecefe5-1109-4c9d-9697-950f164646de req-fdde8cc8-c06c-48de-b284-ecbf225821dc service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updating instance_info_cache with network_info: [{"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:29:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-96ecefe5-1109-4c9d-9697-950f164646de req-fdde8cc8-c06c-48de-b284-ecbf225821dc service nova] Releasing lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:29:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-0efcb414-cc47-4e5f-9cb8-6434714a41f5 req-582f8a27-a8d6-495a-9b47-5ead467a30c1 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:29:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0efcb414-cc47-4e5f-9cb8-6434714a41f5 req-582f8a27-a8d6-495a-9b47-5ead467a30c1 service nova] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0efcb414-cc47-4e5f-9cb8-6434714a41f5 req-582f8a27-a8d6-495a-9b47-5ead467a30c1 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0efcb414-cc47-4e5f-9cb8-6434714a41f5 req-582f8a27-a8d6-495a-9b47-5ead467a30c1 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-0efcb414-cc47-4e5f-9cb8-6434714a41f5 req-582f8a27-a8d6-495a-9b47-5ead467a30c1 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] No waiting events found dispatching network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:29:35 user nova-compute[75021]: WARNING nova.compute.manager [req-0efcb414-cc47-4e5f-9cb8-6434714a41f5 req-582f8a27-a8d6-495a-9b47-5ead467a30c1 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received unexpected event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:29:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-0efcb414-cc47-4e5f-9cb8-6434714a41f5 req-582f8a27-a8d6-495a-9b47-5ead467a30c1 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:29:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0efcb414-cc47-4e5f-9cb8-6434714a41f5 req-582f8a27-a8d6-495a-9b47-5ead467a30c1 service nova] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0efcb414-cc47-4e5f-9cb8-6434714a41f5 req-582f8a27-a8d6-495a-9b47-5ead467a30c1 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0efcb414-cc47-4e5f-9cb8-6434714a41f5 req-582f8a27-a8d6-495a-9b47-5ead467a30c1 service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-0efcb414-cc47-4e5f-9cb8-6434714a41f5 req-582f8a27-a8d6-495a-9b47-5ead467a30c1 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] No waiting events found dispatching network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:29:35 user nova-compute[75021]: WARNING nova.compute.manager [req-0efcb414-cc47-4e5f-9cb8-6434714a41f5 req-582f8a27-a8d6-495a-9b47-5ead467a30c1 service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received unexpected event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 for instance with vm_state rescued and task_state unrescuing.
Dec 06 07:29:35 user nova-compute[75021]: DEBUG nova.compute.manager [None req-925aece3-18a6-4cdd-938f-88c74bfab871 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:29:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "a3eb22e5-35f4-4744-839d-43ec60924f61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:29:45 user nova-compute[75021]: INFO nova.compute.claims [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Claim successful on node user
Dec 06 07:29:45 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:29:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:29:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG nova.policy [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6279516fe514203950a2d0280e73417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49736ca5cec543bdabc53604c9020f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:29:45 user nova-compute[75021]: INFO nova.virt.block_device [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Booting with volume eaae6975-a767-4a01-9dfd-cac33b122195 at /dev/vda
Dec 06 07:29:45 user nova-compute[75021]: DEBUG os_brick.utils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fb79f9-2339-4a21-ae15-ab1263334a57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0e5673-1316-4b4f-8813-c3bcd5824d05]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c0ecad-a59f-4782-82c2-180f0ad0db3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e04afd8-6843-435d-a7ad-09bc0530605a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:45 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:29:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:29:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:29:46 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:29:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e9623b-5139-4eeb-8072-6833981e0fe0]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:29:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:29:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:29:46 user nova-compute[75021]: DEBUG os_brick.utils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:29:46 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updating existing volume attachment record: e5be7471-079e-4717-970a-f5a61bdf787e {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:29:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:46 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Successfully created port: 111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Successfully updated port: 111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquired lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-9177be53-a2f6-4532-a53b-dde660261e0b req-70f8e68e-56d1-4384-8aeb-4a834e3b112f service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received event network-changed-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG nova.compute.manager [req-9177be53-a2f6-4532-a53b-dde660261e0b req-70f8e68e-56d1-4384-8aeb-4a834e3b112f service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Refreshing instance network info cache due to event network-changed-111f3897-75da-40d3-8f93-16f488ebc186. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9177be53-a2f6-4532-a53b-dde660261e0b req-70f8e68e-56d1-4384-8aeb-4a834e3b112f service nova] Acquiring lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG nova.network.neutron [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updating instance_info_cache with network_info: [{"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Releasing lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Instance network_info: |[{"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9177be53-a2f6-4532-a53b-dde660261e0b req-70f8e68e-56d1-4384-8aeb-4a834e3b112f service nova] Acquired lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG nova.network.neutron [req-9177be53-a2f6-4532-a53b-dde660261e0b req-70f8e68e-56d1-4384-8aeb-4a834e3b112f service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Refreshing network info cache for port 111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG nova.network.neutron [req-9177be53-a2f6-4532-a53b-dde660261e0b req-70f8e68e-56d1-4384-8aeb-4a834e3b112f service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updated VIF entry in instance network info cache for port 111f3897-75da-40d3-8f93-16f488ebc186. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG nova.network.neutron [req-9177be53-a2f6-4532-a53b-dde660261e0b req-70f8e68e-56d1-4384-8aeb-4a834e3b112f service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updating instance_info_cache with network_info: [{"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9177be53-a2f6-4532-a53b-dde660261e0b req-70f8e68e-56d1-4384-8aeb-4a834e3b112f service nova] Releasing lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:29:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:29:59 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Creating image(s)
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Ensure instance console log exists: /opt/stack/data/nova/instances/a3eb22e5-35f4-4744-839d-43ec60924f61/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Start _get_guest_xml network_info=[{"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e5be7471-079e-4717-970a-f5a61bdf787e', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEYJrPBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3eb22e5-35f4-4744-839d-43ec60924f61', 'attached_at': '', 'detached_at': '', 'volume_id': 'eaae6975-a767-4a01-9dfd-cac33b122195', 'serial': 'eaae6975-a767-4a01-9dfd-cac33b122195'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:29:59 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:29:59 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEYJrPBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:29:59 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:29:59 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:29:59 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43ab1f3-75f0-45ce-904d-726e50d8ab4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:29:59 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7461c8c-d069-4ccf-bc05-be9de07deb62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195] added
Dec 06 07:29:59 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[056e0c0e-5808-4db8-976b-a3b965725700]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4ed41a-2456-43cb-ba11-9b164a973fe1]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eEYJrPBM {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eEYJrPBM" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[05367c74-dd03-4009-8828-34e179d27e9a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eEYJrPBM'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa178751-9336-41d5-8921-056d417a1753]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7ace8d-b307-4efd-b8da-23d0c0b0a250]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:29:59 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:29:59 user nova-compute[75021]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac (non-flash)
Dec 06 07:29:59 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:29:59 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:29:59 user nova-compute[75021]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac (non-flash)
Dec 06 07:29:59 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c745e9a-56e7-495a-8d7c-84e0221e0421]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260]
Dec 06 07:29:59 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260] successful.
Dec 06 07:29:59 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f5ba27-46be-473b-8a61-6e5579c0463e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[af13dc07-6f41-4599-a2d0-86f02776bb5f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:29:59 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:29:59 user nova-compute[75021]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac (non-flash)
Dec 06 07:29:59 user nova-compute[75021]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:29:59 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:29:59 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:29:59 user nova-compute[75021]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac (non-flash)
Dec 06 07:29:59 user nova-compute[75021]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:29:59 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c220d405-8ab0-43a8-8f1a-058e498f5abb]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:29:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEYJrPBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23937656333383233', 'path': '/dev/sdd'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937656333383233', 'path': '/dev/sdd'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1240073608',display_name='tempest-TestShelveInstance-server-1240073608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1240073608',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxWWL9DEGMhocr6FZ6ZRC+Kdexb5fj22tvA2GdaTwKeGacHxJCWmeZXYpSmdKbqozYlvixSIpxPkdNk/oynj9aZdPCApw+s9E8GF1Fw0o/gHXsz54DIinIrx/AW8UaWZw==',key_name='tempest-TestShelveInstance-653132316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49736ca5cec543bdabc53604c9020f89',ramdisk_id='',reservation_id='r-c68wuuhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1793737621',owner_user_name='tempest-TestShelveInstance-1793737621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:29:46Z,user_data=None,user_id='f6279516fe514203950a2d0280e73417',uuid=a3eb22e5-35f4-4744-839d-43ec60924f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Converting VIF {"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:11:35,bridge_name='br-int',has_traffic_filtering=True,id=111f3897-75da-40d3-8f93-16f488ebc186,network=Network(8f13b891-c697-40d0-b740-4f0acd72d60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f3897-75') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lazy-loading 'pci_devices' on Instance uuid a3eb22e5-35f4-4744-839d-43ec60924f61 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:30:00 user nova-compute[75021]:   <uuid>a3eb22e5-35f4-4744-839d-43ec60924f61</uuid>
Dec 06 07:30:00 user nova-compute[75021]:   <name>instance-00000030</name>
Dec 06 07:30:00 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:30:00 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:30:00 user nova-compute[75021]:   <metadata>
Dec 06 07:30:00 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:30:00 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:30:00 user nova-compute[75021]:       <nova:name>tempest-TestShelveInstance-server-1240073608</nova:name>
Dec 06 07:30:00 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:29:59</nova:creationTime>
Dec 06 07:30:00 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:30:00 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:30:00 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:30:00 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:30:00 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:30:00 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:30:00 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:30:00 user nova-compute[75021]:       <nova:owner>
Dec 06 07:30:00 user nova-compute[75021]:         <nova:user uuid="f6279516fe514203950a2d0280e73417">tempest-TestShelveInstance-1793737621-project-member</nova:user>
Dec 06 07:30:00 user nova-compute[75021]:         <nova:project uuid="49736ca5cec543bdabc53604c9020f89">tempest-TestShelveInstance-1793737621</nova:project>
Dec 06 07:30:00 user nova-compute[75021]:       </nova:owner>
Dec 06 07:30:00 user nova-compute[75021]:       <nova:ports>
Dec 06 07:30:00 user nova-compute[75021]:         <nova:port uuid="111f3897-75da-40d3-8f93-16f488ebc186">
Dec 06 07:30:00 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 07:30:00 user nova-compute[75021]:         </nova:port>
Dec 06 07:30:00 user nova-compute[75021]:       </nova:ports>
Dec 06 07:30:00 user nova-compute[75021]:     </nova:instance>
Dec 06 07:30:00 user nova-compute[75021]:   </metadata>
Dec 06 07:30:00 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:30:00 user nova-compute[75021]:     <system>
Dec 06 07:30:00 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:30:00 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:30:00 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:30:00 user nova-compute[75021]:       <entry name="serial">a3eb22e5-35f4-4744-839d-43ec60924f61</entry>
Dec 06 07:30:00 user nova-compute[75021]:       <entry name="uuid">a3eb22e5-35f4-4744-839d-43ec60924f61</entry>
Dec 06 07:30:00 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:30:00 user nova-compute[75021]:     </system>
Dec 06 07:30:00 user nova-compute[75021]:   </sysinfo>
Dec 06 07:30:00 user nova-compute[75021]:   <os>
Dec 06 07:30:00 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:30:00 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:30:00 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:30:00 user nova-compute[75021]:   </os>
Dec 06 07:30:00 user nova-compute[75021]:   <features>
Dec 06 07:30:00 user nova-compute[75021]:     <acpi/>
Dec 06 07:30:00 user nova-compute[75021]:     <apic/>
Dec 06 07:30:00 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:30:00 user nova-compute[75021]:   </features>
Dec 06 07:30:00 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:30:00 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:30:00 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:30:00 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:30:00 user nova-compute[75021]:   </clock>
Dec 06 07:30:00 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:30:00 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:30:00 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:30:00 user nova-compute[75021]:   </cpu>
Dec 06 07:30:00 user nova-compute[75021]:   <devices>
Dec 06 07:30:00 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:30:00 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:30:00 user nova-compute[75021]:       <source dev="/dev/sdd"/>
Dec 06 07:30:00 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:30:00 user nova-compute[75021]:       <serial>eaae6975-a767-4a01-9dfd-cac33b122195</serial>
Dec 06 07:30:00 user nova-compute[75021]:     </disk>
Dec 06 07:30:00 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:30:00 user nova-compute[75021]:       <mac address="fa:16:3e:03:11:35"/>
Dec 06 07:30:00 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:30:00 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:30:00 user nova-compute[75021]:       <target dev="tap111f3897-75"/>
Dec 06 07:30:00 user nova-compute[75021]:     </interface>
Dec 06 07:30:00 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:30:00 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/a3eb22e5-35f4-4744-839d-43ec60924f61/console.log" append="off"/>
Dec 06 07:30:00 user nova-compute[75021]:     </serial>
Dec 06 07:30:00 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:30:00 user nova-compute[75021]:     <video>
Dec 06 07:30:00 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:30:00 user nova-compute[75021]:     </video>
Dec 06 07:30:00 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:30:00 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:30:00 user nova-compute[75021]:     </rng>
Dec 06 07:30:00 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:30:00 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:30:00 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:30:00 user nova-compute[75021]:     </memballoon>
Dec 06 07:30:00 user nova-compute[75021]:   </devices>
Dec 06 07:30:00 user nova-compute[75021]: </domain>
Dec 06 07:30:00 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1240073608',display_name='tempest-TestShelveInstance-server-1240073608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1240073608',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxWWL9DEGMhocr6FZ6ZRC+Kdexb5fj22tvA2GdaTwKeGacHxJCWmeZXYpSmdKbqozYlvixSIpxPkdNk/oynj9aZdPCApw+s9E8GF1Fw0o/gHXsz54DIinIrx/AW8UaWZw==',key_name='tempest-TestShelveInstance-653132316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49736ca5cec543bdabc53604c9020f89',ramdisk_id='',reservation_id='r-c68wuuhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1793737621',owner_user_name='tempest-TestShelveInstance-1793737621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:29:46Z,user_data=None,user_id='f6279516fe514203950a2d0280e73417',uuid=a3eb22e5-35f4-4744-839d-43ec60924f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Converting VIF {"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:11:35,bridge_name='br-int',has_traffic_filtering=True,id=111f3897-75da-40d3-8f93-16f488ebc186,network=Network(8f13b891-c697-40d0-b740-4f0acd72d60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f3897-75') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG os_vif [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:11:35,bridge_name='br-int',has_traffic_filtering=True,id=111f3897-75da-40d3-8f93-16f488ebc186,network=Network(8f13b891-c697-40d0-b740-4f0acd72d60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f3897-75') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82c8361e-6071-57a9-b13a-9984f4a12f1a', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap111f3897-75, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap111f3897-75, col_values=(('qos', UUID('f3bc9b80-aa70-4655-9dce-2a3e32a02daa')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap111f3897-75, col_values=(('external_ids', {'iface-id': '111f3897-75da-40d3-8f93-16f488ebc186', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:11:35', 'vm-uuid': 'a3eb22e5-35f4-4744-839d-43ec60924f61'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:00 user nova-compute[75021]: INFO os_vif [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:11:35,bridge_name='br-int',has_traffic_filtering=True,id=111f3897-75da-40d3-8f93-16f488ebc186,network=Network(8f13b891-c697-40d0-b740-4f0acd72d60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f3897-75')
Dec 06 07:30:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:30:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] No VIF found with MAC fa:16:3e:03:11:35, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:30:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-fbf955fa-1339-4703-beba-9c6c6941a99d req-b357f1bc-6a51-4d67-8960-e9f715626ef4 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received event network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:30:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fbf955fa-1339-4703-beba-9c6c6941a99d req-b357f1bc-6a51-4d67-8960-e9f715626ef4 service nova] Acquiring lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:30:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fbf955fa-1339-4703-beba-9c6c6941a99d req-b357f1bc-6a51-4d67-8960-e9f715626ef4 service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:30:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-fbf955fa-1339-4703-beba-9c6c6941a99d req-b357f1bc-6a51-4d67-8960-e9f715626ef4 service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:02 user nova-compute[75021]: DEBUG nova.compute.manager [req-fbf955fa-1339-4703-beba-9c6c6941a99d req-b357f1bc-6a51-4d67-8960-e9f715626ef4 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] No waiting events found dispatching network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:30:02 user nova-compute[75021]: WARNING nova.compute.manager [req-fbf955fa-1339-4703-beba-9c6c6941a99d req-b357f1bc-6a51-4d67-8960-e9f715626ef4 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received unexpected event network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 for instance with vm_state building and task_state spawning.
Dec 06 07:30:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:30:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "5a0c7109-a15e-440b-b0f3-785721e55627" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:30:03 user nova-compute[75021]: INFO nova.compute.manager [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Detaching volume 4cf89dc4-c18e-4313-a159-d451f051c7e7
Dec 06 07:30:03 user nova-compute[75021]: INFO nova.virt.block_device [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Attempting to driver detach volume 4cf89dc4-c18e-4313-a159-d451f051c7e7 from mountpoint /dev/vdb
Dec 06 07:30:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Attempting to detach device vdb from instance 5a0c7109-a15e-440b-b0f3-785721e55627 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:30:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:30:03 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:30:03 user nova-compute[75021]:   <source dev="/dev/sde"/>
Dec 06 07:30:03 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:30:03 user nova-compute[75021]:   <serial>4cf89dc4-c18e-4313-a159-d451f051c7e7</serial>
Dec 06 07:30:03 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:30:03 user nova-compute[75021]: </disk>
Dec 06 07:30:03 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:30:03 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Successfully detached device vdb from instance 5a0c7109-a15e-440b-b0f3-785721e55627 from the persistent domain config.
Dec 06 07:30:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5a0c7109-a15e-440b-b0f3-785721e55627 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:30:03 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:30:03 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:30:03 user nova-compute[75021]:   <source dev="/dev/sde"/>
Dec 06 07:30:03 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:30:03 user nova-compute[75021]:   <serial>4cf89dc4-c18e-4313-a159-d451f051c7e7</serial>
Dec 06 07:30:03 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:30:03 user nova-compute[75021]: </disk>
Dec 06 07:30:03 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:30:04 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:30:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:30:04 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Instance spawned successfully.
Dec 06 07:30:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:30:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:30:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:30:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:30:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:30:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:30:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:30:04 user nova-compute[75021]: INFO nova.compute.manager [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Took 4.85 seconds to spawn the instance on the hypervisor.
Dec 06 07:30:04 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:30:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4a33d4d-96f5-4f81-947f-978419c21b18 req-2764f5cb-18ab-4a28-9ec3-ce4c4c880e5a service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received event network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4a33d4d-96f5-4f81-947f-978419c21b18 req-2764f5cb-18ab-4a28-9ec3-ce4c4c880e5a service nova] Acquiring lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4a33d4d-96f5-4f81-947f-978419c21b18 req-2764f5cb-18ab-4a28-9ec3-ce4c4c880e5a service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4a33d4d-96f5-4f81-947f-978419c21b18 req-2764f5cb-18ab-4a28-9ec3-ce4c4c880e5a service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:04 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4a33d4d-96f5-4f81-947f-978419c21b18 req-2764f5cb-18ab-4a28-9ec3-ce4c4c880e5a service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] No waiting events found dispatching network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:30:04 user nova-compute[75021]: WARNING nova.compute.manager [req-d4a33d4d-96f5-4f81-947f-978419c21b18 req-2764f5cb-18ab-4a28-9ec3-ce4c4c880e5a service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received unexpected event network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 for instance with vm_state active and task_state None.
Dec 06 07:30:04 user nova-compute[75021]: INFO nova.compute.manager [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Took 18.82 seconds to build instance.
Dec 06 07:30:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d9271312-b235-4632-811e-30e497a8d3a5 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.913s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:30:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:30:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:30:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:30:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:30:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:16 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:30:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:20 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:30:20 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:30:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:30:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:30:20 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:20 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:30:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:20 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:30:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:20 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:30:21 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:30:21 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:30:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8261MB free_disk=25.080310821533203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5a0c7109-a15e-440b-b0f3-785721e55627 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance be4426d8-f8fa-4c62-bfa6-74944341d938 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 527ac697-aab8-423e-8e92-16c702670793 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance f62bddff-a202-47e7-88b1-d7505eb92731 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a3eb22e5-35f4-4744-839d-43ec60924f61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:30:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:22 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:30:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:30:24 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5a0c7109-a15e-440b-b0f3-785721e55627 is timed out.
Dec 06 07:30:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:24 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Successfully detached device vdb from instance 5a0c7109-a15e-440b-b0f3-785721e55627 from the live domain config.
Dec 06 07:30:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsGLqfWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:30:24 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2547c30f-6270-4472-ab68-36880a19d3e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:30:24 user nova-compute[75021]: No targets found.
Dec 06 07:30:24 user nova-compute[75021]: iSNS:
Dec 06 07:30:24 user nova-compute[75021]: No targets found.
Dec 06 07:30:24 user nova-compute[75021]: STATIC:
Dec 06 07:30:24 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195
Dec 06 07:30:24 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:30:24 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:30:24 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac
Dec 06 07:30:24 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:30:24 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:30:24 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7
Dec 06 07:30:24 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:30:24 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:30:24 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703
Dec 06 07:30:24 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:30:24 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:30:24 user nova-compute[75021]: FIRMWARE:
Dec 06 07:30:24 user nova-compute[75021]: No targets found.
Dec 06 07:30:24 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:30:24 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:30:24 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c645bd6-b508-4be4-a7ad-7754d8ffbd2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97321d9-444e-4b8b-9ae9-d1ade64b499d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:30:24 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:30:24 user nova-compute[75021]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac (non-flash)
Dec 06 07:30:24 user nova-compute[75021]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:30:24 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:30:24 user nova-compute[75021]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 (non-flash)
Dec 06 07:30:24 user nova-compute[75021]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac (non-flash)
Dec 06 07:30:24 user nova-compute[75021]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:30:24 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b47cc3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7'): ({'sde'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Removing single pathed devices sde {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[940b5ee0-1643-49df-9ef7-f2daabd287a3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f354fb2-aa38-4cc0-a8db-946167a13634]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Flushing IO for device /dev/sde {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdf718d-98c6-4fba-94a6-1f7b03f8b724]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd11a16e-a8af-45c4-aa10-7a3daf35d0ce]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] SCSI volumes sde have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba08d752-8422-4660-a002-e8f056264766]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bb3aa5-c07d-41e4-8bce-7a28ebe35d02]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7, portal: 172.16.0.220,3260]
Dec 06 07:30:24 user nova-compute[75021]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7, portal: 172.16.0.220,3260] successful.
Dec 06 07:30:24 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf89dc4-c18e-4313-a159-d451f051c7e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88d2d43-d84c-421d-9f19-aee214900a45]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] <== disconnect_volume: return (337ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updating instance_info_cache with network_info: [{"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-5a0c7109-a15e-440b-b0f3-785721e55627" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:30:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:30:25 user nova-compute[75021]: DEBUG nova.objects.instance [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lazy-loading 'flavor' on Instance uuid 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:30:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-379aa0b4-b722-457c-af8b-e12061900620 tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "5a0c7109-a15e-440b-b0f3-785721e55627" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.739s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:26 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:30:26 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:30:27 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:30:27 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:30:28 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:30:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-bff6364b-099e-4374-beac-5cca744fb96a req-c81d30fe-396f-41ab-8887-467c17619a50 service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Received event network-changed-61fea00a-5787-4441-896a-17321da5e643 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:30:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-bff6364b-099e-4374-beac-5cca744fb96a req-c81d30fe-396f-41ab-8887-467c17619a50 service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Refreshing instance network info cache due to event network-changed-61fea00a-5787-4441-896a-17321da5e643. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:30:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bff6364b-099e-4374-beac-5cca744fb96a req-c81d30fe-396f-41ab-8887-467c17619a50 service nova] Acquiring lock "refresh_cache-527ac697-aab8-423e-8e92-16c702670793" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:30:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bff6364b-099e-4374-beac-5cca744fb96a req-c81d30fe-396f-41ab-8887-467c17619a50 service nova] Acquired lock "refresh_cache-527ac697-aab8-423e-8e92-16c702670793" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:30:38 user nova-compute[75021]: DEBUG nova.network.neutron [req-bff6364b-099e-4374-beac-5cca744fb96a req-c81d30fe-396f-41ab-8887-467c17619a50 service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Refreshing network info cache for port 61fea00a-5787-4441-896a-17321da5e643 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG nova.network.neutron [req-bff6364b-099e-4374-beac-5cca744fb96a req-c81d30fe-396f-41ab-8887-467c17619a50 service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Updated VIF entry in instance network info cache for port 61fea00a-5787-4441-896a-17321da5e643. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG nova.network.neutron [req-bff6364b-099e-4374-beac-5cca744fb96a req-c81d30fe-396f-41ab-8887-467c17619a50 service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Updating instance_info_cache with network_info: [{"id": "61fea00a-5787-4441-896a-17321da5e643", "address": "fa:16:3e:09:15:40", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fea00a-57", "ovs_interfaceid": "61fea00a-5787-4441-896a-17321da5e643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-bff6364b-099e-4374-beac-5cca744fb96a req-c81d30fe-396f-41ab-8887-467c17619a50 service nova] Releasing lock "refresh_cache-527ac697-aab8-423e-8e92-16c702670793" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "527ac697-aab8-423e-8e92-16c702670793" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "527ac697-aab8-423e-8e92-16c702670793" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "527ac697-aab8-423e-8e92-16c702670793-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "527ac697-aab8-423e-8e92-16c702670793-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "527ac697-aab8-423e-8e92-16c702670793-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:39 user nova-compute[75021]: INFO nova.compute.manager [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Terminating instance
Dec 06 07:30:39 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75021) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-a5841852-4cc0-4c8c-a198-409d4b28f434 req-d8dee7c8-459d-4615-9226-2d9290460aee service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Received event network-vif-unplugged-61fea00a-5787-4441-896a-17321da5e643 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a5841852-4cc0-4c8c-a198-409d4b28f434 req-d8dee7c8-459d-4615-9226-2d9290460aee service nova] Acquiring lock "527ac697-aab8-423e-8e92-16c702670793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a5841852-4cc0-4c8c-a198-409d4b28f434 req-d8dee7c8-459d-4615-9226-2d9290460aee service nova] Lock "527ac697-aab8-423e-8e92-16c702670793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a5841852-4cc0-4c8c-a198-409d4b28f434 req-d8dee7c8-459d-4615-9226-2d9290460aee service nova] Lock "527ac697-aab8-423e-8e92-16c702670793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-a5841852-4cc0-4c8c-a198-409d4b28f434 req-d8dee7c8-459d-4615-9226-2d9290460aee service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] No waiting events found dispatching network-vif-unplugged-61fea00a-5787-4441-896a-17321da5e643 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-a5841852-4cc0-4c8c-a198-409d4b28f434 req-d8dee7c8-459d-4615-9226-2d9290460aee service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Received event network-vif-unplugged-61fea00a-5787-4441-896a-17321da5e643 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 527ac697-aab8-423e-8e92-16c702670793] Instance destroyed successfully.
Dec 06 07:30:39 user nova-compute[75021]: DEBUG nova.objects.instance [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lazy-loading 'resources' on Instance uuid 527ac697-aab8-423e-8e92-16c702670793 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1154956034',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1154956034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1154956034',id=46,image_ref='dbf71722-12ca-4330-a521-a6f877152f07',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMEVzWruYyyumq/m30nZGfE8lBn+peIh8M86Qiw/0ulFYqmRElQzi7St8aK8BETCK1M6cn83ts4v2bXLuRuo8edtRmLLwiTdvIkynD/M19goTKBmju8U5Q98Em7sXuVsA==',key_name='tempest-keypair-1281158074',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:29:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-ymp62iun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1013845055',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:29:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=527ac697-aab8-423e-8e92-16c702670793,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61fea00a-5787-4441-896a-17321da5e643", "address": "fa:16:3e:09:15:40", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fea00a-57", "ovs_interfaceid": "61fea00a-5787-4441-896a-17321da5e643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "61fea00a-5787-4441-896a-17321da5e643", "address": "fa:16:3e:09:15:40", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fea00a-57", "ovs_interfaceid": "61fea00a-5787-4441-896a-17321da5e643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:15:40,bridge_name='br-int',has_traffic_filtering=True,id=61fea00a-5787-4441-896a-17321da5e643,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61fea00a-57') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG os_vif [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:15:40,bridge_name='br-int',has_traffic_filtering=True,id=61fea00a-5787-4441-896a-17321da5e643,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61fea00a-57') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61fea00a-57, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa97b0cf-5c22-439f-aaf1-c82db03d10fb) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:39 user nova-compute[75021]: INFO os_vif [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:15:40,bridge_name='br-int',has_traffic_filtering=True,id=61fea00a-5787-4441-896a-17321da5e643,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61fea00a-57')
Dec 06 07:30:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRZHdjQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:30:39 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:30:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9083490-3289-46f7-95f7-2207bbaa5b48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:30:39 user nova-compute[75021]: No targets found.
Dec 06 07:30:39 user nova-compute[75021]: iSNS:
Dec 06 07:30:39 user nova-compute[75021]: No targets found.
Dec 06 07:30:39 user nova-compute[75021]: STATIC:
Dec 06 07:30:39 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195
Dec 06 07:30:39 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:30:39 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:30:39 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac
Dec 06 07:30:39 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:30:39 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:30:39 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703
Dec 06 07:30:39 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:30:39 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:30:39 user nova-compute[75021]: FIRMWARE:
Dec 06 07:30:39 user nova-compute[75021]: No targets found.
Dec 06 07:30:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:30:39 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:30:39 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd5e5b2-ef33-4dfd-8558-06b3289a48a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e98dc1-222c-495d-8b87-1dd546a94593]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:30:39 user nova-compute[75021]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac (non-flash)
Dec 06 07:30:39 user nova-compute[75021]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:30:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:30:39 user nova-compute[75021]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac (non-flash)
Dec 06 07:30:39 user nova-compute[75021]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:30:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b4765630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae7056c-28ae-48c7-88d1-c89279e0001e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86bcdc2-ec85-4e94-8d86-435304fd9dc9]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d647e86c-5a0c-4357-8849-6ff7e523a5ea]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.095s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[62df2232-fa70-42d8-918b-75651d4d9830]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6804326b-20f4-4da5-9cd4-4512ce1504e9]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c77b81-c7a8-47f8-81d3-d9009154e8cb]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac, portal: 172.16.0.220,3260]
Dec 06 07:30:40 user nova-compute[75021]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac, portal: 172.16.0.220,3260] successful.
Dec 06 07:30:40 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43091b3b-2901-4f71-899a-da5be44250ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec4a6be-cc9f-4d47-ba0c-113f20e0e6ea]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== disconnect_volume: return (370ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:30:40 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Deleting instance files /opt/stack/data/nova/instances/527ac697-aab8-423e-8e92-16c702670793_del
Dec 06 07:30:40 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Deletion of /opt/stack/data/nova/instances/527ac697-aab8-423e-8e92-16c702670793_del complete
Dec 06 07:30:40 user nova-compute[75021]: INFO nova.compute.manager [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Took 1.21 seconds to destroy the instance on the hypervisor.
Dec 06 07:30:40 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 527ac697-aab8-423e-8e92-16c702670793] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 527ac697-aab8-423e-8e92-16c702670793] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 527ac697-aab8-423e-8e92-16c702670793] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:30:40 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 527ac697-aab8-423e-8e92-16c702670793] Took 0.60 seconds to deallocate network for instance.
Dec 06 07:30:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-6d8f8104-d92d-4adc-befa-cdde4bbc970f req-27fb9cb8-ddf4-4b58-aafc-715044e5b06d service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Received event network-vif-deleted-61fea00a-5787-4441-896a-17321da5e643 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:30:40 user nova-compute[75021]: INFO nova.compute.manager [req-6d8f8104-d92d-4adc-befa-cdde4bbc970f req-27fb9cb8-ddf4-4b58-aafc-715044e5b06d service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Neutron deleted interface 61fea00a-5787-4441-896a-17321da5e643; detaching it from the instance and deleting it from the info cache
Dec 06 07:30:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-6d8f8104-d92d-4adc-befa-cdde4bbc970f req-27fb9cb8-ddf4-4b58-aafc-715044e5b06d service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:30:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-6d8f8104-d92d-4adc-befa-cdde4bbc970f req-27fb9cb8-ddf4-4b58-aafc-715044e5b06d service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Detach interface failed, port_id=61fea00a-5787-4441-896a-17321da5e643, reason: Instance 527ac697-aab8-423e-8e92-16c702670793 could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 07:30:41 user nova-compute[75021]: DEBUG nova.compute.manager [req-52f81f36-1711-440c-9831-5f531d1bed99 req-37714dd3-769a-44dd-8274-1e7cef58acad service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Received event network-vif-plugged-61fea00a-5787-4441-896a-17321da5e643 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:30:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-52f81f36-1711-440c-9831-5f531d1bed99 req-37714dd3-769a-44dd-8274-1e7cef58acad service nova] Acquiring lock "527ac697-aab8-423e-8e92-16c702670793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:30:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-52f81f36-1711-440c-9831-5f531d1bed99 req-37714dd3-769a-44dd-8274-1e7cef58acad service nova] Lock "527ac697-aab8-423e-8e92-16c702670793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:30:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-52f81f36-1711-440c-9831-5f531d1bed99 req-37714dd3-769a-44dd-8274-1e7cef58acad service nova] Lock "527ac697-aab8-423e-8e92-16c702670793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:41 user nova-compute[75021]: DEBUG nova.compute.manager [req-52f81f36-1711-440c-9831-5f531d1bed99 req-37714dd3-769a-44dd-8274-1e7cef58acad service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] No waiting events found dispatching network-vif-plugged-61fea00a-5787-4441-896a-17321da5e643 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:30:41 user nova-compute[75021]: WARNING nova.compute.manager [req-52f81f36-1711-440c-9831-5f531d1bed99 req-37714dd3-769a-44dd-8274-1e7cef58acad service nova] [instance: 527ac697-aab8-423e-8e92-16c702670793] Received unexpected event network-vif-plugged-61fea00a-5787-4441-896a-17321da5e643 for instance with vm_state active and task_state deleting.
Dec 06 07:30:41 user nova-compute[75021]: INFO nova.compute.manager [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Took 0.79 seconds to detach 1 volumes for instance.
Dec 06 07:30:41 user nova-compute[75021]: DEBUG nova.compute.manager [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 527ac697-aab8-423e-8e92-16c702670793] Deleting volume: 43091b3b-2901-4f71-899a-da5be44250ac {{(pid=75021) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 07:30:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:30:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:30:41 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:30:41 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:42 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Deleted allocations for instance 527ac697-aab8-423e-8e92-16c702670793
Dec 06 07:30:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-ca483cce-4ccb-4d67-afa2-6906d4479048 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "527ac697-aab8-423e-8e92-16c702670793" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.057s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] There are 0 instances to clean {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "5a0c7109-a15e-440b-b0f3-785721e55627" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:54 user nova-compute[75021]: INFO nova.compute.manager [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Terminating instance
Dec 06 07:30:54 user nova-compute[75021]: DEBUG nova.compute.manager [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-0f76bbfa-faaf-457c-84b8-3f2dcff9e3bb req-435daa38-9a92-4490-aca6-5f094d6e9a1b service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-vif-unplugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0f76bbfa-faaf-457c-84b8-3f2dcff9e3bb req-435daa38-9a92-4490-aca6-5f094d6e9a1b service nova] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0f76bbfa-faaf-457c-84b8-3f2dcff9e3bb req-435daa38-9a92-4490-aca6-5f094d6e9a1b service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-0f76bbfa-faaf-457c-84b8-3f2dcff9e3bb req-435daa38-9a92-4490-aca6-5f094d6e9a1b service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-0f76bbfa-faaf-457c-84b8-3f2dcff9e3bb req-435daa38-9a92-4490-aca6-5f094d6e9a1b service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] No waiting events found dispatching network-vif-unplugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG nova.compute.manager [req-0f76bbfa-faaf-457c-84b8-3f2dcff9e3bb req-435daa38-9a92-4490-aca6-5f094d6e9a1b service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-vif-unplugged-f342e747-6e80-462b-8193-7acecbc16a79 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:30:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:55 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Instance destroyed successfully.
Dec 06 07:30:55 user nova-compute[75021]: DEBUG nova.objects.instance [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lazy-loading 'resources' on Instance uuid 5a0c7109-a15e-440b-b0f3-785721e55627 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:30:55 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1422117388',display_name='tempest-ServerStableDeviceRescueTest-server-1422117388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1422117388',id=42,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTyp1mNeRSFaOYhXh+upqAV91SqE5x6NiN1WeH04nh4B1+8t2m3RL1LSWF5730zfUczB8J0EeJcJ9Iizt0jKnjrFxRButr7rRwhlV+HlM+0niNeMPoFEDoamYa8Sf2mYw==',key_name='tempest-keypair-91380679',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:27:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df6f441403694bda9f8cfcfd2072d41d',ramdisk_id='',reservation_id='r-395d200m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2041652180',owner_user_name='tempest-ServerStableDeviceRescueTest-2041652180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:29:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa0d7066c737488faa4d0465e7046be4',uuid=5a0c7109-a15e-440b-b0f3-785721e55627,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:30:55 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Converting VIF {"id": "f342e747-6e80-462b-8193-7acecbc16a79", "address": "fa:16:3e:59:be:5b", "network": {"id": "2baad0e4-f46e-44a8-9967-4191ab3dab95", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1587586423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6f441403694bda9f8cfcfd2072d41d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf342e747-6e", "ovs_interfaceid": "f342e747-6e80-462b-8193-7acecbc16a79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:30:55 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:be:5b,bridge_name='br-int',has_traffic_filtering=True,id=f342e747-6e80-462b-8193-7acecbc16a79,network=Network(2baad0e4-f46e-44a8-9967-4191ab3dab95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf342e747-6e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:30:55 user nova-compute[75021]: DEBUG os_vif [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:be:5b,bridge_name='br-int',has_traffic_filtering=True,id=f342e747-6e80-462b-8193-7acecbc16a79,network=Network(2baad0e4-f46e-44a8-9967-4191ab3dab95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf342e747-6e') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:30:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf342e747-6e, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:30:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:30:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68f19dda-9bd0-435e-9920-1a91ca047376) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:30:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:30:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:30:55 user nova-compute[75021]: INFO os_vif [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:be:5b,bridge_name='br-int',has_traffic_filtering=True,id=f342e747-6e80-462b-8193-7acecbc16a79,network=Network(2baad0e4-f46e-44a8-9967-4191ab3dab95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf342e747-6e')
Dec 06 07:30:55 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Deleting instance files /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627_del
Dec 06 07:30:55 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Deletion of /opt/stack/data/nova/instances/5a0c7109-a15e-440b-b0f3-785721e55627_del complete
Dec 06 07:30:55 user nova-compute[75021]: INFO nova.compute.manager [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Took 0.83 seconds to destroy the instance on the hypervisor.
Dec 06 07:30:55 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:30:55 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:30:55 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:30:56 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:30:56 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Took 0.78 seconds to deallocate network for instance.
Dec 06 07:30:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:30:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:30:56 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:30:56 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:30:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:56 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Deleted allocations for instance 5a0c7109-a15e-440b-b0f3-785721e55627
Dec 06 07:30:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-d6ffd0f4-d345-4b43-b1a5-430093ef3c5a tempest-ServerStableDeviceRescueTest-2041652180 tempest-ServerStableDeviceRescueTest-2041652180-project-member] Lock "5a0c7109-a15e-440b-b0f3-785721e55627" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.959s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:56 user nova-compute[75021]: DEBUG nova.compute.manager [req-f5ac9cc2-5e48-408b-b215-aa61eceedda3 req-731f6868-4f55-4e2c-a2ea-f10d1c79f09d service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:30:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f5ac9cc2-5e48-408b-b215-aa61eceedda3 req-731f6868-4f55-4e2c-a2ea-f10d1c79f09d service nova] Acquiring lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:30:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f5ac9cc2-5e48-408b-b215-aa61eceedda3 req-731f6868-4f55-4e2c-a2ea-f10d1c79f09d service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:30:56 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-f5ac9cc2-5e48-408b-b215-aa61eceedda3 req-731f6868-4f55-4e2c-a2ea-f10d1c79f09d service nova] Lock "5a0c7109-a15e-440b-b0f3-785721e55627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:30:56 user nova-compute[75021]: DEBUG nova.compute.manager [req-f5ac9cc2-5e48-408b-b215-aa61eceedda3 req-731f6868-4f55-4e2c-a2ea-f10d1c79f09d service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] No waiting events found dispatching network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:30:56 user nova-compute[75021]: WARNING nova.compute.manager [req-f5ac9cc2-5e48-408b-b215-aa61eceedda3 req-731f6868-4f55-4e2c-a2ea-f10d1c79f09d service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received unexpected event network-vif-plugged-f342e747-6e80-462b-8193-7acecbc16a79 for instance with vm_state deleted and task_state None.
Dec 06 07:30:56 user nova-compute[75021]: DEBUG nova.compute.manager [req-f5ac9cc2-5e48-408b-b215-aa61eceedda3 req-731f6868-4f55-4e2c-a2ea-f10d1c79f09d service nova] [instance: 5a0c7109-a15e-440b-b0f3-785721e55627] Received event network-vif-deleted-f342e747-6e80-462b-8193-7acecbc16a79 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:31:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "f62bddff-a202-47e7-88b1-d7505eb92731" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "f62bddff-a202-47e7-88b1-d7505eb92731" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "f62bddff-a202-47e7-88b1-d7505eb92731-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "f62bddff-a202-47e7-88b1-d7505eb92731-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:00 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "f62bddff-a202-47e7-88b1-d7505eb92731-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:00 user nova-compute[75021]: INFO nova.compute.manager [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Terminating instance
Dec 06 07:31:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:31:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-aea00849-fc97-4348-8c93-dd167ad2b63e req-a56c34f7-1166-4f9d-91ef-71911adfe98f service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Received event network-vif-unplugged-e41cc83a-c8d7-4c86-9d36-816ef12a3599 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-aea00849-fc97-4348-8c93-dd167ad2b63e req-a56c34f7-1166-4f9d-91ef-71911adfe98f service nova] Acquiring lock "f62bddff-a202-47e7-88b1-d7505eb92731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-aea00849-fc97-4348-8c93-dd167ad2b63e req-a56c34f7-1166-4f9d-91ef-71911adfe98f service nova] Lock "f62bddff-a202-47e7-88b1-d7505eb92731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-aea00849-fc97-4348-8c93-dd167ad2b63e req-a56c34f7-1166-4f9d-91ef-71911adfe98f service nova] Lock "f62bddff-a202-47e7-88b1-d7505eb92731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-aea00849-fc97-4348-8c93-dd167ad2b63e req-a56c34f7-1166-4f9d-91ef-71911adfe98f service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] No waiting events found dispatching network-vif-unplugged-e41cc83a-c8d7-4c86-9d36-816ef12a3599 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG nova.compute.manager [req-aea00849-fc97-4348-8c93-dd167ad2b63e req-a56c34f7-1166-4f9d-91ef-71911adfe98f service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Received event network-vif-unplugged-e41cc83a-c8d7-4c86-9d36-816ef12a3599 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:31:01 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Instance destroyed successfully.
Dec 06 07:31:01 user nova-compute[75021]: DEBUG nova.objects.instance [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lazy-loading 'resources' on Instance uuid f62bddff-a202-47e7-88b1-d7505eb92731 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:29:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1533914723',display_name='tempest-VolumesActionsTest-instance-1533914723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1533914723',id=47,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:29:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5ac7f58dce14545bb9b45b3a94309b1',ramdisk_id='',reservation_id='r-3hema5au',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1127490927',owner_user_name='tempest-VolumesActionsTest-1127490927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:29:17Z,user_data=None,user_id='f86b8a1612164096bdfb4fa242e95bb1',uuid=f62bddff-a202-47e7-88b1-d7505eb92731,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "address": "fa:16:3e:c5:e8:c4", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41cc83a-c8", "ovs_interfaceid": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Converting VIF {"id": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "address": "fa:16:3e:c5:e8:c4", "network": {"id": "39ddcfc4-035c-49a7-94ae-ba86737c00ba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-166274784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5ac7f58dce14545bb9b45b3a94309b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41cc83a-c8", "ovs_interfaceid": "e41cc83a-c8d7-4c86-9d36-816ef12a3599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:e8:c4,bridge_name='br-int',has_traffic_filtering=True,id=e41cc83a-c8d7-4c86-9d36-816ef12a3599,network=Network(39ddcfc4-035c-49a7-94ae-ba86737c00ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41cc83a-c8') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG os_vif [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:e8:c4,bridge_name='br-int',has_traffic_filtering=True,id=e41cc83a-c8d7-4c86-9d36-816ef12a3599,network=Network(39ddcfc4-035c-49a7-94ae-ba86737c00ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41cc83a-c8') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape41cc83a-c8, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbf608e6-5beb-470d-ac36-4a950bfe1cb9) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:31:01 user nova-compute[75021]: INFO os_vif [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:e8:c4,bridge_name='br-int',has_traffic_filtering=True,id=e41cc83a-c8d7-4c86-9d36-816ef12a3599,network=Network(39ddcfc4-035c-49a7-94ae-ba86737c00ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41cc83a-c8')
Dec 06 07:31:01 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Deleting instance files /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731_del
Dec 06 07:31:01 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Deletion of /opt/stack/data/nova/instances/f62bddff-a202-47e7-88b1-d7505eb92731_del complete
Dec 06 07:31:01 user nova-compute[75021]: INFO nova.compute.manager [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Took 0.66 seconds to destroy the instance on the hypervisor.
Dec 06 07:31:01 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:31:01 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:31:02 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:31:02 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Took 0.45 seconds to deallocate network for instance.
Dec 06 07:31:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:02 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:31:02 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:31:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:02 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Deleted allocations for instance f62bddff-a202-47e7-88b1-d7505eb92731
Dec 06 07:31:02 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cda64872-78e9-4f5a-b893-17e22d019fb0 tempest-VolumesActionsTest-1127490927 tempest-VolumesActionsTest-1127490927-project-member] Lock "f62bddff-a202-47e7-88b1-d7505eb92731" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.418s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-cd5fee5d-4437-42da-9105-fbe31ea9e644 req-26f7dc88-0f6e-4e6d-9a12-0098a01498a5 service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Received event network-vif-plugged-e41cc83a-c8d7-4c86-9d36-816ef12a3599 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:31:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cd5fee5d-4437-42da-9105-fbe31ea9e644 req-26f7dc88-0f6e-4e6d-9a12-0098a01498a5 service nova] Acquiring lock "f62bddff-a202-47e7-88b1-d7505eb92731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cd5fee5d-4437-42da-9105-fbe31ea9e644 req-26f7dc88-0f6e-4e6d-9a12-0098a01498a5 service nova] Lock "f62bddff-a202-47e7-88b1-d7505eb92731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:03 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-cd5fee5d-4437-42da-9105-fbe31ea9e644 req-26f7dc88-0f6e-4e6d-9a12-0098a01498a5 service nova] Lock "f62bddff-a202-47e7-88b1-d7505eb92731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-cd5fee5d-4437-42da-9105-fbe31ea9e644 req-26f7dc88-0f6e-4e6d-9a12-0098a01498a5 service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] No waiting events found dispatching network-vif-plugged-e41cc83a-c8d7-4c86-9d36-816ef12a3599 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:31:03 user nova-compute[75021]: WARNING nova.compute.manager [req-cd5fee5d-4437-42da-9105-fbe31ea9e644 req-26f7dc88-0f6e-4e6d-9a12-0098a01498a5 service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Received unexpected event network-vif-plugged-e41cc83a-c8d7-4c86-9d36-816ef12a3599 for instance with vm_state deleted and task_state None.
Dec 06 07:31:03 user nova-compute[75021]: DEBUG nova.compute.manager [req-cd5fee5d-4437-42da-9105-fbe31ea9e644 req-26f7dc88-0f6e-4e6d-9a12-0098a01498a5 service nova] [instance: f62bddff-a202-47e7-88b1-d7505eb92731] Received event network-vif-deleted-e41cc83a-c8d7-4c86-9d36-816ef12a3599 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:31:06 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:31:16 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:21 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:31:21 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:31:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:31:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:31:22 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:31:22 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:31:22 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=25.232234954833984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance be4426d8-f8fa-4c62-bfa6-74944341d938 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a3eb22e5-35f4-4744-839d-43ec60924f61 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing inventories for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Updating ProviderTree inventory for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Updating inventory in ProviderTree for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing aggregate associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, aggregates: None {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing trait associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, traits: HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:31:22 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:31:23 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:31:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:31:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:31:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:31:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:31:26 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:27 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:31:27 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:31:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-be4426d8-f8fa-4c62-bfa6-74944341d938" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:31:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-be4426d8-f8fa-4c62-bfa6-74944341d938" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:31:27 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:31:27 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Updating instance_info_cache with network_info: [{"id": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "address": "fa:16:3e:ca:09:be", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bba7a6d-ec", "ovs_interfaceid": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:31:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-be4426d8-f8fa-4c62-bfa6-74944341d938" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:31:27 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:31:27 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:31:27 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:31:27 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:31:27 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:31:28 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:31:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:31:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "be4426d8-f8fa-4c62-bfa6-74944341d938" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "be4426d8-f8fa-4c62-bfa6-74944341d938" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "be4426d8-f8fa-4c62-bfa6-74944341d938-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "be4426d8-f8fa-4c62-bfa6-74944341d938-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "be4426d8-f8fa-4c62-bfa6-74944341d938-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:33 user nova-compute[75021]: INFO nova.compute.manager [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Terminating instance
Dec 06 07:31:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-465f5b81-953e-4221-bc9f-5a41eabf2f25 req-524c541e-24cb-4b0a-b927-c6ebe65281bd service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Received event network-vif-unplugged-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-465f5b81-953e-4221-bc9f-5a41eabf2f25 req-524c541e-24cb-4b0a-b927-c6ebe65281bd service nova] Acquiring lock "be4426d8-f8fa-4c62-bfa6-74944341d938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-465f5b81-953e-4221-bc9f-5a41eabf2f25 req-524c541e-24cb-4b0a-b927-c6ebe65281bd service nova] Lock "be4426d8-f8fa-4c62-bfa6-74944341d938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-465f5b81-953e-4221-bc9f-5a41eabf2f25 req-524c541e-24cb-4b0a-b927-c6ebe65281bd service nova] Lock "be4426d8-f8fa-4c62-bfa6-74944341d938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-465f5b81-953e-4221-bc9f-5a41eabf2f25 req-524c541e-24cb-4b0a-b927-c6ebe65281bd service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] No waiting events found dispatching network-vif-unplugged-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-465f5b81-953e-4221-bc9f-5a41eabf2f25 req-524c541e-24cb-4b0a-b927-c6ebe65281bd service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Received event network-vif-unplugged-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:34 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Instance destroyed successfully.
Dec 06 07:31:34 user nova-compute[75021]: DEBUG nova.objects.instance [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lazy-loading 'resources' on Instance uuid be4426d8-f8fa-4c62-bfa6-74944341d938 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:26:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-786834580',display_name='tempest-TestVolumeBootPattern-volume-backed-server-786834580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-786834580',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc9ciKYAca/PoqsCjeRvcV/xVS4uaoiDM0GM/iRqM7z4TT4ad1HDmewFT6DrO84vZAt+mMFHouzdLwDoZ5vMG47JpudMLLN2eYJQWcHC1HxgjroAod35srzrFkg8dFC5Q==',key_name='tempest-keypair-251491758',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:27:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-gb7my2qd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:27:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=be4426d8-f8fa-4c62-bfa6-74944341d938,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "address": "fa:16:3e:ca:09:be", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bba7a6d-ec", "ovs_interfaceid": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "address": "fa:16:3e:ca:09:be", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bba7a6d-ec", "ovs_interfaceid": "3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:09:be,bridge_name='br-int',has_traffic_filtering=True,id=3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bba7a6d-ec') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_vif [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:09:be,bridge_name='br-int',has_traffic_filtering=True,id=3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bba7a6d-ec') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bba7a6d-ec, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e1f4d6d-a23b-4413-8d26-04fa57a4a9f0) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:31:34 user nova-compute[75021]: INFO os_vif [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:09:be,bridge_name='br-int',has_traffic_filtering=True,id=3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bba7a6d-ec')
Dec 06 07:31:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqBbAKGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:31:34 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7146c3a0-f387-4e30-aba0-426486f817ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:31:34 user nova-compute[75021]: No targets found.
Dec 06 07:31:34 user nova-compute[75021]: iSNS:
Dec 06 07:31:34 user nova-compute[75021]: No targets found.
Dec 06 07:31:34 user nova-compute[75021]: STATIC:
Dec 06 07:31:34 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195
Dec 06 07:31:34 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:31:34 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:31:34 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703
Dec 06 07:31:34 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:31:34 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:31:34 user nova-compute[75021]: FIRMWARE:
Dec 06 07:31:34 user nova-compute[75021]: No targets found.
Dec 06 07:31:34 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:31:34 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:31:34 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[740ed3e0-95a1-4153-8133-238096be3c5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea48889-97a4-45ae-95b4-512711cb2521]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:31:34 user nova-compute[75021]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:31:34 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 (non-flash)
Dec 06 07:31:34 user nova-compute[75021]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:31:34 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b47f1870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703'): ({'sdc'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Removing single pathed devices sdc {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4e85ec-2c93-4b8c-a5d3-0f7c2122ee6e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ce345d-6af7-4359-a3ce-bb8f7ef5270e]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flushing IO for device /dev/sdc {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9c2efa-0a9e-4dd3-bc37-1ad7ef937255]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc5fe6c-75e0-4c93-9b90-fd506404408a]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[48354841-0b02-4902-93f8-b93c53fdf4e8]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:31:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4d41c2-3713-4abe-aa54-8242726d3edf]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703, portal: 172.16.0.220,3260]
Dec 06 07:31:35 user nova-compute[75021]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703, portal: 172.16.0.220,3260] successful.
Dec 06 07:31:35 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:31:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9a4f62-08cb-4162-b6bf-56d29376c703 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:35 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da9b60c-a9a4-4aae-b885-56f610110c86]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:31:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:31:35 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== disconnect_volume: return (310ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:31:35 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:31:35 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Deleting instance files /opt/stack/data/nova/instances/be4426d8-f8fa-4c62-bfa6-74944341d938_del
Dec 06 07:31:35 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Deletion of /opt/stack/data/nova/instances/be4426d8-f8fa-4c62-bfa6-74944341d938_del complete
Dec 06 07:31:35 user nova-compute[75021]: INFO nova.compute.manager [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Took 1.16 seconds to destroy the instance on the hypervisor.
Dec 06 07:31:35 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:31:35 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:31:35 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:31:36 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:31:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-b7f4e4b2-ace2-4975-9c9b-c06fcf9c8cea req-294c7ed6-0b15-4ed4-a504-bd96b82ba93f service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Received event network-vif-plugged-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:31:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b7f4e4b2-ace2-4975-9c9b-c06fcf9c8cea req-294c7ed6-0b15-4ed4-a504-bd96b82ba93f service nova] Acquiring lock "be4426d8-f8fa-4c62-bfa6-74944341d938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b7f4e4b2-ace2-4975-9c9b-c06fcf9c8cea req-294c7ed6-0b15-4ed4-a504-bd96b82ba93f service nova] Lock "be4426d8-f8fa-4c62-bfa6-74944341d938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b7f4e4b2-ace2-4975-9c9b-c06fcf9c8cea req-294c7ed6-0b15-4ed4-a504-bd96b82ba93f service nova] Lock "be4426d8-f8fa-4c62-bfa6-74944341d938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-b7f4e4b2-ace2-4975-9c9b-c06fcf9c8cea req-294c7ed6-0b15-4ed4-a504-bd96b82ba93f service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] No waiting events found dispatching network-vif-plugged-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:31:36 user nova-compute[75021]: WARNING nova.compute.manager [req-b7f4e4b2-ace2-4975-9c9b-c06fcf9c8cea req-294c7ed6-0b15-4ed4-a504-bd96b82ba93f service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Received unexpected event network-vif-plugged-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c for instance with vm_state active and task_state deleting.
Dec 06 07:31:36 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Took 1.18 seconds to deallocate network for instance.
Dec 06 07:31:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-0cf2ba76-0b99-4cb8-9745-6b1802a36a43 req-ca7ed6de-c79d-418d-83f8-16da9e358325 service nova] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Received event network-vif-deleted-3bba7a6d-ecc4-49cb-93f6-2e99d629ae3c {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:31:37 user nova-compute[75021]: INFO nova.compute.manager [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Took 0.83 seconds to detach 1 volumes for instance.
Dec 06 07:31:37 user nova-compute[75021]: DEBUG nova.compute.manager [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: be4426d8-f8fa-4c62-bfa6-74944341d938] Deleting volume: ec9a4f62-08cb-4162-b6bf-56d29376c703 {{(pid=75021) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 07:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:37 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:31:37 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:37 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Deleted allocations for instance be4426d8-f8fa-4c62-bfa6-74944341d938
Dec 06 07:31:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-29c007fe-00b8-459e-b62c-5842084e0c7e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "be4426d8-f8fa-4c62-bfa6-74944341d938" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.835s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "a3eb22e5-35f4-4744-839d-43ec60924f61" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:38 user nova-compute[75021]: INFO nova.compute.manager [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Shelve offloading
Dec 06 07:31:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-eecfbc30-5652-41a5-b6d3-f9961bc7c788 req-fbbeb88c-681a-4b24-888e-fc4840e22605 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received event network-changed-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-eecfbc30-5652-41a5-b6d3-f9961bc7c788 req-fbbeb88c-681a-4b24-888e-fc4840e22605 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Refreshing instance network info cache due to event network-changed-111f3897-75da-40d3-8f93-16f488ebc186. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-eecfbc30-5652-41a5-b6d3-f9961bc7c788 req-fbbeb88c-681a-4b24-888e-fc4840e22605 service nova] Acquiring lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-eecfbc30-5652-41a5-b6d3-f9961bc7c788 req-fbbeb88c-681a-4b24-888e-fc4840e22605 service nova] Acquired lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG nova.network.neutron [req-eecfbc30-5652-41a5-b6d3-f9961bc7c788 req-fbbeb88c-681a-4b24-888e-fc4840e22605 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Refreshing network info cache for port 111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG nova.network.neutron [req-eecfbc30-5652-41a5-b6d3-f9961bc7c788 req-fbbeb88c-681a-4b24-888e-fc4840e22605 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updated VIF entry in instance network info cache for port 111f3897-75da-40d3-8f93-16f488ebc186. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG nova.network.neutron [req-eecfbc30-5652-41a5-b6d3-f9961bc7c788 req-fbbeb88c-681a-4b24-888e-fc4840e22605 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updating instance_info_cache with network_info: [{"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-eecfbc30-5652-41a5-b6d3-f9961bc7c788 req-fbbeb88c-681a-4b24-888e-fc4840e22605 service nova] Releasing lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-eecfbc30-5652-41a5-b6d3-f9961bc7c788 req-fbbeb88c-681a-4b24-888e-fc4840e22605 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received event network-vif-unplugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-eecfbc30-5652-41a5-b6d3-f9961bc7c788 req-fbbeb88c-681a-4b24-888e-fc4840e22605 service nova] Acquiring lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-eecfbc30-5652-41a5-b6d3-f9961bc7c788 req-fbbeb88c-681a-4b24-888e-fc4840e22605 service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-eecfbc30-5652-41a5-b6d3-f9961bc7c788 req-fbbeb88c-681a-4b24-888e-fc4840e22605 service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG nova.compute.manager [req-eecfbc30-5652-41a5-b6d3-f9961bc7c788 req-fbbeb88c-681a-4b24-888e-fc4840e22605 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] No waiting events found dispatching network-vif-unplugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:31:38 user nova-compute[75021]: WARNING nova.compute.manager [req-eecfbc30-5652-41a5-b6d3-f9961bc7c788 req-fbbeb88c-681a-4b24-888e-fc4840e22605 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received unexpected event network-vif-unplugged-111f3897-75da-40d3-8f93-16f488ebc186 for instance with vm_state active and task_state shelving.
Dec 06 07:31:38 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Instance destroyed successfully.
Dec 06 07:31:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquired lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:31:38 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updating instance_info_cache with network_info: [{"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Releasing lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:39 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Instance destroyed successfully.
Dec 06 07:31:39 user nova-compute[75021]: DEBUG nova.objects.instance [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lazy-loading 'resources' on Instance uuid a3eb22e5-35f4-4744-839d-43ec60924f61 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1240073608',display_name='tempest-TestShelveInstance-server-1240073608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1240073608',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxWWL9DEGMhocr6FZ6ZRC+Kdexb5fj22tvA2GdaTwKeGacHxJCWmeZXYpSmdKbqozYlvixSIpxPkdNk/oynj9aZdPCApw+s9E8GF1Fw0o/gHXsz54DIinIrx/AW8UaWZw==',key_name='tempest-TestShelveInstance-653132316',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:30:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49736ca5cec543bdabc53604c9020f89',ramdisk_id='',reservation_id='r-c68wuuhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1793737621',owner_user_name='tempest-TestShelveInstance-1793737621-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:30:04Z,user_data=None,user_id='f6279516fe514203950a2d0280e73417',uuid=a3eb22e5-35f4-4744-839d-43ec60924f61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Converting VIF {"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:11:35,bridge_name='br-int',has_traffic_filtering=True,id=111f3897-75da-40d3-8f93-16f488ebc186,network=Network(8f13b891-c697-40d0-b740-4f0acd72d60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f3897-75') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_vif [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:11:35,bridge_name='br-int',has_traffic_filtering=True,id=111f3897-75da-40d3-8f93-16f488ebc186,network=Network(8f13b891-c697-40d0-b740-4f0acd72d60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f3897-75') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap111f3897-75, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-b6a1efdf-5f47-4d2d-b88b-3323dd1cf955 req-fc2f9e00-d4ec-49e5-8a7e-e9b5c2b18ade service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received event network-changed-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-b6a1efdf-5f47-4d2d-b88b-3323dd1cf955 req-fc2f9e00-d4ec-49e5-8a7e-e9b5c2b18ade service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Refreshing instance network info cache due to event network-changed-111f3897-75da-40d3-8f93-16f488ebc186. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b6a1efdf-5f47-4d2d-b88b-3323dd1cf955 req-fc2f9e00-d4ec-49e5-8a7e-e9b5c2b18ade service nova] Acquiring lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b6a1efdf-5f47-4d2d-b88b-3323dd1cf955 req-fc2f9e00-d4ec-49e5-8a7e-e9b5c2b18ade service nova] Acquired lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG nova.network.neutron [req-b6a1efdf-5f47-4d2d-b88b-3323dd1cf955 req-fc2f9e00-d4ec-49e5-8a7e-e9b5c2b18ade service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Refreshing network info cache for port 111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3bc9b80-aa70-4655-9dce-2a3e32a02daa) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:31:39 user nova-compute[75021]: INFO os_vif [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:11:35,bridge_name='br-int',has_traffic_filtering=True,id=111f3897-75da-40d3-8f93-16f488ebc186,network=Network(8f13b891-c697-40d0-b740-4f0acd72d60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f3897-75')
Dec 06 07:31:39 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEYJrPBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:31:39 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01e460d-bf98-4fdc-9b23-1c7bbdd7011a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:31:39 user nova-compute[75021]: No targets found.
Dec 06 07:31:39 user nova-compute[75021]: iSNS:
Dec 06 07:31:39 user nova-compute[75021]: No targets found.
Dec 06 07:31:39 user nova-compute[75021]: STATIC:
Dec 06 07:31:39 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195
Dec 06 07:31:39 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:31:39 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:31:39 user nova-compute[75021]: FIRMWARE:
Dec 06 07:31:39 user nova-compute[75021]: No targets found.
Dec 06 07:31:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:31:39 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:31:39 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a503418f-e9d5-4c2a-87df-817656185b60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9ead1e-0af4-441f-ac3b-0e98d87122ee]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:31:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:31:39 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b47cc820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195'): ({'sdd'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Removing single pathed devices sdd {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df5320e-0105-4a1c-bb62-2b78f311b8ce]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4795d01b-e1bc-40a9-94ae-5fe64400ac25]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Flushing IO for device /dev/sdd {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5746b5a3-95ca-466e-9f92-c5abac538232]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19a40a6-72de-4339-9e91-645b547d8e95]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] SCSI volumes sdd have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[91852c45-4b50-467b-8181-5d186a94c4e7]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:31:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1620d042-3bda-45b6-b1f0-929f5f73efc0]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260]
Dec 06 07:31:40 user nova-compute[75021]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260] successful.
Dec 06 07:31:40 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bf8122-749e-42ec-b134-ccb36c5ba0ea]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] <== disconnect_volume: return (285ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:31:40 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Deleting instance files /opt/stack/data/nova/instances/a3eb22e5-35f4-4744-839d-43ec60924f61_del
Dec 06 07:31:40 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Deletion of /opt/stack/data/nova/instances/a3eb22e5-35f4-4744-839d-43ec60924f61_del complete
Dec 06 07:31:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-b6a1efdf-5f47-4d2d-b88b-3323dd1cf955 req-fc2f9e00-d4ec-49e5-8a7e-e9b5c2b18ade service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updated VIF entry in instance network info cache for port 111f3897-75da-40d3-8f93-16f488ebc186. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-b6a1efdf-5f47-4d2d-b88b-3323dd1cf955 req-fc2f9e00-d4ec-49e5-8a7e-e9b5c2b18ade service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updating instance_info_cache with network_info: [{"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": null, "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap111f3897-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b6a1efdf-5f47-4d2d-b88b-3323dd1cf955 req-fc2f9e00-d4ec-49e5-8a7e-e9b5c2b18ade service nova] Releasing lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-a9c672dc-84d4-421e-8b26-5dd8180f82da req-cbeba380-abf3-4ccf-ba44-1b6c4ae32199 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received event network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a9c672dc-84d4-421e-8b26-5dd8180f82da req-cbeba380-abf3-4ccf-ba44-1b6c4ae32199 service nova] Acquiring lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a9c672dc-84d4-421e-8b26-5dd8180f82da req-cbeba380-abf3-4ccf-ba44-1b6c4ae32199 service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a9c672dc-84d4-421e-8b26-5dd8180f82da req-cbeba380-abf3-4ccf-ba44-1b6c4ae32199 service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-a9c672dc-84d4-421e-8b26-5dd8180f82da req-cbeba380-abf3-4ccf-ba44-1b6c4ae32199 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] No waiting events found dispatching network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:31:40 user nova-compute[75021]: WARNING nova.compute.manager [req-a9c672dc-84d4-421e-8b26-5dd8180f82da req-cbeba380-abf3-4ccf-ba44-1b6c4ae32199 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received unexpected event network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 for instance with vm_state active and task_state shelving.
Dec 06 07:31:41 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Deleted allocations for instance a3eb22e5-35f4-4744-839d-43ec60924f61
Dec 06 07:31:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:31:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:31:41 user nova-compute[75021]: DEBUG nova.objects.instance [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lazy-loading 'numa_topology' on Instance uuid a3eb22e5-35f4-4744-839d-43ec60924f61 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:31:41 user nova-compute[75021]: DEBUG nova.objects.base [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Object Instance<a3eb22e5-35f4-4744-839d-43ec60924f61> lazy-loaded attributes: resources,numa_topology {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:31:41 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:31:41 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:31:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.104s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f009ad26-e5e2-4ed5-a9c5-3749a66cdb9e tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.406s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:31:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:31:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:31:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:31:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:31:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:31:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:32:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:32:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:32:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:32:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:32:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:22 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:32:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:32:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:23 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:24 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:32:24 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:32:24 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.221431732177734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:32:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:26 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:32:26 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:32:26 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Dec 06 07:32:26 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 07:32:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:28 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:32:28 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:32:28 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:32:29 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:32:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:30 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:32:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Acquiring lock "b9a5de7b-2d11-466e-82f6-403eb7563824" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:32:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "b9a5de7b-2d11-466e-82f6-403eb7563824" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:32:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:32:32 user nova-compute[75021]: INFO nova.compute.claims [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Claim successful on node user
Dec 06 07:32:32 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG nova.network.neutron [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:32:32 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:32:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG nova.policy [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a104a819b39c4db7b5168d6828665ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1404fa8569b45ada8644119e5d1471a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:32:32 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Creating image(s)
Dec 06 07:32:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "/opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "/opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.165s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:32:32 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.198s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk 1073741824" returned: 0 in 0.058s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Successfully created port: 24f29474-2190-421e-a90e-d0b4eebe3e05 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.198s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Cannot resize image /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Ensure instance console log exists: /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Successfully updated port: 24f29474-2190-421e-a90e-d0b4eebe3e05 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Acquiring lock "refresh_cache-b9a5de7b-2d11-466e-82f6-403eb7563824" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Acquired lock "refresh_cache-b9a5de7b-2d11-466e-82f6-403eb7563824" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG nova.compute.manager [req-ca5a6334-4fa2-469b-a709-f5c0a5212ecd req-4631b17e-2ebf-427c-80d9-3733d1fca681 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Received event network-changed-24f29474-2190-421e-a90e-d0b4eebe3e05 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG nova.compute.manager [req-ca5a6334-4fa2-469b-a709-f5c0a5212ecd req-4631b17e-2ebf-427c-80d9-3733d1fca681 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Refreshing instance network info cache due to event network-changed-24f29474-2190-421e-a90e-d0b4eebe3e05. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ca5a6334-4fa2-469b-a709-f5c0a5212ecd req-4631b17e-2ebf-427c-80d9-3733d1fca681 service nova] Acquiring lock "refresh_cache-b9a5de7b-2d11-466e-82f6-403eb7563824" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:32:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.network.neutron [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Updating instance_info_cache with network_info: [{"id": "24f29474-2190-421e-a90e-d0b4eebe3e05", "address": "fa:16:3e:b0:77:84", "network": {"id": "8276ccdc-3c29-47e7-8530-e0642ba0502c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1656732734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1404fa8569b45ada8644119e5d1471a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f29474-21", "ovs_interfaceid": "24f29474-2190-421e-a90e-d0b4eebe3e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Releasing lock "refresh_cache-b9a5de7b-2d11-466e-82f6-403eb7563824" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Instance network_info: |[{"id": "24f29474-2190-421e-a90e-d0b4eebe3e05", "address": "fa:16:3e:b0:77:84", "network": {"id": "8276ccdc-3c29-47e7-8530-e0642ba0502c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1656732734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1404fa8569b45ada8644119e5d1471a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f29474-21", "ovs_interfaceid": "24f29474-2190-421e-a90e-d0b4eebe3e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ca5a6334-4fa2-469b-a709-f5c0a5212ecd req-4631b17e-2ebf-427c-80d9-3733d1fca681 service nova] Acquired lock "refresh_cache-b9a5de7b-2d11-466e-82f6-403eb7563824" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-ca5a6334-4fa2-469b-a709-f5c0a5212ecd req-4631b17e-2ebf-427c-80d9-3733d1fca681 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Refreshing network info cache for port 24f29474-2190-421e-a90e-d0b4eebe3e05 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Start _get_guest_xml network_info=[{"id": "24f29474-2190-421e-a90e-d0b4eebe3e05", "address": "fa:16:3e:b0:77:84", "network": {"id": "8276ccdc-3c29-47e7-8530-e0642ba0502c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1656732734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1404fa8569b45ada8644119e5d1471a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f29474-21", "ovs_interfaceid": "24f29474-2190-421e-a90e-d0b4eebe3e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:32:34 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:32:34 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-313407973',display_name='tempest-VolumesActionsTest-instance-313407973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-313407973',id=49,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1404fa8569b45ada8644119e5d1471a',ramdisk_id='',reservation_id='r-mdr9ghzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2000478144',owner_user_name='tempest-VolumesActionsTest-2000478144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:32:32Z,user_data=None,user_id='a104a819b39c4db7b5168d6828665ebd',uuid=b9a5de7b-2d11-466e-82f6-403eb7563824,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24f29474-2190-421e-a90e-d0b4eebe3e05", "address": "fa:16:3e:b0:77:84", "network": {"id": "8276ccdc-3c29-47e7-8530-e0642ba0502c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1656732734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1404fa8569b45ada8644119e5d1471a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f29474-21", "ovs_interfaceid": "24f29474-2190-421e-a90e-d0b4eebe3e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Converting VIF {"id": "24f29474-2190-421e-a90e-d0b4eebe3e05", "address": "fa:16:3e:b0:77:84", "network": {"id": "8276ccdc-3c29-47e7-8530-e0642ba0502c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1656732734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1404fa8569b45ada8644119e5d1471a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f29474-21", "ovs_interfaceid": "24f29474-2190-421e-a90e-d0b4eebe3e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:77:84,bridge_name='br-int',has_traffic_filtering=True,id=24f29474-2190-421e-a90e-d0b4eebe3e05,network=Network(8276ccdc-3c29-47e7-8530-e0642ba0502c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f29474-21') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.objects.instance [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lazy-loading 'pci_devices' on Instance uuid b9a5de7b-2d11-466e-82f6-403eb7563824 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:32:34 user nova-compute[75021]:   <uuid>b9a5de7b-2d11-466e-82f6-403eb7563824</uuid>
Dec 06 07:32:34 user nova-compute[75021]:   <name>instance-00000031</name>
Dec 06 07:32:34 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:32:34 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:32:34 user nova-compute[75021]:   <metadata>
Dec 06 07:32:34 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:32:34 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:32:34 user nova-compute[75021]:       <nova:name>tempest-VolumesActionsTest-instance-313407973</nova:name>
Dec 06 07:32:34 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:32:34</nova:creationTime>
Dec 06 07:32:34 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:32:34 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:32:34 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:32:34 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:32:34 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:32:34 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:32:34 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:32:34 user nova-compute[75021]:       <nova:owner>
Dec 06 07:32:34 user nova-compute[75021]:         <nova:user uuid="a104a819b39c4db7b5168d6828665ebd">tempest-VolumesActionsTest-2000478144-project-member</nova:user>
Dec 06 07:32:34 user nova-compute[75021]:         <nova:project uuid="b1404fa8569b45ada8644119e5d1471a">tempest-VolumesActionsTest-2000478144</nova:project>
Dec 06 07:32:34 user nova-compute[75021]:       </nova:owner>
Dec 06 07:32:34 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:32:34 user nova-compute[75021]:       <nova:ports>
Dec 06 07:32:34 user nova-compute[75021]:         <nova:port uuid="24f29474-2190-421e-a90e-d0b4eebe3e05">
Dec 06 07:32:34 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 07:32:34 user nova-compute[75021]:         </nova:port>
Dec 06 07:32:34 user nova-compute[75021]:       </nova:ports>
Dec 06 07:32:34 user nova-compute[75021]:     </nova:instance>
Dec 06 07:32:34 user nova-compute[75021]:   </metadata>
Dec 06 07:32:34 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:32:34 user nova-compute[75021]:     <system>
Dec 06 07:32:34 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:32:34 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:32:34 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:32:34 user nova-compute[75021]:       <entry name="serial">b9a5de7b-2d11-466e-82f6-403eb7563824</entry>
Dec 06 07:32:34 user nova-compute[75021]:       <entry name="uuid">b9a5de7b-2d11-466e-82f6-403eb7563824</entry>
Dec 06 07:32:34 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:32:34 user nova-compute[75021]:     </system>
Dec 06 07:32:34 user nova-compute[75021]:   </sysinfo>
Dec 06 07:32:34 user nova-compute[75021]:   <os>
Dec 06 07:32:34 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:32:34 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:32:34 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:32:34 user nova-compute[75021]:   </os>
Dec 06 07:32:34 user nova-compute[75021]:   <features>
Dec 06 07:32:34 user nova-compute[75021]:     <acpi/>
Dec 06 07:32:34 user nova-compute[75021]:     <apic/>
Dec 06 07:32:34 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:32:34 user nova-compute[75021]:   </features>
Dec 06 07:32:34 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:32:34 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:32:34 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:32:34 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:32:34 user nova-compute[75021]:   </clock>
Dec 06 07:32:34 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:32:34 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:32:34 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:32:34 user nova-compute[75021]:   </cpu>
Dec 06 07:32:34 user nova-compute[75021]:   <devices>
Dec 06 07:32:34 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:32:34 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:32:34 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk"/>
Dec 06 07:32:34 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:32:34 user nova-compute[75021]:     </disk>
Dec 06 07:32:34 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:32:34 user nova-compute[75021]:       <mac address="fa:16:3e:b0:77:84"/>
Dec 06 07:32:34 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:32:34 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:32:34 user nova-compute[75021]:       <target dev="tap24f29474-21"/>
Dec 06 07:32:34 user nova-compute[75021]:     </interface>
Dec 06 07:32:34 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:32:34 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/console.log" append="off"/>
Dec 06 07:32:34 user nova-compute[75021]:     </serial>
Dec 06 07:32:34 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:32:34 user nova-compute[75021]:     <video>
Dec 06 07:32:34 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:32:34 user nova-compute[75021]:     </video>
Dec 06 07:32:34 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:32:34 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:32:34 user nova-compute[75021]:     </rng>
Dec 06 07:32:34 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:32:34 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:32:34 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:32:34 user nova-compute[75021]:     </memballoon>
Dec 06 07:32:34 user nova-compute[75021]:   </devices>
Dec 06 07:32:34 user nova-compute[75021]: </domain>
Dec 06 07:32:34 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-313407973',display_name='tempest-VolumesActionsTest-instance-313407973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-313407973',id=49,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1404fa8569b45ada8644119e5d1471a',ramdisk_id='',reservation_id='r-mdr9ghzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2000478144',owner_user_name='tempest-VolumesActionsTest-2000478144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:32:32Z,user_data=None,user_id='a104a819b39c4db7b5168d6828665ebd',uuid=b9a5de7b-2d11-466e-82f6-403eb7563824,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24f29474-2190-421e-a90e-d0b4eebe3e05", "address": "fa:16:3e:b0:77:84", "network": {"id": "8276ccdc-3c29-47e7-8530-e0642ba0502c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1656732734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1404fa8569b45ada8644119e5d1471a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f29474-21", "ovs_interfaceid": "24f29474-2190-421e-a90e-d0b4eebe3e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Converting VIF {"id": "24f29474-2190-421e-a90e-d0b4eebe3e05", "address": "fa:16:3e:b0:77:84", "network": {"id": "8276ccdc-3c29-47e7-8530-e0642ba0502c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1656732734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1404fa8569b45ada8644119e5d1471a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f29474-21", "ovs_interfaceid": "24f29474-2190-421e-a90e-d0b4eebe3e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:77:84,bridge_name='br-int',has_traffic_filtering=True,id=24f29474-2190-421e-a90e-d0b4eebe3e05,network=Network(8276ccdc-3c29-47e7-8530-e0642ba0502c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f29474-21') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG os_vif [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:77:84,bridge_name='br-int',has_traffic_filtering=True,id=24f29474-2190-421e-a90e-d0b4eebe3e05,network=Network(8276ccdc-3c29-47e7-8530-e0642ba0502c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f29474-21') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '931264f5-c174-551b-8508-1a4d792af701', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24f29474-21, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24f29474-21, col_values=(('qos', UUID('6333cd8c-7263-45fe-9ea2-98248301046b')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24f29474-21, col_values=(('external_ids', {'iface-id': '24f29474-2190-421e-a90e-d0b4eebe3e05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:77:84', 'vm-uuid': 'b9a5de7b-2d11-466e-82f6-403eb7563824'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:34 user nova-compute[75021]: INFO os_vif [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:77:84,bridge_name='br-int',has_traffic_filtering=True,id=24f29474-2190-421e-a90e-d0b4eebe3e05,network=Network(8276ccdc-3c29-47e7-8530-e0642ba0502c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f29474-21')
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] No VIF found with MAC fa:16:3e:b0:77:84, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-ca5a6334-4fa2-469b-a709-f5c0a5212ecd req-4631b17e-2ebf-427c-80d9-3733d1fca681 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Updated VIF entry in instance network info cache for port 24f29474-2190-421e-a90e-d0b4eebe3e05. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG nova.network.neutron [req-ca5a6334-4fa2-469b-a709-f5c0a5212ecd req-4631b17e-2ebf-427c-80d9-3733d1fca681 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Updating instance_info_cache with network_info: [{"id": "24f29474-2190-421e-a90e-d0b4eebe3e05", "address": "fa:16:3e:b0:77:84", "network": {"id": "8276ccdc-3c29-47e7-8530-e0642ba0502c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1656732734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1404fa8569b45ada8644119e5d1471a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f29474-21", "ovs_interfaceid": "24f29474-2190-421e-a90e-d0b4eebe3e05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:32:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ca5a6334-4fa2-469b-a709-f5c0a5212ecd req-4631b17e-2ebf-427c-80d9-3733d1fca681 service nova] Releasing lock "refresh_cache-b9a5de7b-2d11-466e-82f6-403eb7563824" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:32:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-14ea2989-27dc-4fcc-830f-d9fe2e4e8be6 req-3e2bb35c-0534-444b-bf9e-f39effee9821 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Received event network-vif-plugged-24f29474-2190-421e-a90e-d0b4eebe3e05 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:32:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-14ea2989-27dc-4fcc-830f-d9fe2e4e8be6 req-3e2bb35c-0534-444b-bf9e-f39effee9821 service nova] Acquiring lock "b9a5de7b-2d11-466e-82f6-403eb7563824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:32:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-14ea2989-27dc-4fcc-830f-d9fe2e4e8be6 req-3e2bb35c-0534-444b-bf9e-f39effee9821 service nova] Lock "b9a5de7b-2d11-466e-82f6-403eb7563824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:32:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-14ea2989-27dc-4fcc-830f-d9fe2e4e8be6 req-3e2bb35c-0534-444b-bf9e-f39effee9821 service nova] Lock "b9a5de7b-2d11-466e-82f6-403eb7563824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:32:35 user nova-compute[75021]: DEBUG nova.compute.manager [req-14ea2989-27dc-4fcc-830f-d9fe2e4e8be6 req-3e2bb35c-0534-444b-bf9e-f39effee9821 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] No waiting events found dispatching network-vif-plugged-24f29474-2190-421e-a90e-d0b4eebe3e05 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:32:35 user nova-compute[75021]: WARNING nova.compute.manager [req-14ea2989-27dc-4fcc-830f-d9fe2e4e8be6 req-3e2bb35c-0534-444b-bf9e-f39effee9821 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Received unexpected event network-vif-plugged-24f29474-2190-421e-a90e-d0b4eebe3e05 for instance with vm_state building and task_state spawning.
Dec 06 07:32:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "da52ecfa-51e7-4578-9489-6878dfd2326f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "da52ecfa-51e7-4578-9489-6878dfd2326f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:32:36 user nova-compute[75021]: INFO nova.compute.claims [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Claim successful on node user
Dec 06 07:32:36 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.226s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:32:36 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:32:36 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG nova.policy [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b39552dec3964bf69ed87b5ca130fe5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddfde019af4962929aa2c8cfa84b35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:32:36 user nova-compute[75021]: INFO nova.virt.block_device [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Booting with volume 375fa659-89c5-4c1d-a11d-6d3a354dcbab at /dev/vda
Dec 06 07:32:36 user nova-compute[75021]: DEBUG os_brick.utils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9973aee-28f7-4543-951c-7ff7db3b5465]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:36 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b27f81-12e5-4bb8-a8dc-bcd1f35b3045]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6e4990-c7cd-4c05-ad49-35e3aa2c7037]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da97cda-6d33-4ac0-bda1-43cce820793e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:32:37 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:32:37 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1d4f7d-e8c6-4a5c-9c0a-85702d4a464b]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG os_brick.utils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Updating existing volume attachment record: 8b550bd1-a591-4240-ac91-5021a3d4b459 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Successfully created port: dc7d5029-e174-454a-a9fe-a30c2aeea2a2 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-eac4a540-9a7a-4304-94b1-f844ad40d22d req-7a8a6750-2cf5-4a69-a258-86aee5cecf14 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Received event network-vif-plugged-24f29474-2190-421e-a90e-d0b4eebe3e05 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-eac4a540-9a7a-4304-94b1-f844ad40d22d req-7a8a6750-2cf5-4a69-a258-86aee5cecf14 service nova] Acquiring lock "b9a5de7b-2d11-466e-82f6-403eb7563824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-eac4a540-9a7a-4304-94b1-f844ad40d22d req-7a8a6750-2cf5-4a69-a258-86aee5cecf14 service nova] Lock "b9a5de7b-2d11-466e-82f6-403eb7563824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-eac4a540-9a7a-4304-94b1-f844ad40d22d req-7a8a6750-2cf5-4a69-a258-86aee5cecf14 service nova] Lock "b9a5de7b-2d11-466e-82f6-403eb7563824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG nova.compute.manager [req-eac4a540-9a7a-4304-94b1-f844ad40d22d req-7a8a6750-2cf5-4a69-a258-86aee5cecf14 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] No waiting events found dispatching network-vif-plugged-24f29474-2190-421e-a90e-d0b4eebe3e05 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:32:37 user nova-compute[75021]: WARNING nova.compute.manager [req-eac4a540-9a7a-4304-94b1-f844ad40d22d req-7a8a6750-2cf5-4a69-a258-86aee5cecf14 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Received unexpected event network-vif-plugged-24f29474-2190-421e-a90e-d0b4eebe3e05 for instance with vm_state building and task_state spawning.
Dec 06 07:32:37 user nova-compute[75021]: DEBUG nova.compute.manager [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:32:37 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Instance spawned successfully.
Dec 06 07:32:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:32:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:32:38 user nova-compute[75021]: INFO nova.compute.manager [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Took 5.39 seconds to spawn the instance on the hypervisor.
Dec 06 07:32:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:32:38 user nova-compute[75021]: INFO nova.compute.manager [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Took 6.07 seconds to build instance.
Dec 06 07:32:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-307e1cc1-8c75-49b8-8777-e65b23726748 tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "b9a5de7b-2d11-466e-82f6-403eb7563824" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.171s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:32:38 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Successfully updated port: dc7d5029-e174-454a-a9fe-a30c2aeea2a2 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:32:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "refresh_cache-da52ecfa-51e7-4578-9489-6878dfd2326f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:32:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquired lock "refresh_cache-da52ecfa-51e7-4578-9489-6878dfd2326f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:32:38 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:32:38 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:32:38 user nova-compute[75021]: DEBUG nova.network.neutron [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Updating instance_info_cache with network_info: [{"id": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "address": "fa:16:3e:9c:3d:fa", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7d5029-e1", "ovs_interfaceid": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:32:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Releasing lock "refresh_cache-da52ecfa-51e7-4578-9489-6878dfd2326f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:32:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Instance network_info: |[{"id": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "address": "fa:16:3e:9c:3d:fa", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7d5029-e1", "ovs_interfaceid": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:32:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-25a36ebe-4b2e-4024-8882-1f71685b431e req-8d46f36f-3704-4fac-a409-959f1c433fe7 service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Received event network-changed-dc7d5029-e174-454a-a9fe-a30c2aeea2a2 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:32:39 user nova-compute[75021]: DEBUG nova.compute.manager [req-25a36ebe-4b2e-4024-8882-1f71685b431e req-8d46f36f-3704-4fac-a409-959f1c433fe7 service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Refreshing instance network info cache due to event network-changed-dc7d5029-e174-454a-a9fe-a30c2aeea2a2. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:32:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-25a36ebe-4b2e-4024-8882-1f71685b431e req-8d46f36f-3704-4fac-a409-959f1c433fe7 service nova] Acquiring lock "refresh_cache-da52ecfa-51e7-4578-9489-6878dfd2326f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:32:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-25a36ebe-4b2e-4024-8882-1f71685b431e req-8d46f36f-3704-4fac-a409-959f1c433fe7 service nova] Acquired lock "refresh_cache-da52ecfa-51e7-4578-9489-6878dfd2326f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:32:39 user nova-compute[75021]: DEBUG nova.network.neutron [req-25a36ebe-4b2e-4024-8882-1f71685b431e req-8d46f36f-3704-4fac-a409-959f1c433fe7 service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Refreshing network info cache for port dc7d5029-e174-454a-a9fe-a30c2aeea2a2 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:32:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-25a36ebe-4b2e-4024-8882-1f71685b431e req-8d46f36f-3704-4fac-a409-959f1c433fe7 service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Updated VIF entry in instance network info cache for port dc7d5029-e174-454a-a9fe-a30c2aeea2a2. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:32:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-25a36ebe-4b2e-4024-8882-1f71685b431e req-8d46f36f-3704-4fac-a409-959f1c433fe7 service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Updating instance_info_cache with network_info: [{"id": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "address": "fa:16:3e:9c:3d:fa", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7d5029-e1", "ovs_interfaceid": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:32:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-25a36ebe-4b2e-4024-8882-1f71685b431e req-8d46f36f-3704-4fac-a409-959f1c433fe7 service nova] Releasing lock "refresh_cache-da52ecfa-51e7-4578-9489-6878dfd2326f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:32:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:32:46 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Creating image(s)
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Ensure instance console log exists: /opt/stack/data/nova/instances/da52ecfa-51e7-4578-9489-6878dfd2326f/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Start _get_guest_xml network_info=[{"id": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "address": "fa:16:3e:9c:3d:fa", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7d5029-e1", "ovs_interfaceid": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8b550bd1-a591-4240-ac91-5021a3d4b459', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tERBKjyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da52ecfa-51e7-4578-9489-6878dfd2326f', 'attached_at': '', 'detached_at': '', 'volume_id': '375fa659-89c5-4c1d-a11d-6d3a354dcbab', 'serial': '375fa659-89c5-4c1d-a11d-6d3a354dcbab'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:32:46 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:32:46 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tERBKjyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:32:46 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:32:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:32:46 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:32:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:32:46 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[def55e8d-79ed-404d-9f80-933dcf3fbf52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:32:46 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[897925ee-796e-4b13-8fbc-922e64bdf302]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab] added
Dec 06 07:32:46 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc704df7-79bb-480d-931a-f38cc8b5576a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f393dc7-0d29-458d-b110-23fbb2858e04]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tERBKjyi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tERBKjyi" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2aba9f-c275-4453-8194-4ab07a57272d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tERBKjyi'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:32:46 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdefd26-08fb-4ada-866f-98a1820109d5]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd57b86-fc2e-4674-acf9-25a69ce33f07]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:32:47 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:32:47 user nova-compute[75021]:  {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:32:47 user nova-compute[75021]: WARNING os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 07:32:47 user nova-compute[75021]: 
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e9599a-7086-4c23-8aff-e15f773f263a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260]
Dec 06 07:32:47 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260] successful.
Dec 06 07:32:47 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26602b8-86f5-4e48-bdfd-118c921dc79e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf71d4c-6b1c-48a8-b08b-6efffd24d60c]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:32:47 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:32:47 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3d8429-c919-47f9-b146-b250b6f03d4f]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:32:47 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tERBKjyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26533366137633936', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533366137633936', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:32:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-130496791',display_name='tempest-TestVolumeBootPattern-server-130496791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-130496791',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/q672ydb0gw8Top+rrysEwxQ79bw8IIbuqy7QFDIbXz/tZqH3LZLi824RQ6QLVj2ALmCEvtH1vqGA5G+ngr0orlUWhzvqZziUCTzoOwBaRmBqojvNQQcSbs90EuLDeQQ==',key_name='tempest-TestVolumeBootPattern-943306452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-6psfuova',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:32:37Z,user_data=None,user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=da52ecfa-51e7-4578-9489-6878dfd2326f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "address": "fa:16:3e:9c:3d:fa", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7d5029-e1", "ovs_interfaceid": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "address": "fa:16:3e:9c:3d:fa", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7d5029-e1", "ovs_interfaceid": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:3d:fa,bridge_name='br-int',has_traffic_filtering=True,id=dc7d5029-e174-454a-a9fe-a30c2aeea2a2,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7d5029-e1') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG nova.objects.instance [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lazy-loading 'pci_devices' on Instance uuid da52ecfa-51e7-4578-9489-6878dfd2326f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:32:48 user nova-compute[75021]:   <uuid>da52ecfa-51e7-4578-9489-6878dfd2326f</uuid>
Dec 06 07:32:48 user nova-compute[75021]:   <name>instance-00000032</name>
Dec 06 07:32:48 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:32:48 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:32:48 user nova-compute[75021]:   <metadata>
Dec 06 07:32:48 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:32:48 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:32:48 user nova-compute[75021]:       <nova:name>tempest-TestVolumeBootPattern-server-130496791</nova:name>
Dec 06 07:32:48 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:32:46</nova:creationTime>
Dec 06 07:32:48 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:32:48 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:32:48 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:32:48 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:32:48 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:32:48 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:32:48 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:32:48 user nova-compute[75021]:       <nova:owner>
Dec 06 07:32:48 user nova-compute[75021]:         <nova:user uuid="b39552dec3964bf69ed87b5ca130fe5f">tempest-TestVolumeBootPattern-1013845055-project-member</nova:user>
Dec 06 07:32:48 user nova-compute[75021]:         <nova:project uuid="00ddfde019af4962929aa2c8cfa84b35">tempest-TestVolumeBootPattern-1013845055</nova:project>
Dec 06 07:32:48 user nova-compute[75021]:       </nova:owner>
Dec 06 07:32:48 user nova-compute[75021]:       <nova:ports>
Dec 06 07:32:48 user nova-compute[75021]:         <nova:port uuid="dc7d5029-e174-454a-a9fe-a30c2aeea2a2">
Dec 06 07:32:48 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 06 07:32:48 user nova-compute[75021]:         </nova:port>
Dec 06 07:32:48 user nova-compute[75021]:       </nova:ports>
Dec 06 07:32:48 user nova-compute[75021]:     </nova:instance>
Dec 06 07:32:48 user nova-compute[75021]:   </metadata>
Dec 06 07:32:48 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:32:48 user nova-compute[75021]:     <system>
Dec 06 07:32:48 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:32:48 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:32:48 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:32:48 user nova-compute[75021]:       <entry name="serial">da52ecfa-51e7-4578-9489-6878dfd2326f</entry>
Dec 06 07:32:48 user nova-compute[75021]:       <entry name="uuid">da52ecfa-51e7-4578-9489-6878dfd2326f</entry>
Dec 06 07:32:48 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:32:48 user nova-compute[75021]:     </system>
Dec 06 07:32:48 user nova-compute[75021]:   </sysinfo>
Dec 06 07:32:48 user nova-compute[75021]:   <os>
Dec 06 07:32:48 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:32:48 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:32:48 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:32:48 user nova-compute[75021]:   </os>
Dec 06 07:32:48 user nova-compute[75021]:   <features>
Dec 06 07:32:48 user nova-compute[75021]:     <acpi/>
Dec 06 07:32:48 user nova-compute[75021]:     <apic/>
Dec 06 07:32:48 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:32:48 user nova-compute[75021]:   </features>
Dec 06 07:32:48 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:32:48 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:32:48 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:32:48 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:32:48 user nova-compute[75021]:   </clock>
Dec 06 07:32:48 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:32:48 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:32:48 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:32:48 user nova-compute[75021]:   </cpu>
Dec 06 07:32:48 user nova-compute[75021]:   <devices>
Dec 06 07:32:48 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:32:48 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:32:48 user nova-compute[75021]:       <source dev="/dev/sdb"/>
Dec 06 07:32:48 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:32:48 user nova-compute[75021]:       <serial>375fa659-89c5-4c1d-a11d-6d3a354dcbab</serial>
Dec 06 07:32:48 user nova-compute[75021]:     </disk>
Dec 06 07:32:48 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:32:48 user nova-compute[75021]:       <mac address="fa:16:3e:9c:3d:fa"/>
Dec 06 07:32:48 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:32:48 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:32:48 user nova-compute[75021]:       <target dev="tapdc7d5029-e1"/>
Dec 06 07:32:48 user nova-compute[75021]:     </interface>
Dec 06 07:32:48 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:32:48 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/da52ecfa-51e7-4578-9489-6878dfd2326f/console.log" append="off"/>
Dec 06 07:32:48 user nova-compute[75021]:     </serial>
Dec 06 07:32:48 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:32:48 user nova-compute[75021]:     <video>
Dec 06 07:32:48 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:32:48 user nova-compute[75021]:     </video>
Dec 06 07:32:48 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:32:48 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:32:48 user nova-compute[75021]:     </rng>
Dec 06 07:32:48 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:32:48 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:32:48 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:32:48 user nova-compute[75021]:     </memballoon>
Dec 06 07:32:48 user nova-compute[75021]:   </devices>
Dec 06 07:32:48 user nova-compute[75021]: </domain>
Dec 06 07:32:48 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:32:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-130496791',display_name='tempest-TestVolumeBootPattern-server-130496791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-130496791',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/q672ydb0gw8Top+rrysEwxQ79bw8IIbuqy7QFDIbXz/tZqH3LZLi824RQ6QLVj2ALmCEvtH1vqGA5G+ngr0orlUWhzvqZziUCTzoOwBaRmBqojvNQQcSbs90EuLDeQQ==',key_name='tempest-TestVolumeBootPattern-943306452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-6psfuova',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:32:37Z,user_data=None,user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=da52ecfa-51e7-4578-9489-6878dfd2326f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "address": "fa:16:3e:9c:3d:fa", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7d5029-e1", "ovs_interfaceid": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "address": "fa:16:3e:9c:3d:fa", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7d5029-e1", "ovs_interfaceid": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:3d:fa,bridge_name='br-int',has_traffic_filtering=True,id=dc7d5029-e174-454a-a9fe-a30c2aeea2a2,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7d5029-e1') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG os_vif [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:3d:fa,bridge_name='br-int',has_traffic_filtering=True,id=dc7d5029-e174-454a-a9fe-a30c2aeea2a2,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7d5029-e1') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85f446ac-6a99-5263-9d10-d68267912dc7', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc7d5029-e1, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc7d5029-e1, col_values=(('qos', UUID('9a4e8da3-fa6f-40a8-845f-c87c90b6eb25')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc7d5029-e1, col_values=(('external_ids', {'iface-id': 'dc7d5029-e174-454a-a9fe-a30c2aeea2a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:3d:fa', 'vm-uuid': 'da52ecfa-51e7-4578-9489-6878dfd2326f'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:48 user nova-compute[75021]: INFO os_vif [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:3d:fa,bridge_name='br-int',has_traffic_filtering=True,id=dc7d5029-e174-454a-a9fe-a30c2aeea2a2,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7d5029-e1')
Dec 06 07:32:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:32:48 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] No VIF found with MAC fa:16:3e:9c:3d:fa, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:32:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-9e82c3f6-a219-4408-abbd-18c68c81977f req-9f0f4689-6015-4482-adfc-258e0ae3f465 service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Received event network-vif-plugged-dc7d5029-e174-454a-a9fe-a30c2aeea2a2 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9e82c3f6-a219-4408-abbd-18c68c81977f req-9f0f4689-6015-4482-adfc-258e0ae3f465 service nova] Acquiring lock "da52ecfa-51e7-4578-9489-6878dfd2326f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9e82c3f6-a219-4408-abbd-18c68c81977f req-9f0f4689-6015-4482-adfc-258e0ae3f465 service nova] Lock "da52ecfa-51e7-4578-9489-6878dfd2326f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:32:49 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-9e82c3f6-a219-4408-abbd-18c68c81977f req-9f0f4689-6015-4482-adfc-258e0ae3f465 service nova] Lock "da52ecfa-51e7-4578-9489-6878dfd2326f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:32:49 user nova-compute[75021]: DEBUG nova.compute.manager [req-9e82c3f6-a219-4408-abbd-18c68c81977f req-9f0f4689-6015-4482-adfc-258e0ae3f465 service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] No waiting events found dispatching network-vif-plugged-dc7d5029-e174-454a-a9fe-a30c2aeea2a2 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:32:49 user nova-compute[75021]: WARNING nova.compute.manager [req-9e82c3f6-a219-4408-abbd-18c68c81977f req-9f0f4689-6015-4482-adfc-258e0ae3f465 service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Received unexpected event network-vif-plugged-dc7d5029-e174-454a-a9fe-a30c2aeea2a2 for instance with vm_state building and task_state spawning.
Dec 06 07:32:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-6ae1646c-fe18-4db9-bd20-44b2bd1a9379 req-975dd2e3-b4b7-47a1-93bb-01b731aab4dc service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Received event network-vif-plugged-dc7d5029-e174-454a-a9fe-a30c2aeea2a2 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:32:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6ae1646c-fe18-4db9-bd20-44b2bd1a9379 req-975dd2e3-b4b7-47a1-93bb-01b731aab4dc service nova] Acquiring lock "da52ecfa-51e7-4578-9489-6878dfd2326f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:32:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6ae1646c-fe18-4db9-bd20-44b2bd1a9379 req-975dd2e3-b4b7-47a1-93bb-01b731aab4dc service nova] Lock "da52ecfa-51e7-4578-9489-6878dfd2326f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:32:51 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6ae1646c-fe18-4db9-bd20-44b2bd1a9379 req-975dd2e3-b4b7-47a1-93bb-01b731aab4dc service nova] Lock "da52ecfa-51e7-4578-9489-6878dfd2326f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:32:51 user nova-compute[75021]: DEBUG nova.compute.manager [req-6ae1646c-fe18-4db9-bd20-44b2bd1a9379 req-975dd2e3-b4b7-47a1-93bb-01b731aab4dc service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] No waiting events found dispatching network-vif-plugged-dc7d5029-e174-454a-a9fe-a30c2aeea2a2 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:32:51 user nova-compute[75021]: WARNING nova.compute.manager [req-6ae1646c-fe18-4db9-bd20-44b2bd1a9379 req-975dd2e3-b4b7-47a1-93bb-01b731aab4dc service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Received unexpected event network-vif-plugged-dc7d5029-e174-454a-a9fe-a30c2aeea2a2 for instance with vm_state building and task_state spawning.
Dec 06 07:32:51 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:32:51 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:32:52 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Instance spawned successfully.
Dec 06 07:32:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:32:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:32:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:32:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:32:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:32:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:32:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:32:52 user nova-compute[75021]: INFO nova.compute.manager [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Took 5.32 seconds to spawn the instance on the hypervisor.
Dec 06 07:32:52 user nova-compute[75021]: DEBUG nova.compute.manager [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:32:52 user nova-compute[75021]: INFO nova.compute.manager [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Took 15.78 seconds to build instance.
Dec 06 07:32:52 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-0c0767c9-f95a-4b72-aa35-e6d08890758d tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "da52ecfa-51e7-4578-9489-6878dfd2326f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.992s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:32:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:32:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:24 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:33:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:33:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:25 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:33:26 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:33:26 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:33:26 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:33:26 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:33:26 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8723MB free_disk=25.181201934814453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:33:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:33:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9a5de7b-2d11-466e-82f6-403eb7563824 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:33:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance da52ecfa-51e7-4578-9489-6878dfd2326f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:33:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:33:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:33:27 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:33:27 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:33:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:33:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:33:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:29 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:33:29 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:33:29 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:33:29 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:33:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-b9a5de7b-2d11-466e-82f6-403eb7563824" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:33:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-b9a5de7b-2d11-466e-82f6-403eb7563824" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:33:29 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:33:29 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid b9a5de7b-2d11-466e-82f6-403eb7563824 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:33:29 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Updating instance_info_cache with network_info: [{"id": "24f29474-2190-421e-a90e-d0b4eebe3e05", "address": "fa:16:3e:b0:77:84", "network": {"id": "8276ccdc-3c29-47e7-8530-e0642ba0502c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1656732734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1404fa8569b45ada8644119e5d1471a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f29474-21", "ovs_interfaceid": "24f29474-2190-421e-a90e-d0b4eebe3e05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:33:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-b9a5de7b-2d11-466e-82f6-403eb7563824" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:33:29 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:33:29 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "a3eb22e5-35f4-4744-839d-43ec60924f61" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:33:30 user nova-compute[75021]: INFO nova.compute.manager [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Unshelving
Dec 06 07:33:30 user nova-compute[75021]: INFO nova.virt.block_device [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Booting with volume eaae6975-a767-4a01-9dfd-cac33b122195 at /dev/vda
Dec 06 07:33:30 user nova-compute[75021]: DEBUG os_brick.utils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[590b3c8a-7e91-476a-a123-21e7c68c290b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fa6f64-4197-4cc4-a1ac-01f316f0c554]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[662fbb61-2707-4663-9020-1b62b2c19c41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2073f69b-2c37-460c-84e6-f1b665113efc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:33:30 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:33:30 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b3657c-22be-46a7-b9f2-2c1862fa167f]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG os_brick.utils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:33:30 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updating existing volume attachment record: 626df802-9ea8-4fb4-8c96-a277e2060a71 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:33:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:33:37 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:33:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:33:39 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lazy-loading 'pci_requests' on Instance uuid a3eb22e5-35f4-4744-839d-43ec60924f61 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:33:39 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lazy-loading 'numa_topology' on Instance uuid a3eb22e5-35f4-4744-839d-43ec60924f61 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:33:39 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:33:39 user nova-compute[75021]: INFO nova.compute.claims [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Claim successful on node user
Dec 06 07:33:39 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:33:39 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:33:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.280s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:33:39 user nova-compute[75021]: INFO nova.network.neutron [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updating port 111f3897-75da-40d3-8f93-16f488ebc186 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquired lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-6de28a4f-3af4-43b1-a969-34fb21e4d859 req-04cb8e0b-25e8-41c7-b36e-53b8dc3b222c service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received event network-changed-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.compute.manager [req-6de28a4f-3af4-43b1-a969-34fb21e4d859 req-04cb8e0b-25e8-41c7-b36e-53b8dc3b222c service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Refreshing instance network info cache due to event network-changed-111f3897-75da-40d3-8f93-16f488ebc186. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6de28a4f-3af4-43b1-a969-34fb21e4d859 req-04cb8e0b-25e8-41c7-b36e-53b8dc3b222c service nova] Acquiring lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updating instance_info_cache with network_info: [{"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Releasing lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:33:40 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Creating image(s)
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Ensure instance console log exists: /opt/stack/data/nova/instances/a3eb22e5-35f4-4744-839d-43ec60924f61/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Start _get_guest_xml network_info=[{"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '626df802-9ea8-4fb4-8c96-a277e2060a71', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEYJrPBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3eb22e5-35f4-4744-839d-43ec60924f61', 'attached_at': '', 'detached_at': '', 'volume_id': 'eaae6975-a767-4a01-9dfd-cac33b122195', 'serial': 'eaae6975-a767-4a01-9dfd-cac33b122195'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6de28a4f-3af4-43b1-a969-34fb21e4d859 req-04cb8e0b-25e8-41c7-b36e-53b8dc3b222c service nova] Acquired lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-6de28a4f-3af4-43b1-a969-34fb21e4d859 req-04cb8e0b-25e8-41c7-b36e-53b8dc3b222c service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Refreshing network info cache for port 111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:33:40 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:33:40 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lazy-loading 'vcpu_model' on Instance uuid a3eb22e5-35f4-4744-839d-43ec60924f61 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.objects.base [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Object Instance<a3eb22e5-35f4-4744-839d-43ec60924f61> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEYJrPBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:33:40 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:33:40 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:33:40 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3be960-5fb7-4f9c-800a-90fc473f60f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:33:40 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5808f31-5a8f-4e72-94d6-52a8be12533f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195] added
Dec 06 07:33:40 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[647acfff-423d-4e9d-b710-56766738d871]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c2877f-c949-4e0e-a2ec-77f840690518]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eEYJrPBM {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eEYJrPBM" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc270fd-fb29-4464-830a-a99dd4e10d65]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eEYJrPBM'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8c94e9-9e46-4288-a106-7e0ae39b21a2]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[788a6d3b-aa65-4d9e-9861-c2d317d51852]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:33:40 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:33:40 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[358ead85-3a3f-45c3-871d-b69fcb846bf9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260]
Dec 06 07:33:40 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260] successful.
Dec 06 07:33:40 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cd0e3b-c459-49d4-95d5-235bd7ee3b59]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e226743-395b-4905-9736-bcf286be9702]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:33:40 user nova-compute[75021]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:33:40 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:33:40 user nova-compute[75021]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:33:40 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccafb0a1-e9d1-4351-ae23-5b1822000167]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-6de28a4f-3af4-43b1-a969-34fb21e4d859 req-04cb8e0b-25e8-41c7-b36e-53b8dc3b222c service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updated VIF entry in instance network info cache for port 111f3897-75da-40d3-8f93-16f488ebc186. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG nova.network.neutron [req-6de28a4f-3af4-43b1-a969-34fb21e4d859 req-04cb8e0b-25e8-41c7-b36e-53b8dc3b222c service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updating instance_info_cache with network_info: [{"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:33:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-6de28a4f-3af4-43b1-a969-34fb21e4d859 req-04cb8e0b-25e8-41c7-b36e-53b8dc3b222c service nova] Releasing lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEYJrPBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23937656333383233', 'path': '/dev/sdc'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937656333383233', 'path': '/dev/sdc'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T07:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1240073608',display_name='tempest-TestShelveInstance-server-1240073608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1240073608',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-653132316',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:30:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='49736ca5cec543bdabc53604c9020f89',ramdisk_id='',reservation_id='r-c68wuuhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1793737621',owner_user_name='tempest-TestShelveInstance-1793737621-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:33:30Z,user_data=None,user_id='f6279516fe514203950a2d0280e73417',uuid=a3eb22e5-35f4-4744-839d-43ec60924f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Converting VIF {"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:11:35,bridge_name='br-int',has_traffic_filtering=True,id=111f3897-75da-40d3-8f93-16f488ebc186,network=Network(8f13b891-c697-40d0-b740-4f0acd72d60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f3897-75') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lazy-loading 'pci_devices' on Instance uuid a3eb22e5-35f4-4744-839d-43ec60924f61 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG nova.objects.base [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Object Instance<a3eb22e5-35f4-4744-839d-43ec60924f61> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75021) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:33:41 user nova-compute[75021]:   <uuid>a3eb22e5-35f4-4744-839d-43ec60924f61</uuid>
Dec 06 07:33:41 user nova-compute[75021]:   <name>instance-00000030</name>
Dec 06 07:33:41 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:33:41 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:33:41 user nova-compute[75021]:   <metadata>
Dec 06 07:33:41 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:33:41 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:33:41 user nova-compute[75021]:       <nova:name>tempest-TestShelveInstance-server-1240073608</nova:name>
Dec 06 07:33:41 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:33:40</nova:creationTime>
Dec 06 07:33:41 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:33:41 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:33:41 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:33:41 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:33:41 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:33:41 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:33:41 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:33:41 user nova-compute[75021]:       <nova:owner>
Dec 06 07:33:41 user nova-compute[75021]:         <nova:user uuid="f6279516fe514203950a2d0280e73417">tempest-TestShelveInstance-1793737621-project-member</nova:user>
Dec 06 07:33:41 user nova-compute[75021]:         <nova:project uuid="49736ca5cec543bdabc53604c9020f89">tempest-TestShelveInstance-1793737621</nova:project>
Dec 06 07:33:41 user nova-compute[75021]:       </nova:owner>
Dec 06 07:33:41 user nova-compute[75021]:       <nova:ports>
Dec 06 07:33:41 user nova-compute[75021]:         <nova:port uuid="111f3897-75da-40d3-8f93-16f488ebc186">
Dec 06 07:33:41 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 06 07:33:41 user nova-compute[75021]:         </nova:port>
Dec 06 07:33:41 user nova-compute[75021]:       </nova:ports>
Dec 06 07:33:41 user nova-compute[75021]:     </nova:instance>
Dec 06 07:33:41 user nova-compute[75021]:   </metadata>
Dec 06 07:33:41 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:33:41 user nova-compute[75021]:     <system>
Dec 06 07:33:41 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:33:41 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:33:41 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:33:41 user nova-compute[75021]:       <entry name="serial">a3eb22e5-35f4-4744-839d-43ec60924f61</entry>
Dec 06 07:33:41 user nova-compute[75021]:       <entry name="uuid">a3eb22e5-35f4-4744-839d-43ec60924f61</entry>
Dec 06 07:33:41 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:33:41 user nova-compute[75021]:     </system>
Dec 06 07:33:41 user nova-compute[75021]:   </sysinfo>
Dec 06 07:33:41 user nova-compute[75021]:   <os>
Dec 06 07:33:41 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:33:41 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:33:41 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:33:41 user nova-compute[75021]:   </os>
Dec 06 07:33:41 user nova-compute[75021]:   <features>
Dec 06 07:33:41 user nova-compute[75021]:     <acpi/>
Dec 06 07:33:41 user nova-compute[75021]:     <apic/>
Dec 06 07:33:41 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:33:41 user nova-compute[75021]:   </features>
Dec 06 07:33:41 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:33:41 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:33:41 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:33:41 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:33:41 user nova-compute[75021]:   </clock>
Dec 06 07:33:41 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:33:41 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:33:41 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:33:41 user nova-compute[75021]:   </cpu>
Dec 06 07:33:41 user nova-compute[75021]:   <devices>
Dec 06 07:33:41 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:33:41 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:33:41 user nova-compute[75021]:       <source dev="/dev/sdc"/>
Dec 06 07:33:41 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:33:41 user nova-compute[75021]:       <serial>eaae6975-a767-4a01-9dfd-cac33b122195</serial>
Dec 06 07:33:41 user nova-compute[75021]:     </disk>
Dec 06 07:33:41 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:33:41 user nova-compute[75021]:       <mac address="fa:16:3e:03:11:35"/>
Dec 06 07:33:41 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:33:41 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:33:41 user nova-compute[75021]:       <target dev="tap111f3897-75"/>
Dec 06 07:33:41 user nova-compute[75021]:     </interface>
Dec 06 07:33:41 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:33:41 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/a3eb22e5-35f4-4744-839d-43ec60924f61/console.log" append="off"/>
Dec 06 07:33:41 user nova-compute[75021]:     </serial>
Dec 06 07:33:41 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:33:41 user nova-compute[75021]:     <video>
Dec 06 07:33:41 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:33:41 user nova-compute[75021]:     </video>
Dec 06 07:33:41 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:33:41 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:33:41 user nova-compute[75021]:     </rng>
Dec 06 07:33:41 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:33:41 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:33:41 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:33:41 user nova-compute[75021]:     </memballoon>
Dec 06 07:33:41 user nova-compute[75021]:   </devices>
Dec 06 07:33:41 user nova-compute[75021]: </domain>
Dec 06 07:33:41 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T07:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1240073608',display_name='tempest-TestShelveInstance-server-1240073608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1240073608',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-653132316',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:30:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='49736ca5cec543bdabc53604c9020f89',ramdisk_id='',reservation_id='r-c68wuuhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1793737621',owner_user_name='tempest-TestShelveInstance-1793737621-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:33:30Z,user_data=None,user_id='f6279516fe514203950a2d0280e73417',uuid=a3eb22e5-35f4-4744-839d-43ec60924f61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Converting VIF {"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:11:35,bridge_name='br-int',has_traffic_filtering=True,id=111f3897-75da-40d3-8f93-16f488ebc186,network=Network(8f13b891-c697-40d0-b740-4f0acd72d60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f3897-75') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG os_vif [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:11:35,bridge_name='br-int',has_traffic_filtering=True,id=111f3897-75da-40d3-8f93-16f488ebc186,network=Network(8f13b891-c697-40d0-b740-4f0acd72d60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f3897-75') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82c8361e-6071-57a9-b13a-9984f4a12f1a', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap111f3897-75, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap111f3897-75, col_values=(('qos', UUID('6d9a198e-dacb-4761-a80c-856ef2acce6d')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap111f3897-75, col_values=(('external_ids', {'iface-id': '111f3897-75da-40d3-8f93-16f488ebc186', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:11:35', 'vm-uuid': 'a3eb22e5-35f4-4744-839d-43ec60924f61'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:33:41 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:41 user nova-compute[75021]: INFO os_vif [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:11:35,bridge_name='br-int',has_traffic_filtering=True,id=111f3897-75da-40d3-8f93-16f488ebc186,network=Network(8f13b891-c697-40d0-b740-4f0acd72d60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f3897-75')
Dec 06 07:33:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:33:42 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] No VIF found with MAC fa:16:3e:03:11:35, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:33:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-4661178a-13da-4802-af76-c3831301f12b req-ece58f49-3d03-4c89-8e96-158bf0339b22 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received event network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:33:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4661178a-13da-4802-af76-c3831301f12b req-ece58f49-3d03-4c89-8e96-158bf0339b22 service nova] Acquiring lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:33:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4661178a-13da-4802-af76-c3831301f12b req-ece58f49-3d03-4c89-8e96-158bf0339b22 service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:33:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4661178a-13da-4802-af76-c3831301f12b req-ece58f49-3d03-4c89-8e96-158bf0339b22 service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:33:43 user nova-compute[75021]: DEBUG nova.compute.manager [req-4661178a-13da-4802-af76-c3831301f12b req-ece58f49-3d03-4c89-8e96-158bf0339b22 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] No waiting events found dispatching network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:33:43 user nova-compute[75021]: WARNING nova.compute.manager [req-4661178a-13da-4802-af76-c3831301f12b req-ece58f49-3d03-4c89-8e96-158bf0339b22 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received unexpected event network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 06 07:33:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:33:45 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:33:45 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Instance spawned successfully.
Dec 06 07:33:45 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:33:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b4e4b78a-65be-42c9-be5a-f80a84968187 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.232s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:33:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-614ca1f5-1a49-4527-b46e-db19cefa64c6 req-156cfa24-1e2b-4456-9891-b589934fe868 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received event network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:33:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-614ca1f5-1a49-4527-b46e-db19cefa64c6 req-156cfa24-1e2b-4456-9891-b589934fe868 service nova] Acquiring lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:33:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-614ca1f5-1a49-4527-b46e-db19cefa64c6 req-156cfa24-1e2b-4456-9891-b589934fe868 service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:33:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-614ca1f5-1a49-4527-b46e-db19cefa64c6 req-156cfa24-1e2b-4456-9891-b589934fe868 service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:33:45 user nova-compute[75021]: DEBUG nova.compute.manager [req-614ca1f5-1a49-4527-b46e-db19cefa64c6 req-156cfa24-1e2b-4456-9891-b589934fe868 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] No waiting events found dispatching network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:33:45 user nova-compute[75021]: WARNING nova.compute.manager [req-614ca1f5-1a49-4527-b46e-db19cefa64c6 req-156cfa24-1e2b-4456-9891-b589934fe868 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received unexpected event network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 for instance with vm_state active and task_state None.
Dec 06 07:33:46 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:51 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:33:56 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:33:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:01 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:25 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:34:25 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:34:26 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:34:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:34:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:34:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:34:26 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:34:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:34:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:34:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:34:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:34:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:34:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:34:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:27 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:34:27 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:34:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8691MB free_disk=25.17932891845703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:34:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:34:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:34:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance b9a5de7b-2d11-466e-82f6-403eb7563824 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:34:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance da52ecfa-51e7-4578-9489-6878dfd2326f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:34:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance a3eb22e5-35f4-4744-839d-43ec60924f61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:34:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:34:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:34:27 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:34:27 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:34:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:34:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-c7759372-dabf-418b-8fe0-92e4051cbbdf req-f9d4696a-bfd4-4f06-af9d-991f6b18c97c service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Received event network-changed-dc7d5029-e174-454a-a9fe-a30c2aeea2a2 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG nova.compute.manager [req-c7759372-dabf-418b-8fe0-92e4051cbbdf req-f9d4696a-bfd4-4f06-af9d-991f6b18c97c service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Refreshing instance network info cache due to event network-changed-dc7d5029-e174-454a-a9fe-a30c2aeea2a2. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c7759372-dabf-418b-8fe0-92e4051cbbdf req-f9d4696a-bfd4-4f06-af9d-991f6b18c97c service nova] Acquiring lock "refresh_cache-da52ecfa-51e7-4578-9489-6878dfd2326f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c7759372-dabf-418b-8fe0-92e4051cbbdf req-f9d4696a-bfd4-4f06-af9d-991f6b18c97c service nova] Acquired lock "refresh_cache-da52ecfa-51e7-4578-9489-6878dfd2326f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG nova.network.neutron [req-c7759372-dabf-418b-8fe0-92e4051cbbdf req-f9d4696a-bfd4-4f06-af9d-991f6b18c97c service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Refreshing network info cache for port dc7d5029-e174-454a-a9fe-a30c2aeea2a2 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-da52ecfa-51e7-4578-9489-6878dfd2326f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "da52ecfa-51e7-4578-9489-6878dfd2326f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "da52ecfa-51e7-4578-9489-6878dfd2326f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "da52ecfa-51e7-4578-9489-6878dfd2326f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "da52ecfa-51e7-4578-9489-6878dfd2326f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "da52ecfa-51e7-4578-9489-6878dfd2326f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:34:28 user nova-compute[75021]: INFO nova.compute.manager [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Terminating instance
Dec 06 07:34:28 user nova-compute[75021]: DEBUG nova.compute.manager [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG nova.network.neutron [req-c7759372-dabf-418b-8fe0-92e4051cbbdf req-f9d4696a-bfd4-4f06-af9d-991f6b18c97c service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Updated VIF entry in instance network info cache for port dc7d5029-e174-454a-a9fe-a30c2aeea2a2. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG nova.network.neutron [req-c7759372-dabf-418b-8fe0-92e4051cbbdf req-f9d4696a-bfd4-4f06-af9d-991f6b18c97c service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Updating instance_info_cache with network_info: [{"id": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "address": "fa:16:3e:9c:3d:fa", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7d5029-e1", "ovs_interfaceid": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c7759372-dabf-418b-8fe0-92e4051cbbdf req-f9d4696a-bfd4-4f06-af9d-991f6b18c97c service nova] Releasing lock "refresh_cache-da52ecfa-51e7-4578-9489-6878dfd2326f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-da52ecfa-51e7-4578-9489-6878dfd2326f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-150d41c9-2c67-44f6-a183-f49fea944a1a req-674fcb45-7d83-4d4a-bc86-9d8bde17805b service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Received event network-vif-unplugged-dc7d5029-e174-454a-a9fe-a30c2aeea2a2 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-150d41c9-2c67-44f6-a183-f49fea944a1a req-674fcb45-7d83-4d4a-bc86-9d8bde17805b service nova] Acquiring lock "da52ecfa-51e7-4578-9489-6878dfd2326f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-150d41c9-2c67-44f6-a183-f49fea944a1a req-674fcb45-7d83-4d4a-bc86-9d8bde17805b service nova] Lock "da52ecfa-51e7-4578-9489-6878dfd2326f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-150d41c9-2c67-44f6-a183-f49fea944a1a req-674fcb45-7d83-4d4a-bc86-9d8bde17805b service nova] Lock "da52ecfa-51e7-4578-9489-6878dfd2326f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-150d41c9-2c67-44f6-a183-f49fea944a1a req-674fcb45-7d83-4d4a-bc86-9d8bde17805b service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] No waiting events found dispatching network-vif-unplugged-dc7d5029-e174-454a-a9fe-a30c2aeea2a2 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-150d41c9-2c67-44f6-a183-f49fea944a1a req-674fcb45-7d83-4d4a-bc86-9d8bde17805b service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Received event network-vif-unplugged-dc7d5029-e174-454a-a9fe-a30c2aeea2a2 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:29 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Instance destroyed successfully.
Dec 06 07:34:29 user nova-compute[75021]: DEBUG nova.objects.instance [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lazy-loading 'resources' on Instance uuid da52ecfa-51e7-4578-9489-6878dfd2326f {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:32:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-130496791',display_name='tempest-TestVolumeBootPattern-server-130496791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-130496791',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/q672ydb0gw8Top+rrysEwxQ79bw8IIbuqy7QFDIbXz/tZqH3LZLi824RQ6QLVj2ALmCEvtH1vqGA5G+ngr0orlUWhzvqZziUCTzoOwBaRmBqojvNQQcSbs90EuLDeQQ==',key_name='tempest-TestVolumeBootPattern-943306452',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:32:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-6psfuova',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:32:52Z,user_data=None,user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=da52ecfa-51e7-4578-9489-6878dfd2326f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "address": "fa:16:3e:9c:3d:fa", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7d5029-e1", "ovs_interfaceid": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "address": "fa:16:3e:9c:3d:fa", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7d5029-e1", "ovs_interfaceid": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:3d:fa,bridge_name='br-int',has_traffic_filtering=True,id=dc7d5029-e174-454a-a9fe-a30c2aeea2a2,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7d5029-e1') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_vif [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:3d:fa,bridge_name='br-int',has_traffic_filtering=True,id=dc7d5029-e174-454a-a9fe-a30c2aeea2a2,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7d5029-e1') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc7d5029-e1, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a4e8da3-fa6f-40a8-845f-c87c90b6eb25) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:34:29 user nova-compute[75021]: INFO os_vif [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:3d:fa,bridge_name='br-int',has_traffic_filtering=True,id=dc7d5029-e174-454a-a9fe-a30c2aeea2a2,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc7d5029-e1')
Dec 06 07:34:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tERBKjyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:34:29 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Updating instance_info_cache with network_info: [{"id": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "address": "fa:16:3e:9c:3d:fa", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc7d5029-e1", "ovs_interfaceid": "dc7d5029-e174-454a-a9fe-a30c2aeea2a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-da52ecfa-51e7-4578-9489-6878dfd2326f" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b08a4f8-27ad-4c67-9b35-721889dfbe18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:34:29 user nova-compute[75021]: No targets found.
Dec 06 07:34:29 user nova-compute[75021]: iSNS:
Dec 06 07:34:29 user nova-compute[75021]: No targets found.
Dec 06 07:34:29 user nova-compute[75021]: STATIC:
Dec 06 07:34:29 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195
Dec 06 07:34:29 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:34:29 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:34:29 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab
Dec 06 07:34:29 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:34:29 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:34:29 user nova-compute[75021]: FIRMWARE:
Dec 06 07:34:29 user nova-compute[75021]: No targets found.
Dec 06 07:34:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:34:29 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:34:29 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f495b0d-10c0-429f-b4b6-d675ba481aca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[695092be-383b-4f00-ac27-cb92b2e077ad]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:34:29 user nova-compute[75021]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:34:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:34:29 user nova-compute[75021]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:34:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b46293f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd32dfe-e851-45d9-899f-3ce4b7d0644e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f200c0-47b6-4b1e-96b0-6526ef3f8f0e]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90a6ba0-78ce-4480-88ee-64953da30286]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03d0105-9720-4476-b039-9b78ea2821b9]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_22d5baeb', '/dev/disk/by-id/scsi-26533366137633936', '/dev/disk/by-id/scsi-1SCST_BIO22d5baeb-e36a7c963d0cb0ec') {{(pid=86148) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 07:34:29 user nova-compute[75021]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_22d5baeb
Dec 06 07:34:29 user nova-compute[75021]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26533366137633936
Dec 06 07:34:29 user nova-compute[75021]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO22d5baeb-e36a7c963d0cb0ec
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae2dffd-a57c-492d-9761-c2ea24590ed6]: (4, None) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7932ec7-a66c-4e08-a8bf-389915f3af54]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Acquiring lock "b9a5de7b-2d11-466e-82f6-403eb7563824" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "b9a5de7b-2d11-466e-82f6-403eb7563824" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Acquiring lock "b9a5de7b-2d11-466e-82f6-403eb7563824-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "b9a5de7b-2d11-466e-82f6-403eb7563824-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "b9a5de7b-2d11-466e-82f6-403eb7563824-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8d545b-8e37-49e9-bc05-97721ca0cdd4]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260]
Dec 06 07:34:29 user nova-compute[75021]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260] successful.
Dec 06 07:34:29 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:34:29 user nova-compute[75021]: INFO nova.compute.manager [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Terminating instance
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG nova.compute.manager [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85779a6-0ddf-4aef-9f04-8d407aa7bb8e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== disconnect_volume: return (356ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:34:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:34:29 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Deleting instance files /opt/stack/data/nova/instances/da52ecfa-51e7-4578-9489-6878dfd2326f_del
Dec 06 07:34:29 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Deletion of /opt/stack/data/nova/instances/da52ecfa-51e7-4578-9489-6878dfd2326f_del complete
Dec 06 07:34:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:30 user nova-compute[75021]: INFO nova.compute.manager [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Took 1.24 seconds to destroy the instance on the hypervisor.
Dec 06 07:34:30 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:34:30 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Instance destroyed successfully.
Dec 06 07:34:30 user nova-compute[75021]: DEBUG nova.objects.instance [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lazy-loading 'resources' on Instance uuid b9a5de7b-2d11-466e-82f6-403eb7563824 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-313407973',display_name='tempest-VolumesActionsTest-instance-313407973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-313407973',id=49,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:32:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1404fa8569b45ada8644119e5d1471a',ramdisk_id='',reservation_id='r-mdr9ghzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2000478144',owner_user_name='tempest-VolumesActionsTest-2000478144-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:32:38Z,user_data=None,user_id='a104a819b39c4db7b5168d6828665ebd',uuid=b9a5de7b-2d11-466e-82f6-403eb7563824,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24f29474-2190-421e-a90e-d0b4eebe3e05", "address": "fa:16:3e:b0:77:84", "network": {"id": "8276ccdc-3c29-47e7-8530-e0642ba0502c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1656732734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1404fa8569b45ada8644119e5d1471a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f29474-21", "ovs_interfaceid": "24f29474-2190-421e-a90e-d0b4eebe3e05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Converting VIF {"id": "24f29474-2190-421e-a90e-d0b4eebe3e05", "address": "fa:16:3e:b0:77:84", "network": {"id": "8276ccdc-3c29-47e7-8530-e0642ba0502c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1656732734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1404fa8569b45ada8644119e5d1471a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f29474-21", "ovs_interfaceid": "24f29474-2190-421e-a90e-d0b4eebe3e05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:77:84,bridge_name='br-int',has_traffic_filtering=True,id=24f29474-2190-421e-a90e-d0b4eebe3e05,network=Network(8276ccdc-3c29-47e7-8530-e0642ba0502c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f29474-21') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG os_vif [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:77:84,bridge_name='br-int',has_traffic_filtering=True,id=24f29474-2190-421e-a90e-d0b4eebe3e05,network=Network(8276ccdc-3c29-47e7-8530-e0642ba0502c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f29474-21') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24f29474-21, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6333cd8c-7263-45fe-9ea2-98248301046b) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:30 user nova-compute[75021]: INFO os_vif [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:77:84,bridge_name='br-int',has_traffic_filtering=True,id=24f29474-2190-421e-a90e-d0b4eebe3e05,network=Network(8276ccdc-3c29-47e7-8530-e0642ba0502c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f29474-21')
Dec 06 07:34:30 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Deleting instance files /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824_del
Dec 06 07:34:30 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Deletion of /opt/stack/data/nova/instances/b9a5de7b-2d11-466e-82f6-403eb7563824_del complete
Dec 06 07:34:30 user nova-compute[75021]: INFO nova.compute.manager [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Took 0.69 seconds to destroy the instance on the hypervisor.
Dec 06 07:34:30 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:34:30 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:34:30 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Took 0.89 seconds to deallocate network for instance.
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Received event network-vif-plugged-dc7d5029-e174-454a-a9fe-a30c2aeea2a2 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] Acquiring lock "da52ecfa-51e7-4578-9489-6878dfd2326f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] Lock "da52ecfa-51e7-4578-9489-6878dfd2326f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] Lock "da52ecfa-51e7-4578-9489-6878dfd2326f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] No waiting events found dispatching network-vif-plugged-dc7d5029-e174-454a-a9fe-a30c2aeea2a2 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:34:31 user nova-compute[75021]: WARNING nova.compute.manager [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Received unexpected event network-vif-plugged-dc7d5029-e174-454a-a9fe-a30c2aeea2a2 for instance with vm_state active and task_state deleting.
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Received event network-vif-unplugged-24f29474-2190-421e-a90e-d0b4eebe3e05 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] Acquiring lock "b9a5de7b-2d11-466e-82f6-403eb7563824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] Lock "b9a5de7b-2d11-466e-82f6-403eb7563824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] Lock "b9a5de7b-2d11-466e-82f6-403eb7563824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] No waiting events found dispatching network-vif-unplugged-24f29474-2190-421e-a90e-d0b4eebe3e05 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Received event network-vif-unplugged-24f29474-2190-421e-a90e-d0b4eebe3e05 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Received event network-vif-plugged-24f29474-2190-421e-a90e-d0b4eebe3e05 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] Acquiring lock "b9a5de7b-2d11-466e-82f6-403eb7563824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] Lock "b9a5de7b-2d11-466e-82f6-403eb7563824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] Lock "b9a5de7b-2d11-466e-82f6-403eb7563824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] No waiting events found dispatching network-vif-plugged-24f29474-2190-421e-a90e-d0b4eebe3e05 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:34:31 user nova-compute[75021]: WARNING nova.compute.manager [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Received unexpected event network-vif-plugged-24f29474-2190-421e-a90e-d0b4eebe3e05 for instance with vm_state active and task_state deleting.
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-d4383d7a-881f-489b-a331-7480e13699d8 req-ac7400d4-61a4-47a7-9fbd-e7c119bbd477 service nova] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Received event network-vif-deleted-dc7d5029-e174-454a-a9fe-a30c2aeea2a2 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:34:31 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Took 0.67 seconds to deallocate network for instance.
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-93840971-3131-47c1-abc2-bc89b4b9914f req-1ab7653b-2ea5-4817-8017-2864d7a4abdd service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Received event network-vif-deleted-24f29474-2190-421e-a90e-d0b4eebe3e05 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:34:31 user nova-compute[75021]: INFO nova.compute.manager [req-93840971-3131-47c1-abc2-bc89b4b9914f req-1ab7653b-2ea5-4817-8017-2864d7a4abdd service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Neutron deleted interface 24f29474-2190-421e-a90e-d0b4eebe3e05; detaching it from the instance and deleting it from the info cache
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.network.neutron [req-93840971-3131-47c1-abc2-bc89b4b9914f req-1ab7653b-2ea5-4817-8017-2864d7a4abdd service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-93840971-3131-47c1-abc2-bc89b4b9914f req-1ab7653b-2ea5-4817-8017-2864d7a4abdd service nova] [instance: b9a5de7b-2d11-466e-82f6-403eb7563824] Detach interface failed, port_id=24f29474-2190-421e-a90e-d0b4eebe3e05, reason: Instance b9a5de7b-2d11-466e-82f6-403eb7563824 could not be found. {{(pid=75021) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:34:31 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Deleted allocations for instance b9a5de7b-2d11-466e-82f6-403eb7563824
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-603b4ec1-1a27-4934-8470-865cdccc544c tempest-VolumesActionsTest-2000478144 tempest-VolumesActionsTest-2000478144-project-member] Lock "b9a5de7b-2d11-466e-82f6-403eb7563824" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.746s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:34:31 user nova-compute[75021]: INFO nova.compute.manager [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: da52ecfa-51e7-4578-9489-6878dfd2326f] Took 0.84 seconds to detach 1 volumes for instance.
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:34:31 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:34:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:34:32 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Deleted allocations for instance da52ecfa-51e7-4578-9489-6878dfd2326f
Dec 06 07:34:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-b85c1521-cd5e-422a-905c-d1199d88fc8e tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "da52ecfa-51e7-4578-9489-6878dfd2326f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.284s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:34:32 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:34:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:34:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:34:53 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:34:53 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:34:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Verify base images {{(pid=75021) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Dec 06 07:34:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75021) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 06 07:34:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] a3eb22e5-35f4-4744-839d-43ec60924f61 is a valid instance name {{(pid=75021) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 06 07:34:53 user nova-compute[75021]: WARNING nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Unknown base file: /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c
Dec 06 07:34:53 user nova-compute[75021]: WARNING nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Unknown base file: /opt/stack/data/nova/instances/_base/458e11fc59dadaeed9b7f08ee22ab01d7de9de1f
Dec 06 07:34:53 user nova-compute[75021]: WARNING nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381
Dec 06 07:34:53 user nova-compute[75021]: WARNING nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Unknown base file: /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a
Dec 06 07:34:53 user nova-compute[75021]: WARNING nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162
Dec 06 07:34:53 user nova-compute[75021]: WARNING nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Unknown base file: /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe
Dec 06 07:34:53 user nova-compute[75021]: WARNING nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b1dbf32e356372527665b8d54c855a85afabc471
Dec 06 07:34:53 user nova-compute[75021]: WARNING nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf
Dec 06 07:34:53 user nova-compute[75021]: WARNING nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d309896c33440fe0b28d4affd4373a57447bb3c3
Dec 06 07:34:53 user nova-compute[75021]: WARNING nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb
Dec 06 07:34:53 user nova-compute[75021]: INFO nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Removable base files: /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c /opt/stack/data/nova/instances/_base/458e11fc59dadaeed9b7f08ee22ab01d7de9de1f /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381 /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162 /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe /opt/stack/data/nova/instances/_base/b1dbf32e356372527665b8d54c855a85afabc471 /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf /opt/stack/data/nova/instances/_base/d309896c33440fe0b28d4affd4373a57447bb3c3 /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb
Dec 06 07:34:53 user nova-compute[75021]: INFO nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/060c3645ceb56f97ba508563abf4ce3f86defc7c
Dec 06 07:34:53 user nova-compute[75021]: INFO nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/458e11fc59dadaeed9b7f08ee22ab01d7de9de1f
Dec 06 07:34:53 user nova-compute[75021]: INFO nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bd50aeab4a3797cd8395dc356902a3f79e792381
Dec 06 07:34:53 user nova-compute[75021]: INFO nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/52bffbf57eb4dae6e0279ec0d5930ae1c24ab61a
Dec 06 07:34:53 user nova-compute[75021]: INFO nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2f28ebb93a3f275980cd87fc21b98eef76d84162
Dec 06 07:34:53 user nova-compute[75021]: INFO nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe
Dec 06 07:34:53 user nova-compute[75021]: INFO nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b1dbf32e356372527665b8d54c855a85afabc471
Dec 06 07:34:53 user nova-compute[75021]: INFO nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f47d4fc1720a6ebd0700a0e7a71a96c3d965d9cf
Dec 06 07:34:53 user nova-compute[75021]: INFO nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d309896c33440fe0b28d4affd4373a57447bb3c3
Dec 06 07:34:53 user nova-compute[75021]: INFO nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dd9a31b5146134da3f18ae3752e4b747b23a34bb
Dec 06 07:34:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Verification complete {{(pid=75021) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Dec 06 07:34:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Verify swap images {{(pid=75021) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Dec 06 07:34:53 user nova-compute[75021]: DEBUG nova.virt.libvirt.imagecache [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Verify ephemeral images {{(pid=75021) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Dec 06 07:34:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "5b940840-1ebf-4022-8799-5353032e02b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "5b940840-1ebf-4022-8799-5353032e02b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:35:21 user nova-compute[75021]: INFO nova.compute.claims [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Claim successful on node user
Dec 06 07:35:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-837c3c10-355c-4beb-839f-f767ebd15c11 req-8f93edaf-8029-4a3d-a02a-232b2d2c2739 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received event network-changed-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG nova.compute.manager [req-837c3c10-355c-4beb-839f-f767ebd15c11 req-8f93edaf-8029-4a3d-a02a-232b2d2c2739 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Refreshing instance network info cache due to event network-changed-111f3897-75da-40d3-8f93-16f488ebc186. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-837c3c10-355c-4beb-839f-f767ebd15c11 req-8f93edaf-8029-4a3d-a02a-232b2d2c2739 service nova] Acquiring lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-837c3c10-355c-4beb-839f-f767ebd15c11 req-8f93edaf-8029-4a3d-a02a-232b2d2c2739 service nova] Acquired lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG nova.network.neutron [req-837c3c10-355c-4beb-839f-f767ebd15c11 req-8f93edaf-8029-4a3d-a02a-232b2d2c2739 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Refreshing network info cache for port 111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "a3eb22e5-35f4-4744-839d-43ec60924f61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:35:21 user nova-compute[75021]: INFO nova.compute.manager [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Terminating instance
Dec 06 07:35:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:35:21 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:35:21 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:35:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:35:22 user nova-compute[75021]: INFO nova.virt.block_device [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Booting with volume 375fa659-89c5-4c1d-a11d-6d3a354dcbab at /dev/vda
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.policy [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b39552dec3964bf69ed87b5ca130fe5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddfde019af4962929aa2c8cfa84b35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-80dbf94e-95c5-4691-884f-0c1c4c0dd45e req-51835b64-18de-4c40-9851-3f6b4ddb12a2 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received event network-vif-unplugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dbf94e-95c5-4691-884f-0c1c4c0dd45e req-51835b64-18de-4c40-9851-3f6b4ddb12a2 service nova] Acquiring lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dbf94e-95c5-4691-884f-0c1c4c0dd45e req-51835b64-18de-4c40-9851-3f6b4ddb12a2 service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-80dbf94e-95c5-4691-884f-0c1c4c0dd45e req-51835b64-18de-4c40-9851-3f6b4ddb12a2 service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-80dbf94e-95c5-4691-884f-0c1c4c0dd45e req-51835b64-18de-4c40-9851-3f6b4ddb12a2 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] No waiting events found dispatching network-vif-unplugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.compute.manager [req-80dbf94e-95c5-4691-884f-0c1c4c0dd45e req-51835b64-18de-4c40-9851-3f6b4ddb12a2 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received event network-vif-unplugged-111f3897-75da-40d3-8f93-16f488ebc186 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.utils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f47f3e-fd25-4b41-a879-0f2149fa5c5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2738d7-cfce-47ae-8fc9-f38211420ff4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fc2d05-27de-4497-bff5-33c8f03e2942]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c84f6c7-68a5-4b10-8f42-1a6f003cf64a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.network.neutron [req-837c3c10-355c-4beb-839f-f767ebd15c11 req-8f93edaf-8029-4a3d-a02a-232b2d2c2739 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updated VIF entry in instance network info cache for port 111f3897-75da-40d3-8f93-16f488ebc186. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.network.neutron [req-837c3c10-355c-4beb-839f-f767ebd15c11 req-8f93edaf-8029-4a3d-a02a-232b2d2c2739 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updating instance_info_cache with network_info: [{"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-837c3c10-355c-4beb-839f-f767ebd15c11 req-8f93edaf-8029-4a3d-a02a-232b2d2c2739 service nova] Releasing lock "refresh_cache-a3eb22e5-35f4-4744-839d-43ec60924f61" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:35:22 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[87aacba5-818b-4089-9471-400a8f2e9861]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.utils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Updating existing volume attachment record: 4ff33f9b-1717-4b50-bc83-5b31cc9b6751 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Instance destroyed successfully.
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.objects.instance [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lazy-loading 'resources' on Instance uuid a3eb22e5-35f4-4744-839d-43ec60924f61 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-06T07:29:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1240073608',display_name='tempest-TestShelveInstance-server-1240073608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1240073608',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxWWL9DEGMhocr6FZ6ZRC+Kdexb5fj22tvA2GdaTwKeGacHxJCWmeZXYpSmdKbqozYlvixSIpxPkdNk/oynj9aZdPCApw+s9E8GF1Fw0o/gHXsz54DIinIrx/AW8UaWZw==',key_name='tempest-TestShelveInstance-653132316',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:33:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49736ca5cec543bdabc53604c9020f89',ramdisk_id='',reservation_id='r-c68wuuhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1793737621',owner_user_name='tempest-TestShelveInstance-1793737621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:33:45Z,user_data=None,user_id='f6279516fe514203950a2d0280e73417',uuid=a3eb22e5-35f4-4744-839d-43ec60924f61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Converting VIF {"id": "111f3897-75da-40d3-8f93-16f488ebc186", "address": "fa:16:3e:03:11:35", "network": {"id": "8f13b891-c697-40d0-b740-4f0acd72d60f", "bridge": "br-int", "label": "tempest-TestShelveInstance-155521937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49736ca5cec543bdabc53604c9020f89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap111f3897-75", "ovs_interfaceid": "111f3897-75da-40d3-8f93-16f488ebc186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:11:35,bridge_name='br-int',has_traffic_filtering=True,id=111f3897-75da-40d3-8f93-16f488ebc186,network=Network(8f13b891-c697-40d0-b740-4f0acd72d60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f3897-75') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_vif [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:11:35,bridge_name='br-int',has_traffic_filtering=True,id=111f3897-75da-40d3-8f93-16f488ebc186,network=Network(8f13b891-c697-40d0-b740-4f0acd72d60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f3897-75') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap111f3897-75, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d9a198e-dacb-4761-a80c-856ef2acce6d) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:35:22 user nova-compute[75021]: INFO os_vif [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:11:35,bridge_name='br-int',has_traffic_filtering=True,id=111f3897-75da-40d3-8f93-16f488ebc186,network=Network(8f13b891-c697-40d0-b740-4f0acd72d60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap111f3897-75')
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eEYJrPBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:35:22 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff71301e-4116-49a3-9462-fce0d93a8748]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:35:22 user nova-compute[75021]: No targets found.
Dec 06 07:35:22 user nova-compute[75021]: iSNS:
Dec 06 07:35:22 user nova-compute[75021]: No targets found.
Dec 06 07:35:22 user nova-compute[75021]: STATIC:
Dec 06 07:35:22 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195
Dec 06 07:35:22 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:35:22 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:35:22 user nova-compute[75021]: FIRMWARE:
Dec 06 07:35:22 user nova-compute[75021]: No targets found.
Dec 06 07:35:22 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:35:22 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:35:22 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ef3e3d-abe3-4501-93b7-bfad949cb743]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89da12c-5df7-4f95-9415-a29424622524]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:35:22 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 (non-flash)
Dec 06 07:35:22 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b46e6950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195'): ({'sdc'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Removing single pathed devices sdc {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d827cfc-781a-4626-8888-54c79ce6a613]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f67717-d249-4b72-b7ff-ffcf2360de5f]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Flushing IO for device /dev/sdc {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[558f2b48-c54e-40ae-b5bd-a4917b5bdf0f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d69b4b0-8d47-4d77-aeb0-2ff591096324]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOcfb42a1b-97ec38231b43677b', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cfb42a1b', '/dev/disk/by-id/scsi-23937656333383233') {{(pid=86148) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5aacf8-ccbd-47ef-8ad3-0429abe55f4e]: (4, None) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd7da5b-ab15-4809-9111-de329d3fad10]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Successfully created port: fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef97004-ffa8-4dd7-8b45-da08e0acbe6f]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260]
Dec 06 07:35:22 user nova-compute[75021]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195, portal: 172.16.0.220,3260] successful.
Dec 06 07:35:22 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaae6975-a767-4a01-9dfd-cac33b122195 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a071745-d9f3-44b6-8aed-40c92296d448]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] <== disconnect_volume: return (366ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:35:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Deleting instance files /opt/stack/data/nova/instances/a3eb22e5-35f4-4744-839d-43ec60924f61_del
Dec 06 07:35:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Deletion of /opt/stack/data/nova/instances/a3eb22e5-35f4-4744-839d-43ec60924f61_del complete
Dec 06 07:35:22 user nova-compute[75021]: INFO nova.compute.manager [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Took 1.26 seconds to destroy the instance on the hypervisor.
Dec 06 07:35:22 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:35:22 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:35:23 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:35:23 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Took 0.67 seconds to deallocate network for instance.
Dec 06 07:35:23 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Successfully updated port: fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:35:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:35:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquired lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:35:23 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:35:23 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:35:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-a6a48c44-d8a9-4a58-b625-88b7507c49ba req-81996fc3-8a8a-4116-9aef-bc2c9e1ecd97 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Received event network-changed-fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:35:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-a6a48c44-d8a9-4a58-b625-88b7507c49ba req-81996fc3-8a8a-4116-9aef-bc2c9e1ecd97 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Refreshing instance network info cache due to event network-changed-fc765828-eb23-4186-9f06-44f6f3179631. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:35:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a6a48c44-d8a9-4a58-b625-88b7507c49ba req-81996fc3-8a8a-4116-9aef-bc2c9e1ecd97 service nova] Acquiring lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG nova.network.neutron [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Updating instance_info_cache with network_info: [{"id": "fc765828-eb23-4186-9f06-44f6f3179631", "address": "fa:16:3e:0d:88:29", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc765828-eb", "ovs_interfaceid": "fc765828-eb23-4186-9f06-44f6f3179631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-dea2e3b7-c948-4064-b550-2675da5022e1 req-793aeee5-3464-475e-83fb-00149cbae1b8 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received event network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dea2e3b7-c948-4064-b550-2675da5022e1 req-793aeee5-3464-475e-83fb-00149cbae1b8 service nova] Acquiring lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dea2e3b7-c948-4064-b550-2675da5022e1 req-793aeee5-3464-475e-83fb-00149cbae1b8 service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dea2e3b7-c948-4064-b550-2675da5022e1 req-793aeee5-3464-475e-83fb-00149cbae1b8 service nova] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-dea2e3b7-c948-4064-b550-2675da5022e1 req-793aeee5-3464-475e-83fb-00149cbae1b8 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] No waiting events found dispatching network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:35:24 user nova-compute[75021]: WARNING nova.compute.manager [req-dea2e3b7-c948-4064-b550-2675da5022e1 req-793aeee5-3464-475e-83fb-00149cbae1b8 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received unexpected event network-vif-plugged-111f3897-75da-40d3-8f93-16f488ebc186 for instance with vm_state active and task_state deleting.
Dec 06 07:35:24 user nova-compute[75021]: DEBUG nova.compute.manager [req-dea2e3b7-c948-4064-b550-2675da5022e1 req-793aeee5-3464-475e-83fb-00149cbae1b8 service nova] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Received event network-vif-deleted-111f3897-75da-40d3-8f93-16f488ebc186 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Releasing lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Instance network_info: |[{"id": "fc765828-eb23-4186-9f06-44f6f3179631", "address": "fa:16:3e:0d:88:29", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc765828-eb", "ovs_interfaceid": "fc765828-eb23-4186-9f06-44f6f3179631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a6a48c44-d8a9-4a58-b625-88b7507c49ba req-81996fc3-8a8a-4116-9aef-bc2c9e1ecd97 service nova] Acquired lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG nova.network.neutron [req-a6a48c44-d8a9-4a58-b625-88b7507c49ba req-81996fc3-8a8a-4116-9aef-bc2c9e1ecd97 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Refreshing network info cache for port fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:35:24 user nova-compute[75021]: INFO nova.compute.manager [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Took 0.87 seconds to detach 1 volumes for instance.
Dec 06 07:35:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] [instance: a3eb22e5-35f4-4744-839d-43ec60924f61] Deleting volume: eaae6975-a767-4a01-9dfd-cac33b122195 {{(pid=75021) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG nova.network.neutron [req-a6a48c44-d8a9-4a58-b625-88b7507c49ba req-81996fc3-8a8a-4116-9aef-bc2c9e1ecd97 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Updated VIF entry in instance network info cache for port fc765828-eb23-4186-9f06-44f6f3179631. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG nova.network.neutron [req-a6a48c44-d8a9-4a58-b625-88b7507c49ba req-81996fc3-8a8a-4116-9aef-bc2c9e1ecd97 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Updating instance_info_cache with network_info: [{"id": "fc765828-eb23-4186-9f06-44f6f3179631", "address": "fa:16:3e:0d:88:29", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc765828-eb", "ovs_interfaceid": "fc765828-eb23-4186-9f06-44f6f3179631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a6a48c44-d8a9-4a58-b625-88b7507c49ba req-81996fc3-8a8a-4116-9aef-bc2c9e1ecd97 service nova] Releasing lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:35:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:35:24 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Deleted allocations for instance a3eb22e5-35f4-4744-839d-43ec60924f61
Dec 06 07:35:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c2d2f4d3-0157-426d-becd-73f0f4574d47 tempest-TestShelveInstance-1793737621 tempest-TestShelveInstance-1793737621-project-member] Lock "a3eb22e5-35f4-4744-839d-43ec60924f61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.193s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:35:25 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:35:25 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:35:26 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:35:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:35:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:35:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:35:26 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:35:26 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:35:26 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:35:26 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=9055MB free_disk=25.20547866821289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:35:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:35:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:35:26 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5b940840-1ebf-4022-8799-5353032e02b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:35:26 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:35:26 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:35:26 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:35:26 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:35:26 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:35:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:35:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:27 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:35:28 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:35:30 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:35:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:35:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:35:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Skipping network cache update for instance because it is Building. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 06 07:35:30 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:35:31 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Creating image(s)
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Ensure instance console log exists: /opt/stack/data/nova/instances/5b940840-1ebf-4022-8799-5353032e02b9/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Start _get_guest_xml network_info=[{"id": "fc765828-eb23-4186-9f06-44f6f3179631", "address": "fa:16:3e:0d:88:29", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc765828-eb", "ovs_interfaceid": "fc765828-eb23-4186-9f06-44f6f3179631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4ff33f9b-1717-4b50-bc83-5b31cc9b6751', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tERBKjyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b940840-1ebf-4022-8799-5353032e02b9', 'attached_at': '', 'detached_at': '', 'volume_id': '375fa659-89c5-4c1d-a11d-6d3a354dcbab', 'serial': '375fa659-89c5-4c1d-a11d-6d3a354dcbab'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:35:31 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:35:31 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tERBKjyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:35:31 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:35:31 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:35:31 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[084a7989-9292-4306-83e3-7dba27f7a93c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:35:31 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d2af2a-51a6-430c-8c29-a3b5dc5a0878]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab] added
Dec 06 07:35:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a941db3-471c-4c78-a868-0d48b7159a2f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[325e2d33-80f4-432d-bfb1-5d299f29ab92]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tERBKjyi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tERBKjyi" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8adebc-c0f3-41de-aa73-dc44757db26b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tERBKjyi'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf9ae89-aa85-4153-9aec-cb78a0e3ab53]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0a67d8-b6f0-4b26-94d6-cf0b92f19822]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:35:31 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:35:31 user nova-compute[75021]:  {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:35:31 user nova-compute[75021]: WARNING os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 07:35:31 user nova-compute[75021]: 
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[da634bc4-2eb1-4858-8a1b-e1b47dbbd55a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260]
Dec 06 07:35:31 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260] successful.
Dec 06 07:35:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f05e735-4b32-4068-aa2c-f269803e76ef]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b85c3c-e247-4e1b-af31-0b778489b195]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:35:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:35:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d2f06e-c8e5-4efe-8a36-73aad5585270]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:35:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:35:32 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:35:32 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:35:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:32 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:35:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tERBKjyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:35:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:35:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26533366137633936', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:35:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533366137633936', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:35:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:35:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-25893913',display_name='tempest-TestVolumeBootPattern-server-25893913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-25893913',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/q672ydb0gw8Top+rrysEwxQ79bw8IIbuqy7QFDIbXz/tZqH3LZLi824RQ6QLVj2ALmCEvtH1vqGA5G+ngr0orlUWhzvqZziUCTzoOwBaRmBqojvNQQcSbs90EuLDeQQ==',key_name='tempest-TestVolumeBootPattern-943306452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-f5swl675',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:35:22Z,user_data=None,user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=5b940840-1ebf-4022-8799-5353032e02b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc765828-eb23-4186-9f06-44f6f3179631", "address": "fa:16:3e:0d:88:29", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc765828-eb", "ovs_interfaceid": "fc765828-eb23-4186-9f06-44f6f3179631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:35:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "fc765828-eb23-4186-9f06-44f6f3179631", "address": "fa:16:3e:0d:88:29", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc765828-eb", "ovs_interfaceid": "fc765828-eb23-4186-9f06-44f6f3179631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:35:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:88:29,bridge_name='br-int',has_traffic_filtering=True,id=fc765828-eb23-4186-9f06-44f6f3179631,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc765828-eb') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:35:32 user nova-compute[75021]: DEBUG nova.objects.instance [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b940840-1ebf-4022-8799-5353032e02b9 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:35:33 user nova-compute[75021]:   <uuid>5b940840-1ebf-4022-8799-5353032e02b9</uuid>
Dec 06 07:35:33 user nova-compute[75021]:   <name>instance-00000033</name>
Dec 06 07:35:33 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:35:33 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:35:33 user nova-compute[75021]:   <metadata>
Dec 06 07:35:33 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:35:33 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:35:33 user nova-compute[75021]:       <nova:name>tempest-TestVolumeBootPattern-server-25893913</nova:name>
Dec 06 07:35:33 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:35:31</nova:creationTime>
Dec 06 07:35:33 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:35:33 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:35:33 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:35:33 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:35:33 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:35:33 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:35:33 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:35:33 user nova-compute[75021]:       <nova:owner>
Dec 06 07:35:33 user nova-compute[75021]:         <nova:user uuid="b39552dec3964bf69ed87b5ca130fe5f">tempest-TestVolumeBootPattern-1013845055-project-member</nova:user>
Dec 06 07:35:33 user nova-compute[75021]:         <nova:project uuid="00ddfde019af4962929aa2c8cfa84b35">tempest-TestVolumeBootPattern-1013845055</nova:project>
Dec 06 07:35:33 user nova-compute[75021]:       </nova:owner>
Dec 06 07:35:33 user nova-compute[75021]:       <nova:ports>
Dec 06 07:35:33 user nova-compute[75021]:         <nova:port uuid="fc765828-eb23-4186-9f06-44f6f3179631">
Dec 06 07:35:33 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 06 07:35:33 user nova-compute[75021]:         </nova:port>
Dec 06 07:35:33 user nova-compute[75021]:       </nova:ports>
Dec 06 07:35:33 user nova-compute[75021]:     </nova:instance>
Dec 06 07:35:33 user nova-compute[75021]:   </metadata>
Dec 06 07:35:33 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:35:33 user nova-compute[75021]:     <system>
Dec 06 07:35:33 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:35:33 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:35:33 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:35:33 user nova-compute[75021]:       <entry name="serial">5b940840-1ebf-4022-8799-5353032e02b9</entry>
Dec 06 07:35:33 user nova-compute[75021]:       <entry name="uuid">5b940840-1ebf-4022-8799-5353032e02b9</entry>
Dec 06 07:35:33 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:35:33 user nova-compute[75021]:     </system>
Dec 06 07:35:33 user nova-compute[75021]:   </sysinfo>
Dec 06 07:35:33 user nova-compute[75021]:   <os>
Dec 06 07:35:33 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:35:33 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:35:33 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:35:33 user nova-compute[75021]:   </os>
Dec 06 07:35:33 user nova-compute[75021]:   <features>
Dec 06 07:35:33 user nova-compute[75021]:     <acpi/>
Dec 06 07:35:33 user nova-compute[75021]:     <apic/>
Dec 06 07:35:33 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:35:33 user nova-compute[75021]:   </features>
Dec 06 07:35:33 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:35:33 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:35:33 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:35:33 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:35:33 user nova-compute[75021]:   </clock>
Dec 06 07:35:33 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:35:33 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:35:33 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:35:33 user nova-compute[75021]:   </cpu>
Dec 06 07:35:33 user nova-compute[75021]:   <devices>
Dec 06 07:35:33 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:35:33 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:35:33 user nova-compute[75021]:       <source dev="/dev/sdb"/>
Dec 06 07:35:33 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:35:33 user nova-compute[75021]:       <serial>375fa659-89c5-4c1d-a11d-6d3a354dcbab</serial>
Dec 06 07:35:33 user nova-compute[75021]:     </disk>
Dec 06 07:35:33 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:35:33 user nova-compute[75021]:       <mac address="fa:16:3e:0d:88:29"/>
Dec 06 07:35:33 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:35:33 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:35:33 user nova-compute[75021]:       <target dev="tapfc765828-eb"/>
Dec 06 07:35:33 user nova-compute[75021]:     </interface>
Dec 06 07:35:33 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:35:33 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/5b940840-1ebf-4022-8799-5353032e02b9/console.log" append="off"/>
Dec 06 07:35:33 user nova-compute[75021]:     </serial>
Dec 06 07:35:33 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:35:33 user nova-compute[75021]:     <video>
Dec 06 07:35:33 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:35:33 user nova-compute[75021]:     </video>
Dec 06 07:35:33 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:35:33 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:35:33 user nova-compute[75021]:     </rng>
Dec 06 07:35:33 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:35:33 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:35:33 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:35:33 user nova-compute[75021]:     </memballoon>
Dec 06 07:35:33 user nova-compute[75021]:   </devices>
Dec 06 07:35:33 user nova-compute[75021]: </domain>
Dec 06 07:35:33 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:35:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-25893913',display_name='tempest-TestVolumeBootPattern-server-25893913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-25893913',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/q672ydb0gw8Top+rrysEwxQ79bw8IIbuqy7QFDIbXz/tZqH3LZLi824RQ6QLVj2ALmCEvtH1vqGA5G+ngr0orlUWhzvqZziUCTzoOwBaRmBqojvNQQcSbs90EuLDeQQ==',key_name='tempest-TestVolumeBootPattern-943306452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-f5swl675',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:35:22Z,user_data=None,user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=5b940840-1ebf-4022-8799-5353032e02b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc765828-eb23-4186-9f06-44f6f3179631", "address": "fa:16:3e:0d:88:29", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc765828-eb", "ovs_interfaceid": "fc765828-eb23-4186-9f06-44f6f3179631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "fc765828-eb23-4186-9f06-44f6f3179631", "address": "fa:16:3e:0d:88:29", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc765828-eb", "ovs_interfaceid": "fc765828-eb23-4186-9f06-44f6f3179631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:88:29,bridge_name='br-int',has_traffic_filtering=True,id=fc765828-eb23-4186-9f06-44f6f3179631,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc765828-eb') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG os_vif [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:88:29,bridge_name='br-int',has_traffic_filtering=True,id=fc765828-eb23-4186-9f06-44f6f3179631,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc765828-eb') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f96ff47-7ec1-5dce-883d-673cd03d41db', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc765828-eb, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc765828-eb, col_values=(('qos', UUID('6975a3de-df78-4d4f-afbf-5cf8fb50892d')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc765828-eb, col_values=(('external_ids', {'iface-id': 'fc765828-eb23-4186-9f06-44f6f3179631', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:88:29', 'vm-uuid': '5b940840-1ebf-4022-8799-5353032e02b9'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:33 user nova-compute[75021]: INFO os_vif [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:88:29,bridge_name='br-int',has_traffic_filtering=True,id=fc765828-eb23-4186-9f06-44f6f3179631,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc765828-eb')
Dec 06 07:35:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:35:33 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] No VIF found with MAC fa:16:3e:0d:88:29, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:35:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-4b076c59-2bf9-49b8-a86e-39fbc8a5fb5f req-2782d53e-bc2b-4f56-b241-e09e3fcc4319 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Received event network-vif-plugged-fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:35:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4b076c59-2bf9-49b8-a86e-39fbc8a5fb5f req-2782d53e-bc2b-4f56-b241-e09e3fcc4319 service nova] Acquiring lock "5b940840-1ebf-4022-8799-5353032e02b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:35:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4b076c59-2bf9-49b8-a86e-39fbc8a5fb5f req-2782d53e-bc2b-4f56-b241-e09e3fcc4319 service nova] Lock "5b940840-1ebf-4022-8799-5353032e02b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:35:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4b076c59-2bf9-49b8-a86e-39fbc8a5fb5f req-2782d53e-bc2b-4f56-b241-e09e3fcc4319 service nova] Lock "5b940840-1ebf-4022-8799-5353032e02b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:35:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-4b076c59-2bf9-49b8-a86e-39fbc8a5fb5f req-2782d53e-bc2b-4f56-b241-e09e3fcc4319 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] No waiting events found dispatching network-vif-plugged-fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:35:34 user nova-compute[75021]: WARNING nova.compute.manager [req-4b076c59-2bf9-49b8-a86e-39fbc8a5fb5f req-2782d53e-bc2b-4f56-b241-e09e3fcc4319 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Received unexpected event network-vif-plugged-fc765828-eb23-4186-9f06-44f6f3179631 for instance with vm_state building and task_state spawning.
Dec 06 07:35:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:36 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:35:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:35:36 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Instance spawned successfully.
Dec 06 07:35:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:35:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:35:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:35:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:35:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:35:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:35:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:35:36 user nova-compute[75021]: INFO nova.compute.manager [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Took 4.94 seconds to spawn the instance on the hypervisor.
Dec 06 07:35:36 user nova-compute[75021]: DEBUG nova.compute.manager [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:35:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-82707d96-ff52-4fa3-8f6a-294ca4658767 req-2c377e9b-6267-4e72-ac4e-3190f5b3d5e3 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Received event network-vif-plugged-fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:35:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-82707d96-ff52-4fa3-8f6a-294ca4658767 req-2c377e9b-6267-4e72-ac4e-3190f5b3d5e3 service nova] Acquiring lock "5b940840-1ebf-4022-8799-5353032e02b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:35:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-82707d96-ff52-4fa3-8f6a-294ca4658767 req-2c377e9b-6267-4e72-ac4e-3190f5b3d5e3 service nova] Lock "5b940840-1ebf-4022-8799-5353032e02b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:35:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-82707d96-ff52-4fa3-8f6a-294ca4658767 req-2c377e9b-6267-4e72-ac4e-3190f5b3d5e3 service nova] Lock "5b940840-1ebf-4022-8799-5353032e02b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:35:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-82707d96-ff52-4fa3-8f6a-294ca4658767 req-2c377e9b-6267-4e72-ac4e-3190f5b3d5e3 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] No waiting events found dispatching network-vif-plugged-fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:35:36 user nova-compute[75021]: WARNING nova.compute.manager [req-82707d96-ff52-4fa3-8f6a-294ca4658767 req-2c377e9b-6267-4e72-ac4e-3190f5b3d5e3 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Received unexpected event network-vif-plugged-fc765828-eb23-4186-9f06-44f6f3179631 for instance with vm_state building and task_state spawning.
Dec 06 07:35:36 user nova-compute[75021]: INFO nova.compute.manager [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Took 15.44 seconds to build instance.
Dec 06 07:35:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-f9979900-f90e-4ca3-b73b-e1a44175ff64 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "5b940840-1ebf-4022-8799-5353032e02b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.543s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:35:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:40 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:35:40 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:35:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 5b940840-1ebf-4022-8799-5353032e02b9 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:35:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "5b940840-1ebf-4022-8799-5353032e02b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:35:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "5b940840-1ebf-4022-8799-5353032e02b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:35:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "5b940840-1ebf-4022-8799-5353032e02b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:35:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:46 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:35:46 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75021) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 07:35:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:35:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:05 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:36:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 07:36:05 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] There are 0 instances to clean {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 07:36:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:25 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:36:25 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:36:27 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:36:27 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:36:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.194168090820312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5b940840-1ebf-4022-8799-5353032e02b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing inventories for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Updating ProviderTree inventory for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Updating inventory in ProviderTree for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing aggregate associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, aggregates: None {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing trait associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, traits: HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:36:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:36:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:36:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:36:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:36:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:36:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:36:28 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:36:29 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:36:31 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:36:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:36:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:36:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:36:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:36:31 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:36:31 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid 5b940840-1ebf-4022-8799-5353032e02b9 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:36:31 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Updating instance_info_cache with network_info: [{"id": "fc765828-eb23-4186-9f06-44f6f3179631", "address": "fa:16:3e:0d:88:29", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc765828-eb", "ovs_interfaceid": "fc765828-eb23-4186-9f06-44f6f3179631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:36:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:36:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:36:32 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:36:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:36:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:36:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:36:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:36:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:36:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:36:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-76bbf0fd-3f9e-4563-b477-743d6df04159 req-c68bb4c9-2610-4f28-a5a5-1d15a074d387 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Received event network-changed-fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:37:12 user nova-compute[75021]: DEBUG nova.compute.manager [req-76bbf0fd-3f9e-4563-b477-743d6df04159 req-c68bb4c9-2610-4f28-a5a5-1d15a074d387 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Refreshing instance network info cache due to event network-changed-fc765828-eb23-4186-9f06-44f6f3179631. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:37:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-76bbf0fd-3f9e-4563-b477-743d6df04159 req-c68bb4c9-2610-4f28-a5a5-1d15a074d387 service nova] Acquiring lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:37:12 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-76bbf0fd-3f9e-4563-b477-743d6df04159 req-c68bb4c9-2610-4f28-a5a5-1d15a074d387 service nova] Acquired lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:37:12 user nova-compute[75021]: DEBUG nova.network.neutron [req-76bbf0fd-3f9e-4563-b477-743d6df04159 req-c68bb4c9-2610-4f28-a5a5-1d15a074d387 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Refreshing network info cache for port fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:37:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:13 user nova-compute[75021]: DEBUG nova.network.neutron [req-76bbf0fd-3f9e-4563-b477-743d6df04159 req-c68bb4c9-2610-4f28-a5a5-1d15a074d387 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Updated VIF entry in instance network info cache for port fc765828-eb23-4186-9f06-44f6f3179631. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:37:13 user nova-compute[75021]: DEBUG nova.network.neutron [req-76bbf0fd-3f9e-4563-b477-743d6df04159 req-c68bb4c9-2610-4f28-a5a5-1d15a074d387 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Updating instance_info_cache with network_info: [{"id": "fc765828-eb23-4186-9f06-44f6f3179631", "address": "fa:16:3e:0d:88:29", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc765828-eb", "ovs_interfaceid": "fc765828-eb23-4186-9f06-44f6f3179631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:37:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-76bbf0fd-3f9e-4563-b477-743d6df04159 req-c68bb4c9-2610-4f28-a5a5-1d15a074d387 service nova] Releasing lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:37:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "175b3db7-1631-43e5-b25b-b890b4f10808" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:37:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "175b3db7-1631-43e5-b25b-b890b4f10808" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:37:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:37:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:37:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:37:21 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:37:21 user nova-compute[75021]: INFO nova.compute.claims [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Claim successful on node user
Dec 06 07:37:21 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:37:21 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:37:21 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:37:21 user nova-compute[75021]: DEBUG nova.compute.manager [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG nova.network.neutron [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:37:22 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:37:22 user nova-compute[75021]: DEBUG nova.compute.manager [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG nova.policy [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b39552dec3964bf69ed87b5ca130fe5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddfde019af4962929aa2c8cfa84b35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:37:22 user nova-compute[75021]: INFO nova.virt.block_device [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Booting with volume 1d160352-bc0c-4b5f-8067-dc852f4e6b0a at /dev/vda
Dec 06 07:37:22 user nova-compute[75021]: DEBUG os_brick.utils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57be696-7099-47ae-8277-b8d0c9da33e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[46550ebb-22c5-4e87-887b-c760b2157825]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd161fe-935b-4d68-af61-69a292b60898]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba2eeb2-6a3a-4d63-9c2b-33b9e12fb606]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:37:22 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:37:22 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e7b299-4e58-49a9-b9cc-1efd454de7b1]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG os_brick.utils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Updating existing volume attachment record: 43825251-58cc-4a08-80f4-53156e61287f {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:37:22 user nova-compute[75021]: DEBUG nova.network.neutron [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Successfully created port: be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:37:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:23 user nova-compute[75021]: DEBUG nova.network.neutron [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Successfully updated port: be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:37:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "refresh_cache-175b3db7-1631-43e5-b25b-b890b4f10808" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:37:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquired lock "refresh_cache-175b3db7-1631-43e5-b25b-b890b4f10808" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:37:23 user nova-compute[75021]: DEBUG nova.network.neutron [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:37:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-4276f708-29d1-4d58-9c05-7a6a4e01a140 req-65ecc759-792c-4453-bddd-e868ae4e6e21 service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Received event network-changed-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:37:23 user nova-compute[75021]: DEBUG nova.compute.manager [req-4276f708-29d1-4d58-9c05-7a6a4e01a140 req-65ecc759-792c-4453-bddd-e868ae4e6e21 service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Refreshing instance network info cache due to event network-changed-be25c029-9e59-42dd-9f0d-ad4f5fc503f4. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:37:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4276f708-29d1-4d58-9c05-7a6a4e01a140 req-65ecc759-792c-4453-bddd-e868ae4e6e21 service nova] Acquiring lock "refresh_cache-175b3db7-1631-43e5-b25b-b890b4f10808" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:37:23 user nova-compute[75021]: DEBUG nova.network.neutron [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:37:23 user nova-compute[75021]: DEBUG nova.network.neutron [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Updating instance_info_cache with network_info: [{"id": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "address": "fa:16:3e:2b:a7:02", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe25c029-9e", "ovs_interfaceid": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:37:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Releasing lock "refresh_cache-175b3db7-1631-43e5-b25b-b890b4f10808" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:37:23 user nova-compute[75021]: DEBUG nova.compute.manager [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Instance network_info: |[{"id": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "address": "fa:16:3e:2b:a7:02", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe25c029-9e", "ovs_interfaceid": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:37:23 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4276f708-29d1-4d58-9c05-7a6a4e01a140 req-65ecc759-792c-4453-bddd-e868ae4e6e21 service nova] Acquired lock "refresh_cache-175b3db7-1631-43e5-b25b-b890b4f10808" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:37:23 user nova-compute[75021]: DEBUG nova.network.neutron [req-4276f708-29d1-4d58-9c05-7a6a4e01a140 req-65ecc759-792c-4453-bddd-e868ae4e6e21 service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Refreshing network info cache for port be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:37:24 user nova-compute[75021]: DEBUG nova.network.neutron [req-4276f708-29d1-4d58-9c05-7a6a4e01a140 req-65ecc759-792c-4453-bddd-e868ae4e6e21 service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Updated VIF entry in instance network info cache for port be25c029-9e59-42dd-9f0d-ad4f5fc503f4. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:37:24 user nova-compute[75021]: DEBUG nova.network.neutron [req-4276f708-29d1-4d58-9c05-7a6a4e01a140 req-65ecc759-792c-4453-bddd-e868ae4e6e21 service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Updating instance_info_cache with network_info: [{"id": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "address": "fa:16:3e:2b:a7:02", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe25c029-9e", "ovs_interfaceid": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:37:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-4276f708-29d1-4d58-9c05-7a6a4e01a140 req-65ecc759-792c-4453-bddd-e868ae4e6e21 service nova] Releasing lock "refresh_cache-175b3db7-1631-43e5-b25b-b890b4f10808" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:37:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:25 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:37:25 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:37:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:29 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:37:29 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:37:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=9042MB free_disk=25.192581176757812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5b940840-1ebf-4022-8799-5353032e02b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 175b3db7-1631-43e5-b25b-b890b4f10808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:37:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:37:30 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Skipping network cache update for instance because it is Building. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid 5b940840-1ebf-4022-8799-5353032e02b9 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:37:31 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Creating image(s)
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Did not create local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4867}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Ensure instance console log exists: /opt/stack/data/nova/instances/175b3db7-1631-43e5-b25b-b890b4f10808/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Start _get_guest_xml network_info=[{"id": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "address": "fa:16:3e:2b:a7:02", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe25c029-9e", "ovs_interfaceid": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '43825251-58cc-4a08-80f4-53156e61287f', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCfHnVko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '175b3db7-1631-43e5-b25b-b890b4f10808', 'attached_at': '', 'detached_at': '', 'volume_id': '1d160352-bc0c-4b5f-8067-dc852f4e6b0a', 'serial': '1d160352-bc0c-4b5f-8067-dc852f4e6b0a'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:37:31 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:37:31 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCfHnVko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:37:31 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:37:31 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:37:31 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f41eb3-e86a-4955-adeb-a944263c3596]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:37:31 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[10904f5c-e272-4295-a375-ebd6ae41c708]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a] added
Dec 06 07:37:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aba539e-bfe0-4786-be8f-903e51fe6b73]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[81653de2-3c6d-4f53-a618-1855db2e8a78]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MCfHnVko {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MCfHnVko" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[eead8b29-0a19-4ca8-9223-9402060d4d59]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MCfHnVko'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[161cdc77-3961-422e-bb9b-09e4f2bd28d0]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd92a3d9-16e5-4378-b7bb-becaa18c09d3]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:37:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:37:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[43987c54-583d-4d36-8064-e56ce0cfac80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a, portal: 172.16.0.220,3260]
Dec 06 07:37:31 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a, portal: 172.16.0.220,3260] successful.
Dec 06 07:37:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Updating instance_info_cache with network_info: [{"id": "fc765828-eb23-4186-9f06-44f6f3179631", "address": "fa:16:3e:0d:88:29", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc765828-eb", "ovs_interfaceid": "fc765828-eb23-4186-9f06-44f6f3179631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f08d36-7481-47bf-a98d-e9cee8069b76]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4372d8-cbd0-44c5-8ecf-9d1b19d5c5c8]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:37:31 user nova-compute[75021]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a (non-flash)
Dec 06 07:37:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:37:31 user nova-compute[75021]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a (non-flash)
Dec 06 07:37:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2b66eb-3e24-4088-bb62-9c4bc9a6f024]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:37:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCfHnVko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23265323633633436', 'path': '/dev/sdc'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265323633633436', 'path': '/dev/sdc'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:37:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-750614393',display_name='tempest-TestVolumeBootPattern-server-750614393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-750614393',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/q672ydb0gw8Top+rrysEwxQ79bw8IIbuqy7QFDIbXz/tZqH3LZLi824RQ6QLVj2ALmCEvtH1vqGA5G+ngr0orlUWhzvqZziUCTzoOwBaRmBqojvNQQcSbs90EuLDeQQ==',key_name='tempest-TestVolumeBootPattern-943306452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-kjpd626d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:37:22Z,user_data=None,user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=175b3db7-1631-43e5-b25b-b890b4f10808,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "address": "fa:16:3e:2b:a7:02", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe25c029-9e", "ovs_interfaceid": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "address": "fa:16:3e:2b:a7:02", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe25c029-9e", "ovs_interfaceid": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a7:02,bridge_name='br-int',has_traffic_filtering=True,id=be25c029-9e59-42dd-9f0d-ad4f5fc503f4,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe25c029-9e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG nova.objects.instance [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lazy-loading 'pci_devices' on Instance uuid 175b3db7-1631-43e5-b25b-b890b4f10808 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:37:32 user nova-compute[75021]:   <uuid>175b3db7-1631-43e5-b25b-b890b4f10808</uuid>
Dec 06 07:37:32 user nova-compute[75021]:   <name>instance-00000034</name>
Dec 06 07:37:32 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:37:32 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:37:32 user nova-compute[75021]:   <metadata>
Dec 06 07:37:32 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:37:32 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:37:32 user nova-compute[75021]:       <nova:name>tempest-TestVolumeBootPattern-server-750614393</nova:name>
Dec 06 07:37:32 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:37:31</nova:creationTime>
Dec 06 07:37:32 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:37:32 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:37:32 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:37:32 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:37:32 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:37:32 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:37:32 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:37:32 user nova-compute[75021]:       <nova:owner>
Dec 06 07:37:32 user nova-compute[75021]:         <nova:user uuid="b39552dec3964bf69ed87b5ca130fe5f">tempest-TestVolumeBootPattern-1013845055-project-member</nova:user>
Dec 06 07:37:32 user nova-compute[75021]:         <nova:project uuid="00ddfde019af4962929aa2c8cfa84b35">tempest-TestVolumeBootPattern-1013845055</nova:project>
Dec 06 07:37:32 user nova-compute[75021]:       </nova:owner>
Dec 06 07:37:32 user nova-compute[75021]:       <nova:ports>
Dec 06 07:37:32 user nova-compute[75021]:         <nova:port uuid="be25c029-9e59-42dd-9f0d-ad4f5fc503f4">
Dec 06 07:37:32 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 06 07:37:32 user nova-compute[75021]:         </nova:port>
Dec 06 07:37:32 user nova-compute[75021]:       </nova:ports>
Dec 06 07:37:32 user nova-compute[75021]:     </nova:instance>
Dec 06 07:37:32 user nova-compute[75021]:   </metadata>
Dec 06 07:37:32 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:37:32 user nova-compute[75021]:     <system>
Dec 06 07:37:32 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:37:32 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:37:32 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:37:32 user nova-compute[75021]:       <entry name="serial">175b3db7-1631-43e5-b25b-b890b4f10808</entry>
Dec 06 07:37:32 user nova-compute[75021]:       <entry name="uuid">175b3db7-1631-43e5-b25b-b890b4f10808</entry>
Dec 06 07:37:32 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:37:32 user nova-compute[75021]:     </system>
Dec 06 07:37:32 user nova-compute[75021]:   </sysinfo>
Dec 06 07:37:32 user nova-compute[75021]:   <os>
Dec 06 07:37:32 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:37:32 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:37:32 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:37:32 user nova-compute[75021]:   </os>
Dec 06 07:37:32 user nova-compute[75021]:   <features>
Dec 06 07:37:32 user nova-compute[75021]:     <acpi/>
Dec 06 07:37:32 user nova-compute[75021]:     <apic/>
Dec 06 07:37:32 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:37:32 user nova-compute[75021]:   </features>
Dec 06 07:37:32 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:37:32 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:37:32 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:37:32 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:37:32 user nova-compute[75021]:   </clock>
Dec 06 07:37:32 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:37:32 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:37:32 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:37:32 user nova-compute[75021]:   </cpu>
Dec 06 07:37:32 user nova-compute[75021]:   <devices>
Dec 06 07:37:32 user nova-compute[75021]:     <disk type="block" device="disk">
Dec 06 07:37:32 user nova-compute[75021]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:37:32 user nova-compute[75021]:       <source dev="/dev/sdc"/>
Dec 06 07:37:32 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:37:32 user nova-compute[75021]:       <serial>1d160352-bc0c-4b5f-8067-dc852f4e6b0a</serial>
Dec 06 07:37:32 user nova-compute[75021]:     </disk>
Dec 06 07:37:32 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:37:32 user nova-compute[75021]:       <mac address="fa:16:3e:2b:a7:02"/>
Dec 06 07:37:32 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:37:32 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:37:32 user nova-compute[75021]:       <target dev="tapbe25c029-9e"/>
Dec 06 07:37:32 user nova-compute[75021]:     </interface>
Dec 06 07:37:32 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:37:32 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/175b3db7-1631-43e5-b25b-b890b4f10808/console.log" append="off"/>
Dec 06 07:37:32 user nova-compute[75021]:     </serial>
Dec 06 07:37:32 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:37:32 user nova-compute[75021]:     <video>
Dec 06 07:37:32 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:37:32 user nova-compute[75021]:     </video>
Dec 06 07:37:32 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:37:32 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:37:32 user nova-compute[75021]:     </rng>
Dec 06 07:37:32 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:37:32 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:37:32 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:37:32 user nova-compute[75021]:     </memballoon>
Dec 06 07:37:32 user nova-compute[75021]:   </devices>
Dec 06 07:37:32 user nova-compute[75021]: </domain>
Dec 06 07:37:32 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:37:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-750614393',display_name='tempest-TestVolumeBootPattern-server-750614393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-750614393',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/q672ydb0gw8Top+rrysEwxQ79bw8IIbuqy7QFDIbXz/tZqH3LZLi824RQ6QLVj2ALmCEvtH1vqGA5G+ngr0orlUWhzvqZziUCTzoOwBaRmBqojvNQQcSbs90EuLDeQQ==',key_name='tempest-TestVolumeBootPattern-943306452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-kjpd626d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:37:22Z,user_data=None,user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=175b3db7-1631-43e5-b25b-b890b4f10808,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "address": "fa:16:3e:2b:a7:02", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe25c029-9e", "ovs_interfaceid": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "address": "fa:16:3e:2b:a7:02", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe25c029-9e", "ovs_interfaceid": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a7:02,bridge_name='br-int',has_traffic_filtering=True,id=be25c029-9e59-42dd-9f0d-ad4f5fc503f4,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe25c029-9e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG os_vif [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a7:02,bridge_name='br-int',has_traffic_filtering=True,id=be25c029-9e59-42dd-9f0d-ad4f5fc503f4,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe25c029-9e') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92cd6043-8ffa-577e-ae82-55ebbc0cd6a1', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe25c029-9e, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe25c029-9e, col_values=(('qos', UUID('91122d70-4f98-4803-bc27-43ffa8a914b8')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe25c029-9e, col_values=(('external_ids', {'iface-id': 'be25c029-9e59-42dd-9f0d-ad4f5fc503f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:a7:02', 'vm-uuid': '175b3db7-1631-43e5-b25b-b890b4f10808'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:32 user nova-compute[75021]: INFO os_vif [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a7:02,bridge_name='br-int',has_traffic_filtering=True,id=be25c029-9e59-42dd-9f0d-ad4f5fc503f4,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe25c029-9e')
Dec 06 07:37:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:37:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] No VIF found with MAC fa:16:3e:2b:a7:02, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:37:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:37:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:37:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:34 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:37:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-dd0896ec-8541-4387-ac91-090cfc653a94 req-ab991a27-bb9d-44cd-ad12-8f2d9b5a04d2 service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Received event network-vif-plugged-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:37:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dd0896ec-8541-4387-ac91-090cfc653a94 req-ab991a27-bb9d-44cd-ad12-8f2d9b5a04d2 service nova] Acquiring lock "175b3db7-1631-43e5-b25b-b890b4f10808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:37:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dd0896ec-8541-4387-ac91-090cfc653a94 req-ab991a27-bb9d-44cd-ad12-8f2d9b5a04d2 service nova] Lock "175b3db7-1631-43e5-b25b-b890b4f10808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:37:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dd0896ec-8541-4387-ac91-090cfc653a94 req-ab991a27-bb9d-44cd-ad12-8f2d9b5a04d2 service nova] Lock "175b3db7-1631-43e5-b25b-b890b4f10808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:37:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-dd0896ec-8541-4387-ac91-090cfc653a94 req-ab991a27-bb9d-44cd-ad12-8f2d9b5a04d2 service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] No waiting events found dispatching network-vif-plugged-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:37:34 user nova-compute[75021]: WARNING nova.compute.manager [req-dd0896ec-8541-4387-ac91-090cfc653a94 req-ab991a27-bb9d-44cd-ad12-8f2d9b5a04d2 service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Received unexpected event network-vif-plugged-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 for instance with vm_state building and task_state spawning.
Dec 06 07:37:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:35 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:37:36 user nova-compute[75021]: DEBUG nova.compute.manager [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:37:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:37:36 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Instance spawned successfully.
Dec 06 07:37:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:37:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:37:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:37:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:37:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:37:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:37:36 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:37:36 user nova-compute[75021]: INFO nova.compute.manager [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Took 4.97 seconds to spawn the instance on the hypervisor.
Dec 06 07:37:36 user nova-compute[75021]: DEBUG nova.compute.manager [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:37:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-09e7d784-9e8b-4f94-b8f0-1cc6898aa1fb req-962c4850-ab74-4264-bcf6-6a7ab0fc7256 service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Received event network-vif-plugged-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:37:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-09e7d784-9e8b-4f94-b8f0-1cc6898aa1fb req-962c4850-ab74-4264-bcf6-6a7ab0fc7256 service nova] Acquiring lock "175b3db7-1631-43e5-b25b-b890b4f10808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:37:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-09e7d784-9e8b-4f94-b8f0-1cc6898aa1fb req-962c4850-ab74-4264-bcf6-6a7ab0fc7256 service nova] Lock "175b3db7-1631-43e5-b25b-b890b4f10808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:37:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-09e7d784-9e8b-4f94-b8f0-1cc6898aa1fb req-962c4850-ab74-4264-bcf6-6a7ab0fc7256 service nova] Lock "175b3db7-1631-43e5-b25b-b890b4f10808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:37:36 user nova-compute[75021]: DEBUG nova.compute.manager [req-09e7d784-9e8b-4f94-b8f0-1cc6898aa1fb req-962c4850-ab74-4264-bcf6-6a7ab0fc7256 service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] No waiting events found dispatching network-vif-plugged-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:37:36 user nova-compute[75021]: WARNING nova.compute.manager [req-09e7d784-9e8b-4f94-b8f0-1cc6898aa1fb req-962c4850-ab74-4264-bcf6-6a7ab0fc7256 service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Received unexpected event network-vif-plugged-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 for instance with vm_state building and task_state spawning.
Dec 06 07:37:36 user nova-compute[75021]: INFO nova.compute.manager [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Took 14.75 seconds to build instance.
Dec 06 07:37:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-51b2c1ee-d2fa-4929-94d8-a4ad3f4c59d7 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "175b3db7-1631-43e5-b25b-b890b4f10808" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.879s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:37:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:41 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:37:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:37:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:38:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:38:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:38:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:38:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:38:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:38:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:38:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:38:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:38:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:38:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:38:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:38:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:38:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:38:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:38:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:38:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:38:27 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:38:27 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:38:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:38:29 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:38:29 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:38:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=25.19125747680664GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5b940840-1ebf-4022-8799-5353032e02b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 175b3db7-1631-43e5-b25b-b890b4f10808 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:38:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:38:31 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:38:32 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:38:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:38:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:38:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:38:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:38:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:38:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:38:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:38:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:38:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:38:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:38:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:38:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:38:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:38:33 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid 5b940840-1ebf-4022-8799-5353032e02b9 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:38:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Updating instance_info_cache with network_info: [{"id": "fc765828-eb23-4186-9f06-44f6f3179631", "address": "fa:16:3e:0d:88:29", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc765828-eb", "ovs_interfaceid": "fc765828-eb23-4186-9f06-44f6f3179631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:38:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:38:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:38:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:38:34 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:38:36 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:38:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:38:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:38:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:38:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:38:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:38:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:38:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:38:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:38:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:38:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:38:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:38:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:38:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:38:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:38:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:38:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:38:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:38:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:38:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:38:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:39:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:39:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:39:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:39:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:39:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:39:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:39:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:39:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:39:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-b4efaadc-61d5-4b59-9a0f-6f6045d33959 req-6053ca45-2e99-4cd6-b122-4c02620fb6fd service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Received event network-changed-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:39:13 user nova-compute[75021]: DEBUG nova.compute.manager [req-b4efaadc-61d5-4b59-9a0f-6f6045d33959 req-6053ca45-2e99-4cd6-b122-4c02620fb6fd service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Refreshing instance network info cache due to event network-changed-be25c029-9e59-42dd-9f0d-ad4f5fc503f4. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:39:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b4efaadc-61d5-4b59-9a0f-6f6045d33959 req-6053ca45-2e99-4cd6-b122-4c02620fb6fd service nova] Acquiring lock "refresh_cache-175b3db7-1631-43e5-b25b-b890b4f10808" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:39:13 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b4efaadc-61d5-4b59-9a0f-6f6045d33959 req-6053ca45-2e99-4cd6-b122-4c02620fb6fd service nova] Acquired lock "refresh_cache-175b3db7-1631-43e5-b25b-b890b4f10808" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:39:13 user nova-compute[75021]: DEBUG nova.network.neutron [req-b4efaadc-61d5-4b59-9a0f-6f6045d33959 req-6053ca45-2e99-4cd6-b122-4c02620fb6fd service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Refreshing network info cache for port be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:39:14 user nova-compute[75021]: DEBUG nova.network.neutron [req-b4efaadc-61d5-4b59-9a0f-6f6045d33959 req-6053ca45-2e99-4cd6-b122-4c02620fb6fd service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Updated VIF entry in instance network info cache for port be25c029-9e59-42dd-9f0d-ad4f5fc503f4. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:39:14 user nova-compute[75021]: DEBUG nova.network.neutron [req-b4efaadc-61d5-4b59-9a0f-6f6045d33959 req-6053ca45-2e99-4cd6-b122-4c02620fb6fd service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Updating instance_info_cache with network_info: [{"id": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "address": "fa:16:3e:2b:a7:02", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe25c029-9e", "ovs_interfaceid": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:39:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-b4efaadc-61d5-4b59-9a0f-6f6045d33959 req-6053ca45-2e99-4cd6-b122-4c02620fb6fd service nova] Releasing lock "refresh_cache-175b3db7-1631-43e5-b25b-b890b4f10808" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:39:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "175b3db7-1631-43e5-b25b-b890b4f10808" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:39:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "175b3db7-1631-43e5-b25b-b890b4f10808" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:39:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "175b3db7-1631-43e5-b25b-b890b4f10808-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:39:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "175b3db7-1631-43e5-b25b-b890b4f10808-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:39:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "175b3db7-1631-43e5-b25b-b890b4f10808-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:39:14 user nova-compute[75021]: INFO nova.compute.manager [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Terminating instance
Dec 06 07:39:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:39:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:15 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Instance destroyed successfully.
Dec 06 07:39:15 user nova-compute[75021]: DEBUG nova.objects.instance [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lazy-loading 'resources' on Instance uuid 175b3db7-1631-43e5-b25b-b890b4f10808 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:37:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-750614393',display_name='tempest-TestVolumeBootPattern-server-750614393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-750614393',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/q672ydb0gw8Top+rrysEwxQ79bw8IIbuqy7QFDIbXz/tZqH3LZLi824RQ6QLVj2ALmCEvtH1vqGA5G+ngr0orlUWhzvqZziUCTzoOwBaRmBqojvNQQcSbs90EuLDeQQ==',key_name='tempest-TestVolumeBootPattern-943306452',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-kjpd626d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:37:36Z,user_data=None,user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=175b3db7-1631-43e5-b25b-b890b4f10808,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "address": "fa:16:3e:2b:a7:02", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe25c029-9e", "ovs_interfaceid": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "address": "fa:16:3e:2b:a7:02", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe25c029-9e", "ovs_interfaceid": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:a7:02,bridge_name='br-int',has_traffic_filtering=True,id=be25c029-9e59-42dd-9f0d-ad4f5fc503f4,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe25c029-9e') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_vif [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:a7:02,bridge_name='br-int',has_traffic_filtering=True,id=be25c029-9e59-42dd-9f0d-ad4f5fc503f4,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe25c029-9e') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe25c029-9e, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91122d70-4f98-4803-bc27-43ffa8a914b8) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:39:15 user nova-compute[75021]: INFO os_vif [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:a7:02,bridge_name='br-int',has_traffic_filtering=True,id=be25c029-9e59-42dd-9f0d-ad4f5fc503f4,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe25c029-9e')
Dec 06 07:39:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCfHnVko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:39:15 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7416ca5a-3162-450f-8ab0-2a1b45c6aa86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:39:15 user nova-compute[75021]: No targets found.
Dec 06 07:39:15 user nova-compute[75021]: iSNS:
Dec 06 07:39:15 user nova-compute[75021]: No targets found.
Dec 06 07:39:15 user nova-compute[75021]: STATIC:
Dec 06 07:39:15 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a
Dec 06 07:39:15 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:39:15 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:39:15 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab
Dec 06 07:39:15 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:39:15 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:39:15 user nova-compute[75021]: FIRMWARE:
Dec 06 07:39:15 user nova-compute[75021]: No targets found.
Dec 06 07:39:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:39:15 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:39:15 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bd8a57-277a-456d-89f6-7812e7aa5e15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f28eb5-dbad-4888-890a-35cdbae0db8d]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:39:15 user nova-compute[75021]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a (non-flash)
Dec 06 07:39:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:39:15 user nova-compute[75021]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a (non-flash)
Dec 06 07:39:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b46291b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a'): ({'sdc'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Removing single pathed devices sdc {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d86b4f0-73d1-45eb-a69e-050ddafaac3c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4779cd4-43fc-4d17-9574-1fb72558b9c8]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flushing IO for device /dev/sdc {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c712c8-e1cf-43c8-a921-2cbc3dc785ef]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef42977-5e55-4421-93b3-54fd45fb851c]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] SCSI volumes sdc have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3f64db1c-2e263c46348f3f16', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3f64db1c', '/dev/disk/by-id/scsi-23265323633633436') {{(pid=86148) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[260d3d21-a7bc-4723-902c-5c6f4b4a586d]: (4, None) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5789571-99e6-4790-b226-bd5e15e33f31]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[585035dd-8345-4ab4-8df0-d867c89f19e5]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a, portal: 172.16.0.220,3260]
Dec 06 07:39:15 user nova-compute[75021]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a, portal: 172.16.0.220,3260] successful.
Dec 06 07:39:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d160352-bc0c-4b5f-8067-dc852f4e6b0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb86d609-57a8-402b-ad0f-dbb9bb4d1da1]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== disconnect_volume: return (295ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:39:15 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Deleting instance files /opt/stack/data/nova/instances/175b3db7-1631-43e5-b25b-b890b4f10808_del
Dec 06 07:39:15 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Deletion of /opt/stack/data/nova/instances/175b3db7-1631-43e5-b25b-b890b4f10808_del complete
Dec 06 07:39:15 user nova-compute[75021]: INFO nova.compute.manager [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Took 1.13 seconds to destroy the instance on the hypervisor.
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Received event network-changed-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Refreshing instance network info cache due to event network-changed-be25c029-9e59-42dd-9f0d-ad4f5fc503f4. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] Acquiring lock "refresh_cache-175b3db7-1631-43e5-b25b-b890b4f10808" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] Acquired lock "refresh_cache-175b3db7-1631-43e5-b25b-b890b4f10808" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:39:15 user nova-compute[75021]: DEBUG nova.network.neutron [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Refreshing network info cache for port be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:39:16 user nova-compute[75021]: DEBUG nova.network.neutron [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Updated VIF entry in instance network info cache for port be25c029-9e59-42dd-9f0d-ad4f5fc503f4. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:39:16 user nova-compute[75021]: DEBUG nova.network.neutron [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Updating instance_info_cache with network_info: [{"id": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "address": "fa:16:3e:2b:a7:02", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe25c029-9e", "ovs_interfaceid": "be25c029-9e59-42dd-9f0d-ad4f5fc503f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:39:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] Releasing lock "refresh_cache-175b3db7-1631-43e5-b25b-b890b4f10808" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:39:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Received event network-vif-unplugged-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:39:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] Acquiring lock "175b3db7-1631-43e5-b25b-b890b4f10808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:39:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] Lock "175b3db7-1631-43e5-b25b-b890b4f10808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:39:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] Lock "175b3db7-1631-43e5-b25b-b890b4f10808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:39:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] No waiting events found dispatching network-vif-unplugged-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:39:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Received event network-vif-unplugged-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:39:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Received event network-vif-plugged-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:39:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] Acquiring lock "175b3db7-1631-43e5-b25b-b890b4f10808-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:39:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] Lock "175b3db7-1631-43e5-b25b-b890b4f10808-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:39:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] Lock "175b3db7-1631-43e5-b25b-b890b4f10808-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:39:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] No waiting events found dispatching network-vif-plugged-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:39:16 user nova-compute[75021]: WARNING nova.compute.manager [req-367d98ab-f4c7-4550-b860-96b700aba3b0 req-afdb9807-4586-4f2d-9181-9c331ce29d2e service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Received unexpected event network-vif-plugged-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 for instance with vm_state active and task_state deleting.
Dec 06 07:39:16 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:39:16 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Took 0.71 seconds to deallocate network for instance.
Dec 06 07:39:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-2c4c04f2-c73f-4f22-92f1-47d3488d9a7e req-87caefbe-6da8-4fc5-ae3c-fe91e8729251 service nova] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Received event network-vif-deleted-be25c029-9e59-42dd-9f0d-ad4f5fc503f4 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:39:17 user nova-compute[75021]: INFO nova.compute.manager [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 175b3db7-1631-43e5-b25b-b890b4f10808] Took 0.94 seconds to detach 1 volumes for instance.
Dec 06 07:39:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:39:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:39:17 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:39:17 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:39:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:39:17 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Deleted allocations for instance 175b3db7-1631-43e5-b25b-b890b4f10808
Dec 06 07:39:17 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-1b2044ce-c285-4997-b7ca-346c4851ba1a tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "175b3db7-1631-43e5-b25b-b890b4f10808" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.096s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:39:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:39:29 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:39:29 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:39:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=9021MB free_disk=25.190345764160156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 5b940840-1ebf-4022-8799-5353032e02b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:39:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:39:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:39:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:39:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:39:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:39:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:31 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:39:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:39:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:39:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:39:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 07:39:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:39:34 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:39:35 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:39:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:39:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:39:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:39:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:39:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:36 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:39:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:43 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:39:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:39:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:40:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:40:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:40:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:40:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:40:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-dbb368a3-7180-4044-b62c-d73468815a25 req-88ca2da6-1275-4d9c-8f97-82f2382cc3c2 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Received event network-changed-fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-dbb368a3-7180-4044-b62c-d73468815a25 req-88ca2da6-1275-4d9c-8f97-82f2382cc3c2 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Refreshing instance network info cache due to event network-changed-fc765828-eb23-4186-9f06-44f6f3179631. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dbb368a3-7180-4044-b62c-d73468815a25 req-88ca2da6-1275-4d9c-8f97-82f2382cc3c2 service nova] Acquiring lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dbb368a3-7180-4044-b62c-d73468815a25 req-88ca2da6-1275-4d9c-8f97-82f2382cc3c2 service nova] Acquired lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG nova.network.neutron [req-dbb368a3-7180-4044-b62c-d73468815a25 req-88ca2da6-1275-4d9c-8f97-82f2382cc3c2 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Refreshing network info cache for port fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "5b940840-1ebf-4022-8799-5353032e02b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "5b940840-1ebf-4022-8799-5353032e02b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "5b940840-1ebf-4022-8799-5353032e02b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "5b940840-1ebf-4022-8799-5353032e02b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "5b940840-1ebf-4022-8799-5353032e02b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:40:14 user nova-compute[75021]: INFO nova.compute.manager [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Terminating instance
Dec 06 07:40:14 user nova-compute[75021]: DEBUG nova.compute.manager [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-ee9b9a97-ac94-4b7b-90dd-d8e06f1fe6b8 req-b9f97150-146c-4da2-a65b-fc5623d31b1b service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Received event network-vif-unplugged-fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ee9b9a97-ac94-4b7b-90dd-d8e06f1fe6b8 req-b9f97150-146c-4da2-a65b-fc5623d31b1b service nova] Acquiring lock "5b940840-1ebf-4022-8799-5353032e02b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ee9b9a97-ac94-4b7b-90dd-d8e06f1fe6b8 req-b9f97150-146c-4da2-a65b-fc5623d31b1b service nova] Lock "5b940840-1ebf-4022-8799-5353032e02b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-ee9b9a97-ac94-4b7b-90dd-d8e06f1fe6b8 req-b9f97150-146c-4da2-a65b-fc5623d31b1b service nova] Lock "5b940840-1ebf-4022-8799-5353032e02b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-ee9b9a97-ac94-4b7b-90dd-d8e06f1fe6b8 req-b9f97150-146c-4da2-a65b-fc5623d31b1b service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] No waiting events found dispatching network-vif-unplugged-fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG nova.compute.manager [req-ee9b9a97-ac94-4b7b-90dd-d8e06f1fe6b8 req-b9f97150-146c-4da2-a65b-fc5623d31b1b service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Received event network-vif-unplugged-fc765828-eb23-4186-9f06-44f6f3179631 for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG nova.network.neutron [req-dbb368a3-7180-4044-b62c-d73468815a25 req-88ca2da6-1275-4d9c-8f97-82f2382cc3c2 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Updated VIF entry in instance network info cache for port fc765828-eb23-4186-9f06-44f6f3179631. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG nova.network.neutron [req-dbb368a3-7180-4044-b62c-d73468815a25 req-88ca2da6-1275-4d9c-8f97-82f2382cc3c2 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Updating instance_info_cache with network_info: [{"id": "fc765828-eb23-4186-9f06-44f6f3179631", "address": "fa:16:3e:0d:88:29", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc765828-eb", "ovs_interfaceid": "fc765828-eb23-4186-9f06-44f6f3179631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:40:14 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dbb368a3-7180-4044-b62c-d73468815a25 req-88ca2da6-1275-4d9c-8f97-82f2382cc3c2 service nova] Releasing lock "refresh_cache-5b940840-1ebf-4022-8799-5353032e02b9" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:40:15 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Instance destroyed successfully.
Dec 06 07:40:15 user nova-compute[75021]: DEBUG nova.objects.instance [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lazy-loading 'resources' on Instance uuid 5b940840-1ebf-4022-8799-5353032e02b9 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:35:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-25893913',display_name='tempest-TestVolumeBootPattern-server-25893913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-25893913',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/q672ydb0gw8Top+rrysEwxQ79bw8IIbuqy7QFDIbXz/tZqH3LZLi824RQ6QLVj2ALmCEvtH1vqGA5G+ngr0orlUWhzvqZziUCTzoOwBaRmBqojvNQQcSbs90EuLDeQQ==',key_name='tempest-TestVolumeBootPattern-943306452',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:35:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00ddfde019af4962929aa2c8cfa84b35',ramdisk_id='',reservation_id='r-f5swl675',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1013845055',owner_user_name='tempest-TestVolumeBootPattern-1013845055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:35:37Z,user_data=None,user_id='b39552dec3964bf69ed87b5ca130fe5f',uuid=5b940840-1ebf-4022-8799-5353032e02b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc765828-eb23-4186-9f06-44f6f3179631", "address": "fa:16:3e:0d:88:29", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc765828-eb", "ovs_interfaceid": "fc765828-eb23-4186-9f06-44f6f3179631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converting VIF {"id": "fc765828-eb23-4186-9f06-44f6f3179631", "address": "fa:16:3e:0d:88:29", "network": {"id": "ad523276-0c04-4762-a8ce-113df468b8c8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1723949970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ddfde019af4962929aa2c8cfa84b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc765828-eb", "ovs_interfaceid": "fc765828-eb23-4186-9f06-44f6f3179631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:88:29,bridge_name='br-int',has_traffic_filtering=True,id=fc765828-eb23-4186-9f06-44f6f3179631,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc765828-eb') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_vif [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:88:29,bridge_name='br-int',has_traffic_filtering=True,id=fc765828-eb23-4186-9f06-44f6f3179631,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc765828-eb') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc765828-eb, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6975a3de-df78-4d4f-afbf-5cf8fb50892d) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:40:15 user nova-compute[75021]: INFO os_vif [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:88:29,bridge_name='br-int',has_traffic_filtering=True,id=fc765828-eb23-4186-9f06-44f6f3179631,network=Network(ad523276-0c04-4762-a8ce-113df468b8c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc765828-eb')
Dec 06 07:40:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tERBKjyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:40:15 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baf18aa-91a2-41b0-ad72-a3a2e6adc8a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:40:15 user nova-compute[75021]: No targets found.
Dec 06 07:40:15 user nova-compute[75021]: iSNS:
Dec 06 07:40:15 user nova-compute[75021]: No targets found.
Dec 06 07:40:15 user nova-compute[75021]: STATIC:
Dec 06 07:40:15 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab
Dec 06 07:40:15 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:40:15 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:40:15 user nova-compute[75021]: FIRMWARE:
Dec 06 07:40:15 user nova-compute[75021]: No targets found.
Dec 06 07:40:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:40:15 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:40:15 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cfb7d4-a6da-4a55-9b1f-2e5acde54af5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50c8d5e-01d6-4c98-b3c1-cdd42103b922]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:40:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab (non-flash)
Dec 06 07:40:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d8422440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bf828e-2964-4a66-8965-79f0cd36d2d5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[027bc341-9f73-4614-b40b-6225bdbd3804]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f61c211-f377-4ad1-98b8-689b3d179990]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5cbe3c-e286-4e28-b7e2-c453588a624f]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_22d5baeb', '/dev/disk/by-id/scsi-26533366137633936', '/dev/disk/by-id/scsi-1SCST_BIO22d5baeb-e36a7c963d0cb0ec') {{(pid=86148) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4aa72a4-1465-4f0c-a20f-af3175ce648f]: (4, None) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2f202b-3564-49d6-b6a8-238668fb1365]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4eb7ce-6e9b-47b3-9bb7-7cb5bd9c7686]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260]
Dec 06 07:40:15 user nova-compute[75021]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab, portal: 172.16.0.220,3260] successful.
Dec 06 07:40:15 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375fa659-89c5-4c1d-a11d-6d3a354dcbab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2651bc1c-c47e-493b-9775-dac43b43e6c7]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] <== disconnect_volume: return (309ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:40:15 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Deleting instance files /opt/stack/data/nova/instances/5b940840-1ebf-4022-8799-5353032e02b9_del
Dec 06 07:40:15 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Deletion of /opt/stack/data/nova/instances/5b940840-1ebf-4022-8799-5353032e02b9_del complete
Dec 06 07:40:15 user nova-compute[75021]: INFO nova.compute.manager [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Took 1.21 seconds to destroy the instance on the hypervisor.
Dec 06 07:40:15 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:40:15 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:40:15 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Took 0.41 seconds to deallocate network for instance.
Dec 06 07:40:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-a6fb6012-1779-45ba-934a-dde4ad5d203f req-13ec0ad7-79a6-4914-b230-11043de1da00 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Received event network-vif-plugged-fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:40:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a6fb6012-1779-45ba-934a-dde4ad5d203f req-13ec0ad7-79a6-4914-b230-11043de1da00 service nova] Acquiring lock "5b940840-1ebf-4022-8799-5353032e02b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:40:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a6fb6012-1779-45ba-934a-dde4ad5d203f req-13ec0ad7-79a6-4914-b230-11043de1da00 service nova] Lock "5b940840-1ebf-4022-8799-5353032e02b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:40:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-a6fb6012-1779-45ba-934a-dde4ad5d203f req-13ec0ad7-79a6-4914-b230-11043de1da00 service nova] Lock "5b940840-1ebf-4022-8799-5353032e02b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:40:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-a6fb6012-1779-45ba-934a-dde4ad5d203f req-13ec0ad7-79a6-4914-b230-11043de1da00 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] No waiting events found dispatching network-vif-plugged-fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:40:16 user nova-compute[75021]: WARNING nova.compute.manager [req-a6fb6012-1779-45ba-934a-dde4ad5d203f req-13ec0ad7-79a6-4914-b230-11043de1da00 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Received unexpected event network-vif-plugged-fc765828-eb23-4186-9f06-44f6f3179631 for instance with vm_state active and task_state deleting.
Dec 06 07:40:16 user nova-compute[75021]: DEBUG nova.compute.manager [req-a6fb6012-1779-45ba-934a-dde4ad5d203f req-13ec0ad7-79a6-4914-b230-11043de1da00 service nova] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Received event network-vif-deleted-fc765828-eb23-4186-9f06-44f6f3179631 {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:40:16 user nova-compute[75021]: INFO nova.compute.manager [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] [instance: 5b940840-1ebf-4022-8799-5353032e02b9] Took 0.76 seconds to detach 1 volumes for instance.
Dec 06 07:40:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:40:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:40:16 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:40:16 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:40:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:40:16 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Deleted allocations for instance 5b940840-1ebf-4022-8799-5353032e02b9
Dec 06 07:40:16 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-254f0a95-b0c1-4287-8fdc-69de89c3f8e1 tempest-TestVolumeBootPattern-1013845055 tempest-TestVolumeBootPattern-1013845055-project-member] Lock "5b940840-1ebf-4022-8799-5353032e02b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.663s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:40:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:23 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:40:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:40:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:40:30 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:40:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:40:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:40:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:40:30 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:40:30 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:40:30 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:40:30 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=9186MB free_disk=25.189498901367188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:40:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:40:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:40:30 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:40:30 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:40:30 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:40:30 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:40:30 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:40:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:40:31 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:40:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:40:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:40:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:40:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:40:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 07:40:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:40:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:40:34 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:40:34 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:40:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:40:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:40:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:40:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:40:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:35 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:40:36 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:40:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:40:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:40:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:40:59 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:40:59 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75021) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 07:41:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:41:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:41:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:41:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:41:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:41:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:41:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:41:18 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:41:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 07:41:18 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] There are 0 instances to clean {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 07:41:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:41:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:41:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:41:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:41:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:41:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:41:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:41:30 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:41:32 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:41:32 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:41:32 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=9194MB free_disk=25.18798828125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing inventories for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Updating ProviderTree inventory for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Updating inventory in ProviderTree for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing aggregate associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, aggregates: None {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing trait associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, traits: HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:41:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:41:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:41:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:41:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:41:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 07:41:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:41:34 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:41:34 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:41:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:41:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:41:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:41:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:41:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:41:35 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:41:35 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:41:36 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:41:36 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:41:40 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:41:45 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:41:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:41:50 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:41:55 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:00 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:05 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:10 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:11 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:15 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:20 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:42:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:42:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Starting instance... {{(pid=75021) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 06 07:42:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:42:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:42:24 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75021) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 06 07:42:24 user nova-compute[75021]: INFO nova.compute.claims [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Claim successful on node user
Dec 06 07:42:24 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:42:24 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:42:24 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:42:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Start building networks asynchronously for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 06 07:42:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Allocating IP information in the background. {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 06 07:42:24 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] allocate_for_instance() {{(pid=75021) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 06 07:42:24 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 06 07:42:24 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Start building block device mappings for instance. {{(pid=75021) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG nova.policy [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a58d5953e812436f93039c0b07a9ac59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42266b03404b41c4a2519332b43bdf3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75021) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Start spawning the instance on the hypervisor. {{(pid=75021) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Creating instance directory {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4731}}
Dec 06 07:42:25 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Creating image(s)
Dec 06 07:42:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "/opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "/opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "/opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.209s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.225s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk 1073741824 {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe,backing_fmt=raw /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk 1073741824" returned: 0 in 0.277s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "16bbf7697929de6d79c94d3a5ffb64bbac290fbe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.509s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:42:25 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Successfully created port: c47044c9-199c-486a-a396-60db403db30a {{(pid=75021) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16bbf7697929de6d79c94d3a5ffb64bbac290fbe --force-share --output=json" returned: 0 in 0.222s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk. size=1073741824 {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG nova.virt.disk.api [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Cannot resize image /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk to a smaller size. {{(pid=75021) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Created local disks {{(pid=75021) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4865}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Ensure instance console log exists: /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/console.log {{(pid=75021) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4617}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Successfully updated port: c47044c9-199c-486a-a396-60db403db30a {{(pid=75021) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquired lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Building network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Instance cache missing network info. {{(pid=75021) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-2fd575f1-670a-4785-9f05-43c7a44e03db req-fd1f9e76-f022-49ec-ba1f-8013c5f43284 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Received event network-changed-c47044c9-199c-486a-a396-60db403db30a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG nova.compute.manager [req-2fd575f1-670a-4785-9f05-43c7a44e03db req-fd1f9e76-f022-49ec-ba1f-8013c5f43284 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Refreshing instance network info cache due to event network-changed-c47044c9-199c-486a-a396-60db403db30a. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:42:26 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2fd575f1-670a-4785-9f05-43c7a44e03db req-fd1f9e76-f022-49ec-ba1f-8013c5f43284 service nova] Acquiring lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.network.neutron [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updating instance_info_cache with network_info: [{"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Releasing lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Instance network_info: |[{"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75021) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2fd575f1-670a-4785-9f05-43c7a44e03db req-fd1f9e76-f022-49ec-ba1f-8013c5f43284 service nova] Acquired lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.network.neutron [req-2fd575f1-670a-4785-9f05-43c7a44e03db req-fd1f9e76-f022-49ec-ba1f-8013c5f43284 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Refreshing network info cache for port c47044c9-199c-486a-a396-60db403db30a {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Start _get_guest_xml network_info=[{"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'image_id': 'a0676e02-e61a-446d-aeb1-22dc06cf490d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7566}}
Dec 06 07:42:27 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:42:27 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] CPU controller missing on host. {{(pid=75021) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.host [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] CPU controller found on host. {{(pid=75021) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75021) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5404}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-06T06:55:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-06T06:55:22Z,direct_url=<?>,disk_format='qcow2',id=a0676e02-e61a-446d-aeb1-22dc06cf490d,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4d272cf95f0431d87ca72a2872f0124',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-06T06:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Flavor limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Image limits 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Flavor pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Image pref 0:0:0 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Got 1 possible topologies {{(pid=75021) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.hardware [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75021) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:42:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1589166433',display_name='tempest-SnapshotDataIntegrityTests-server-1589166433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1589166433',id=53,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9AorRxmja/XabFp+ERfp+pG62mjDs33fBT4qCgC3dR27gn8vrBZObTXrD0kG39pdfO0IbySiJDOCMGQsCK0RJNh1CXn56iPtTtNrEhIhMr/wSgBYHuoMZMZlq5E7ZimQ==',key_name='tempest-keypair-1643443829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42266b03404b41c4a2519332b43bdf3a',ramdisk_id='',reservation_id='r-b0tzz03y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1889008318',owner_user_name='tempest-SnapshotDataIntegrityTests-1889008318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a58d5953e812436f93039c0b07a9ac59',uuid=07e2a259-fcdb-4dc2-8148-6c1bfc32c777,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75021) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Converting VIF {"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:60:37,bridge_name='br-int',has_traffic_filtering=True,id=c47044c9-199c-486a-a396-60db403db30a,network=Network(daaf08f4-87da-4ffb-9b18-5787c3a605ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc47044c9-19') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.objects.instance [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lazy-loading 'pci_devices' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] End _get_guest_xml xml=<domain type="kvm">
Dec 06 07:42:27 user nova-compute[75021]:   <uuid>07e2a259-fcdb-4dc2-8148-6c1bfc32c777</uuid>
Dec 06 07:42:27 user nova-compute[75021]:   <name>instance-00000035</name>
Dec 06 07:42:27 user nova-compute[75021]:   <memory>524288</memory>
Dec 06 07:42:27 user nova-compute[75021]:   <vcpu>1</vcpu>
Dec 06 07:42:27 user nova-compute[75021]:   <metadata>
Dec 06 07:42:27 user nova-compute[75021]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 06 07:42:27 user nova-compute[75021]:       <nova:package version="0.0.0"/>
Dec 06 07:42:27 user nova-compute[75021]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1589166433</nova:name>
Dec 06 07:42:27 user nova-compute[75021]:       <nova:creationTime>2023-12-06 07:42:27</nova:creationTime>
Dec 06 07:42:27 user nova-compute[75021]:       <nova:flavor name="m1.tiny">
Dec 06 07:42:27 user nova-compute[75021]:         <nova:memory>512</nova:memory>
Dec 06 07:42:27 user nova-compute[75021]:         <nova:disk>1</nova:disk>
Dec 06 07:42:27 user nova-compute[75021]:         <nova:swap>0</nova:swap>
Dec 06 07:42:27 user nova-compute[75021]:         <nova:ephemeral>0</nova:ephemeral>
Dec 06 07:42:27 user nova-compute[75021]:         <nova:vcpus>1</nova:vcpus>
Dec 06 07:42:27 user nova-compute[75021]:       </nova:flavor>
Dec 06 07:42:27 user nova-compute[75021]:       <nova:owner>
Dec 06 07:42:27 user nova-compute[75021]:         <nova:user uuid="a58d5953e812436f93039c0b07a9ac59">tempest-SnapshotDataIntegrityTests-1889008318-project-member</nova:user>
Dec 06 07:42:27 user nova-compute[75021]:         <nova:project uuid="42266b03404b41c4a2519332b43bdf3a">tempest-SnapshotDataIntegrityTests-1889008318</nova:project>
Dec 06 07:42:27 user nova-compute[75021]:       </nova:owner>
Dec 06 07:42:27 user nova-compute[75021]:       <nova:root type="image" uuid="a0676e02-e61a-446d-aeb1-22dc06cf490d"/>
Dec 06 07:42:27 user nova-compute[75021]:       <nova:ports>
Dec 06 07:42:27 user nova-compute[75021]:         <nova:port uuid="c47044c9-199c-486a-a396-60db403db30a">
Dec 06 07:42:27 user nova-compute[75021]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 06 07:42:27 user nova-compute[75021]:         </nova:port>
Dec 06 07:42:27 user nova-compute[75021]:       </nova:ports>
Dec 06 07:42:27 user nova-compute[75021]:     </nova:instance>
Dec 06 07:42:27 user nova-compute[75021]:   </metadata>
Dec 06 07:42:27 user nova-compute[75021]:   <sysinfo type="smbios">
Dec 06 07:42:27 user nova-compute[75021]:     <system>
Dec 06 07:42:27 user nova-compute[75021]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 06 07:42:27 user nova-compute[75021]:       <entry name="product">OpenStack Nova</entry>
Dec 06 07:42:27 user nova-compute[75021]:       <entry name="version">0.0.0</entry>
Dec 06 07:42:27 user nova-compute[75021]:       <entry name="serial">07e2a259-fcdb-4dc2-8148-6c1bfc32c777</entry>
Dec 06 07:42:27 user nova-compute[75021]:       <entry name="uuid">07e2a259-fcdb-4dc2-8148-6c1bfc32c777</entry>
Dec 06 07:42:27 user nova-compute[75021]:       <entry name="family">Virtual Machine</entry>
Dec 06 07:42:27 user nova-compute[75021]:     </system>
Dec 06 07:42:27 user nova-compute[75021]:   </sysinfo>
Dec 06 07:42:27 user nova-compute[75021]:   <os>
Dec 06 07:42:27 user nova-compute[75021]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 06 07:42:27 user nova-compute[75021]:     <boot dev="hd"/>
Dec 06 07:42:27 user nova-compute[75021]:     <smbios mode="sysinfo"/>
Dec 06 07:42:27 user nova-compute[75021]:   </os>
Dec 06 07:42:27 user nova-compute[75021]:   <features>
Dec 06 07:42:27 user nova-compute[75021]:     <acpi/>
Dec 06 07:42:27 user nova-compute[75021]:     <apic/>
Dec 06 07:42:27 user nova-compute[75021]:     <vmcoreinfo/>
Dec 06 07:42:27 user nova-compute[75021]:   </features>
Dec 06 07:42:27 user nova-compute[75021]:   <clock offset="utc">
Dec 06 07:42:27 user nova-compute[75021]:     <timer name="pit" tickpolicy="delay"/>
Dec 06 07:42:27 user nova-compute[75021]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 06 07:42:27 user nova-compute[75021]:     <timer name="hpet" present="no"/>
Dec 06 07:42:27 user nova-compute[75021]:   </clock>
Dec 06 07:42:27 user nova-compute[75021]:   <cpu mode="custom" match="exact">
Dec 06 07:42:27 user nova-compute[75021]:     <model>Nehalem</model>
Dec 06 07:42:27 user nova-compute[75021]:     <topology sockets="1" cores="1" threads="1"/>
Dec 06 07:42:27 user nova-compute[75021]:   </cpu>
Dec 06 07:42:27 user nova-compute[75021]:   <devices>
Dec 06 07:42:27 user nova-compute[75021]:     <disk type="file" device="disk">
Dec 06 07:42:27 user nova-compute[75021]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 06 07:42:27 user nova-compute[75021]:       <source file="/opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk"/>
Dec 06 07:42:27 user nova-compute[75021]:       <target dev="vda" bus="virtio"/>
Dec 06 07:42:27 user nova-compute[75021]:     </disk>
Dec 06 07:42:27 user nova-compute[75021]:     <interface type="ethernet">
Dec 06 07:42:27 user nova-compute[75021]:       <mac address="fa:16:3e:90:60:37"/>
Dec 06 07:42:27 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:42:27 user nova-compute[75021]:       <mtu size="1442"/>
Dec 06 07:42:27 user nova-compute[75021]:       <target dev="tapc47044c9-19"/>
Dec 06 07:42:27 user nova-compute[75021]:     </interface>
Dec 06 07:42:27 user nova-compute[75021]:     <serial type="pty">
Dec 06 07:42:27 user nova-compute[75021]:       <log file="/opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/console.log" append="off"/>
Dec 06 07:42:27 user nova-compute[75021]:     </serial>
Dec 06 07:42:27 user nova-compute[75021]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 06 07:42:27 user nova-compute[75021]:     <video>
Dec 06 07:42:27 user nova-compute[75021]:       <model type="virtio"/>
Dec 06 07:42:27 user nova-compute[75021]:     </video>
Dec 06 07:42:27 user nova-compute[75021]:     <rng model="virtio">
Dec 06 07:42:27 user nova-compute[75021]:       <backend model="random">/dev/urandom</backend>
Dec 06 07:42:27 user nova-compute[75021]:     </rng>
Dec 06 07:42:27 user nova-compute[75021]:     <controller type="usb" index="0" model="none"/>
Dec 06 07:42:27 user nova-compute[75021]:     <memballoon model="virtio">
Dec 06 07:42:27 user nova-compute[75021]:       <stats period="10"/>
Dec 06 07:42:27 user nova-compute[75021]:     </memballoon>
Dec 06 07:42:27 user nova-compute[75021]:   </devices>
Dec 06 07:42:27 user nova-compute[75021]: </domain>
Dec 06 07:42:27 user nova-compute[75021]:  {{(pid=75021) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7572}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:42:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1589166433',display_name='tempest-SnapshotDataIntegrityTests-server-1589166433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1589166433',id=53,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9AorRxmja/XabFp+ERfp+pG62mjDs33fBT4qCgC3dR27gn8vrBZObTXrD0kG39pdfO0IbySiJDOCMGQsCK0RJNh1CXn56iPtTtNrEhIhMr/wSgBYHuoMZMZlq5E7ZimQ==',key_name='tempest-keypair-1643443829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42266b03404b41c4a2519332b43bdf3a',ramdisk_id='',reservation_id='r-b0tzz03y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1889008318',owner_user_name='tempest-SnapshotDataIntegrityTests-1889008318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-06T07:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a58d5953e812436f93039c0b07a9ac59',uuid=07e2a259-fcdb-4dc2-8148-6c1bfc32c777,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Converting VIF {"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:60:37,bridge_name='br-int',has_traffic_filtering=True,id=c47044c9-199c-486a-a396-60db403db30a,network=Network(daaf08f4-87da-4ffb-9b18-5787c3a605ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc47044c9-19') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG os_vif [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:60:37,bridge_name='br-int',has_traffic_filtering=True,id=c47044c9-199c-486a-a396-60db403db30a,network=Network(daaf08f4-87da-4ffb-9b18-5787c3a605ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc47044c9-19') {{(pid=75021) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c35ca027-47a8-5f03-9eba-51266716b5a2', '_type': 'linux-noop'}}, row=False) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc47044c9-19, may_exist=True, interface_attrs={}) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc47044c9-19, col_values=(('qos', UUID('e746bc85-4912-4eff-ae0c-8543f4bd6d44')),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc47044c9-19, col_values=(('external_ids', {'iface-id': 'c47044c9-199c-486a-a396-60db403db30a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:60:37', 'vm-uuid': '07e2a259-fcdb-4dc2-8148-6c1bfc32c777'}),), if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:27 user nova-compute[75021]: INFO os_vif [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:60:37,bridge_name='br-int',has_traffic_filtering=True,id=c47044c9-199c-486a-a396-60db403db30a,network=Network(daaf08f4-87da-4ffb-9b18-5787c3a605ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc47044c9-19')
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] No VIF found with MAC fa:16:3e:90:60:37, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.network.neutron [req-2fd575f1-670a-4785-9f05-43c7a44e03db req-fd1f9e76-f022-49ec-ba1f-8013c5f43284 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updated VIF entry in instance network info cache for port c47044c9-199c-486a-a396-60db403db30a. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG nova.network.neutron [req-2fd575f1-670a-4785-9f05-43c7a44e03db req-fd1f9e76-f022-49ec-ba1f-8013c5f43284 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updating instance_info_cache with network_info: [{"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:42:27 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2fd575f1-670a-4785-9f05-43c7a44e03db req-fd1f9e76-f022-49ec-ba1f-8013c5f43284 service nova] Releasing lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:42:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-dcc2720c-9ce5-4c76-9314-8033bfbc9871 req-e51c6e49-ee3b-4266-b8a1-0ab1a64a39fd service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Received event network-vif-plugged-c47044c9-199c-486a-a396-60db403db30a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:42:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dcc2720c-9ce5-4c76-9314-8033bfbc9871 req-e51c6e49-ee3b-4266-b8a1-0ab1a64a39fd service nova] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:42:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dcc2720c-9ce5-4c76-9314-8033bfbc9871 req-e51c6e49-ee3b-4266-b8a1-0ab1a64a39fd service nova] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:42:29 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-dcc2720c-9ce5-4c76-9314-8033bfbc9871 req-e51c6e49-ee3b-4266-b8a1-0ab1a64a39fd service nova] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:42:29 user nova-compute[75021]: DEBUG nova.compute.manager [req-dcc2720c-9ce5-4c76-9314-8033bfbc9871 req-e51c6e49-ee3b-4266-b8a1-0ab1a64a39fd service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] No waiting events found dispatching network-vif-plugged-c47044c9-199c-486a-a396-60db403db30a {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:42:29 user nova-compute[75021]: WARNING nova.compute.manager [req-dcc2720c-9ce5-4c76-9314-8033bfbc9871 req-e51c6e49-ee3b-4266-b8a1-0ab1a64a39fd service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Received unexpected event network-vif-plugged-c47044c9-199c-486a-a396-60db403db30a for instance with vm_state building and task_state spawning.
Dec 06 07:42:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:29 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-1cdcd663-8ee5-44af-ac00-2675cc1ff716 req-4a326f4e-b66d-49aa-9b2b-abc659bbac3e service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Received event network-vif-plugged-c47044c9-199c-486a-a396-60db403db30a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:42:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1cdcd663-8ee5-44af-ac00-2675cc1ff716 req-4a326f4e-b66d-49aa-9b2b-abc659bbac3e service nova] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:42:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1cdcd663-8ee5-44af-ac00-2675cc1ff716 req-4a326f4e-b66d-49aa-9b2b-abc659bbac3e service nova] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:42:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-1cdcd663-8ee5-44af-ac00-2675cc1ff716 req-4a326f4e-b66d-49aa-9b2b-abc659bbac3e service nova] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:42:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-1cdcd663-8ee5-44af-ac00-2675cc1ff716 req-4a326f4e-b66d-49aa-9b2b-abc659bbac3e service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] No waiting events found dispatching network-vif-plugged-c47044c9-199c-486a-a396-60db403db30a {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:42:31 user nova-compute[75021]: WARNING nova.compute.manager [req-1cdcd663-8ee5-44af-ac00-2675cc1ff716 req-4a326f4e-b66d-49aa-9b2b-abc659bbac3e service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Received unexpected event network-vif-plugged-c47044c9-199c-486a-a396-60db403db30a for instance with vm_state building and task_state spawning.
Dec 06 07:42:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Instance event wait completed in 0 seconds for  {{(pid=75021) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 06 07:42:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Guest created on hypervisor {{(pid=75021) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 06 07:42:31 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Instance spawned successfully.
Dec 06 07:42:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 06 07:42:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Found default for hw_cdrom_bus of ide {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:42:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Found default for hw_disk_bus of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:42:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Found default for hw_input_bus of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:42:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Found default for hw_pointer_model of None {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:42:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Found default for hw_video_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:42:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Found default for hw_vif_model of virtio {{(pid=75021) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 06 07:42:31 user nova-compute[75021]: INFO nova.compute.manager [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Took 6.44 seconds to spawn the instance on the hypervisor.
Dec 06 07:42:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Checking state {{(pid=75021) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 06 07:42:31 user nova-compute[75021]: INFO nova.compute.manager [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Took 7.04 seconds to build instance.
Dec 06 07:42:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-9151c689-7382-446a-b12a-89acb1f618c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.167s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:42:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:42:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:42:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:42:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:42:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:42:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:42:33 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:42:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updating instance_info_cache with network_info: [{"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:42:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:42:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:42:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:42:34 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:42:34 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:42:34 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:42:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:42:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:42:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:42:34 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:42:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:42:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:42:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:42:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:34 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:42:35 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:42:35 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:42:35 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=25.17296600341797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:42:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:42:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:42:35 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:42:35 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:42:35 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:42:35 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:42:35 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:42:35 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:42:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:42:36 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:42:36 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:42:36 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:42:37 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:42:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:38 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:42:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:42:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:42:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:43:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:43:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:43:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:43:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:43:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:43:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:43:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:43:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:43:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:43:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:43:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:43:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:43:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:43:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:43:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:43:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:43:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:43:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:43:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:43:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:43:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:43:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:43:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:43:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:43:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:43:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:43:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:43:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:43:33 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:43:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:43:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:43:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:43:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:43:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:43:33 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:43:33 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updating instance_info_cache with network_info: [{"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:43:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:43:33 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:43:35 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:43:35 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:43:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:43:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:43:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:43:35 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:43:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:43:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:43:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:43:35 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:43:36 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:43:36 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:43:36 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=25.141887664794922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:43:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:43:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:43:36 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:43:36 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:43:36 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:43:36 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:43:36 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:43:36 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:43:36 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:43:37 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:43:37 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:43:37 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:43:37 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:43:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:43:38 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:43:38 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:43:39 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:43:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:43:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:43:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:43:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:43:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:43:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:43:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:43:51 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:43:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:43:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:43:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:43:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:43:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:43:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:43:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:44:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:44:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:44:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:44:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:44:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:44:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:44:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:44:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:44:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:44:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:44:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:44:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:44:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:44:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-2013781d-d6a8-4e36-9bd2-f363429bb334 req-637e7645-8050-4cba-a586-0e2543bd82f2 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Received event network-changed-c47044c9-199c-486a-a396-60db403db30a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:44:15 user nova-compute[75021]: DEBUG nova.compute.manager [req-2013781d-d6a8-4e36-9bd2-f363429bb334 req-637e7645-8050-4cba-a586-0e2543bd82f2 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Refreshing instance network info cache due to event network-changed-c47044c9-199c-486a-a396-60db403db30a. {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 06 07:44:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2013781d-d6a8-4e36-9bd2-f363429bb334 req-637e7645-8050-4cba-a586-0e2543bd82f2 service nova] Acquiring lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:44:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2013781d-d6a8-4e36-9bd2-f363429bb334 req-637e7645-8050-4cba-a586-0e2543bd82f2 service nova] Acquired lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:44:15 user nova-compute[75021]: DEBUG nova.network.neutron [req-2013781d-d6a8-4e36-9bd2-f363429bb334 req-637e7645-8050-4cba-a586-0e2543bd82f2 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Refreshing network info cache for port c47044c9-199c-486a-a396-60db403db30a {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 06 07:44:15 user nova-compute[75021]: DEBUG nova.network.neutron [req-2013781d-d6a8-4e36-9bd2-f363429bb334 req-637e7645-8050-4cba-a586-0e2543bd82f2 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updated VIF entry in instance network info cache for port c47044c9-199c-486a-a396-60db403db30a. {{(pid=75021) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 06 07:44:15 user nova-compute[75021]: DEBUG nova.network.neutron [req-2013781d-d6a8-4e36-9bd2-f363429bb334 req-637e7645-8050-4cba-a586-0e2543bd82f2 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updating instance_info_cache with network_info: [{"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:44:15 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-2013781d-d6a8-4e36-9bd2-f363429bb334 req-637e7645-8050-4cba-a586-0e2543bd82f2 service nova] Releasing lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:44:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lazy-loading 'flavor' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:44:19 user nova-compute[75021]: INFO nova.compute.manager [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Attaching volume b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea to /dev/vdb
Dec 06 07:44:19 user nova-compute[75021]: DEBUG os_brick.utils [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[71328909-435b-4082-a2e5-fa8126a04dbc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9e6d0b-f752-4e41-bc3a-cea0f2c82d9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fba86d5-1e68-4d61-b66b-eeda96214d3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e45c22c-28c2-43cd-b954-ac4ae95bf17a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:44:19 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:44:19 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df86e1e-e054-4a42-a2bf-a2f35ae0fced]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG os_brick.utils [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updating existing volume attachment record: b1326439-9570-47de-80ca-bc565a3d4815 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:44:19 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:44:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:44:24 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:44:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCOaGwUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:44:28 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:44:28 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:44:28 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e900ebd-727b-41b2-975a-f2d1128f934f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:44:28 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f2cb81-493a-404f-add5-69eb19fabc0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea] added
Dec 06 07:44:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[125ee8b3-2cbb-4921-b311-22d98bb14897]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba8da26-cd2d-46d0-b0ac-1bc1d3553f8e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NCOaGwUm {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NCOaGwUm" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f35a0f-7a41-451b-88dc-fe0be551c9e5]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NCOaGwUm'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b7a2cc-d507-4f8c-a184-a0f821894251]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[132038fd-3485-4fb2-b3db-085e0a4fcb32]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:44:28 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:44:28 user nova-compute[75021]:  {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:44:28 user nova-compute[75021]: WARNING os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 07:44:28 user nova-compute[75021]: 
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[197027fd-04c7-4be4-b3f1-85b9c0191a9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea, portal: 172.16.0.220,3260]
Dec 06 07:44:28 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea, portal: 172.16.0.220,3260] successful.
Dec 06 07:44:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c00a7c-5351-4af1-b92e-1ea0e8687255]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e524b4a9-c1fb-4d40-b0c1-601a2d862176]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea (non-flash)
Dec 06 07:44:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea (non-flash)
Dec 06 07:44:28 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73699ba-5395-45f2-b8a8-d3470d929646]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:44:28 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCOaGwUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:44:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:44:29 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23438636439386663', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:44:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438636439386663', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:44:29 user nova-compute[75021]: DEBUG nova.objects.instance [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lazy-loading 'flavor' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:44:29 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:44:29 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:44:29 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:44:29 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:44:29 user nova-compute[75021]:   <serial>b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea</serial>
Dec 06 07:44:29 user nova-compute[75021]: </disk>
Dec 06 07:44:29 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:44:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:44:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:44:30 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] No VIF found with MAC fa:16:3e:90:60:37, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:44:30 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-e00b5a9d-ef57-499f-a947-e441cd1c06bc tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.925s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:44:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:44:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:44:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:44:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:44:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:44:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:44:34 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:44:35 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:44:35 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:44:35 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:44:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:44:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:44:35 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:44:35 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:44:35 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updating instance_info_cache with network_info: [{"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:44:35 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:44:35 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:44:35 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:44:37 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:44:37 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:44:37 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:44:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:44:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:44:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:44:37 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:44:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:44:37 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:44:37 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75021) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11218}}
Dec 06 07:44:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:44:37 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:44:37 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:44:38 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=9056MB free_disk=25.140621185302734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:44:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:44:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:44:38 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:44:38 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:44:38 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:44:38 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:44:38 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:44:38 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:44:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:44:39 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:44:39 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:44:39 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:44:39 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:44:40 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:44:41 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:44:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:44:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:44:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:44:47 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:44:47 user nova-compute[75021]: INFO nova.compute.manager [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Detaching volume b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea
Dec 06 07:44:47 user nova-compute[75021]: INFO nova.virt.block_device [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Attempting to driver detach volume b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea from mountpoint /dev/vdb
Dec 06 07:44:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Attempting to detach device vdb from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:44:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:44:47 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:44:47 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:44:47 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:44:47 user nova-compute[75021]:   <serial>b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea</serial>
Dec 06 07:44:47 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:44:47 user nova-compute[75021]: </disk>
Dec 06 07:44:47 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:44:47 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Successfully detached device vdb from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the persistent domain config.
Dec 06 07:44:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:44:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:44:47 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:44:47 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:44:47 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:44:47 user nova-compute[75021]:   <serial>b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea</serial>
Dec 06 07:44:47 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:44:47 user nova-compute[75021]: </disk>
Dec 06 07:44:47 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:44:47 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:44:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:44:49 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:44:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:44:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:44:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:44:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:44:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:44:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:44:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:45:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:45:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:07 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 is timed out.
Dec 06 07:45:07 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Successfully detached device vdb from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the live domain config.
Dec 06 07:45:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:45:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCOaGwUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:45:07 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:45:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:45:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:45:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:07 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79317bd-853b-484d-9274-f517a5cbcb1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:45:07 user nova-compute[75021]: No targets found.
Dec 06 07:45:07 user nova-compute[75021]: iSNS:
Dec 06 07:45:07 user nova-compute[75021]: No targets found.
Dec 06 07:45:07 user nova-compute[75021]: STATIC:
Dec 06 07:45:07 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea
Dec 06 07:45:07 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:45:07 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:45:07 user nova-compute[75021]: FIRMWARE:
Dec 06 07:45:07 user nova-compute[75021]: No targets found.
Dec 06 07:45:07 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:45:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:45:07 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:45:07 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:45:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:45:07 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73fa9f7-8b74-4ead-96ce-df5daa7a34c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[693d2cf5-4e7b-41b1-8d4a-c67a9cb203c3]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea (non-flash)
Dec 06 07:45:08 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea (non-flash)
Dec 06 07:45:08 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d82de560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4daddf-7bc6-4623-bd9b-58d15cbbe6fb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[7921b4f1-b617-47ff-a67a-21a6f484b2d6]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb761a3f-832f-44fb-8fcc-4a5a376480e1]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7504cbe-6615-49bf-b164-7be58b7ed467]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bdc16e-5cb7-4f66-b537-32f426bca02b]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d8680f-ed6f-4a31-8b96-2a73af2ef42a]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea, portal: 172.16.0.220,3260]
Dec 06 07:45:08 user nova-compute[75021]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea, portal: 172.16.0.220,3260] successful.
Dec 06 07:45:08 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4d567ae-f6d6-4925-9c3d-8e1cfb95d9ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49e32d7-c7a3-4de7-94e3-648a20222d9f]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] <== disconnect_volume: return (330ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:45:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:45:09 user nova-compute[75021]: DEBUG nova.objects.instance [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lazy-loading 'flavor' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:45:09 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4e01d6b7-3d0b-48f9-a698-3f53fbc222c7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.714s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:45:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:45:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:45:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:45:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:45:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:45:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:45:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:45:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:45:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:45:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:45:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:32 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:45:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:45:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:45:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:35 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:45:37 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:45:37 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:45:37 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:45:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:45:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:45:37 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:45:37 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:45:37 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updating instance_info_cache with network_info: [{"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:45:37 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:45:37 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:45:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:45:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:45:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:38 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:45:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:45:39 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:45:39 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:45:39 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:45:39 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:45:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:45:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:45:39 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:45:39 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:45:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:39 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:40 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:45:40 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:45:40 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=9065MB free_disk=25.139732360839844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG nova.objects.instance [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lazy-loading 'flavor' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:45:40 user nova-compute[75021]: INFO nova.compute.manager [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Attaching volume 5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d to /dev/vdb
Dec 06 07:45:40 user nova-compute[75021]: DEBUG os_brick.utils [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e39cc90-80d0-454f-b3e9-70ab0dd89163]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b6a35e-e657-4f92-be9b-bfaeb31fb3df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5f0e72-3fe8-4752-a4c0-39dadcfa03e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0702ad65-60da-43a5-a7df-0cf41c2d869e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:45:40 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:45:40 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b28056a-137c-47e2-89c6-7a555088f6bf]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG os_brick.utils [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:45:40 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updating existing volume attachment record: 17810c05-fec8-4852-bfa2-d522a725da99 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:45:42 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:45:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:45:43 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:45:44 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMIUzqNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:45:52 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:45:52 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:45:52 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8be5199-1692-4750-81c4-dacfbf18ca17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:45:52 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a813ee13-1a65-4654-b29a-24bbaebe0575]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d] added
Dec 06 07:45:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d42839e-6bd0-4c5c-9083-9f45d5ad7ebc]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c411c2e-67ff-41f1-84be-e26e4811236a]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMIUzqNS {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMIUzqNS" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97008e8-e905-4e6a-81ea-cdd9b9db5f21]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VMIUzqNS'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c444b6e-92f2-4094-b9f6-b055bb167921]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d15309-2322-44a5-9d9e-d8a860cfaad9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:45:52 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:45:52 user nova-compute[75021]:  {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:45:52 user nova-compute[75021]: WARNING os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 07:45:52 user nova-compute[75021]: 
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edc50b2-fdc2-4b2d-9599-73c468beba4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d, portal: 172.16.0.220,3260]
Dec 06 07:45:52 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d, portal: 172.16.0.220,3260] successful.
Dec 06 07:45:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[583bcb73-b435-40a7-868a-1a7f85ddc654]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[26be800f-e715-460d-b278-d1c7c4071b89]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d (non-flash)
Dec 06 07:45:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d (non-flash)
Dec 06 07:45:52 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:45:52 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:45:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:45:53 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:45:53 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[45098790-b25e-43c0-9258-3e00d381331d]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:45:53 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:45:53 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMIUzqNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:45:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:45:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:45:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:45:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:45:54 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '23665383061396463', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:45:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665383061396463', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:45:54 user nova-compute[75021]: DEBUG nova.objects.instance [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lazy-loading 'flavor' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:45:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:45:54 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:45:54 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:45:54 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:45:54 user nova-compute[75021]:   <serial>5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d</serial>
Dec 06 07:45:54 user nova-compute[75021]: </disk>
Dec 06 07:45:54 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:45:54 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:45:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:45:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:45:54 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] No VIF found with MAC fa:16:3e:90:60:37, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:45:54 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-47aacbda-f5f9-49f3-855b-4e6dbe9807be tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.932s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:45:55 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:45:55 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Triggering sync for uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 06 07:45:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:45:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:45:55 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:45:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:45:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:45:57 user nova-compute[75021]: INFO nova.compute.manager [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Detaching volume 5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d
Dec 06 07:45:57 user nova-compute[75021]: INFO nova.virt.block_device [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Attempting to driver detach volume 5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d from mountpoint /dev/vdb
Dec 06 07:45:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Attempting to detach device vdb from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:45:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:45:57 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:45:57 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:45:57 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:45:57 user nova-compute[75021]:   <serial>5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d</serial>
Dec 06 07:45:57 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:45:57 user nova-compute[75021]: </disk>
Dec 06 07:45:57 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:45:57 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Successfully detached device vdb from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the persistent domain config.
Dec 06 07:45:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:45:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:45:57 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:45:57 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:45:57 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:45:57 user nova-compute[75021]:   <serial>5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d</serial>
Dec 06 07:45:57 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:45:57 user nova-compute[75021]: </disk>
Dec 06 07:45:57 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:45:57 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:45:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:45:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:45:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:45:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:45:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:46:00 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:46:00 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75021) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 06 07:46:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:46:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:46:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:46:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:46:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:46:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:46:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:46:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:46:17 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 is timed out.
Dec 06 07:46:17 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Successfully detached device vdb from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the live domain config.
Dec 06 07:46:17 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMIUzqNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:46:17 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c04835-8697-42d2-a297-4246e7811094]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:46:17 user nova-compute[75021]: No targets found.
Dec 06 07:46:17 user nova-compute[75021]: iSNS:
Dec 06 07:46:17 user nova-compute[75021]: No targets found.
Dec 06 07:46:17 user nova-compute[75021]: STATIC:
Dec 06 07:46:17 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d
Dec 06 07:46:17 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:46:17 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:46:17 user nova-compute[75021]: FIRMWARE:
Dec 06 07:46:17 user nova-compute[75021]: No targets found.
Dec 06 07:46:17 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:46:17 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:46:17 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[96628701-88ce-457c-8857-982afaed97c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[71953b76-b3d4-40d3-9794-dc1b26c23e2f]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d (non-flash)
Dec 06 07:46:17 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d (non-flash)
Dec 06 07:46:17 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b45ff370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd357f4-cc82-493a-aaaa-cae15daeb9b1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab0c2d9-17d9-4770-88c0-072bd51155cd]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da68249-34ca-4d83-9e81-00d4e855925d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14a7890-0f6c-4e21-b178-7dfdc0f36838]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebdf623-5201-4d55-b429-10db04067ecc]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86e49aa-cf08-458a-bd0d-3a3b85093cd9]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d, portal: 172.16.0.220,3260]
Dec 06 07:46:17 user nova-compute[75021]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d, portal: 172.16.0.220,3260] successful.
Dec 06 07:46:17 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:46:17 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:18 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea811e1-8ecc-4fa8-a16a-9b05ccce1a8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:18 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd643dc-512c-4477-be9d-eb5d00ac71e6]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:46:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:46:18 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] <== disconnect_volume: return (289ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:46:18 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:46:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:46:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:46:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:46:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:46:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:46:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:46:18 user nova-compute[75021]: DEBUG nova.objects.instance [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lazy-loading 'flavor' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:46:19 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-128bf181-2867-4938-a2a5-3033bfb260a7 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.828s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:46:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:46:26 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:46:26 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Cleaning up deleted instances {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 06 07:46:26 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] There are 0 instances to clean {{(pid=75021) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 06 07:46:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:46:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:46:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:46:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:46:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:46:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:46:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:46:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:46:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:46:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:46:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:46:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:46:37 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:46:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:46:38 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:46:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:46:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:46:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:46:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:46:38 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:46:38 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:46:38 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updating instance_info_cache with network_info: [{"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:46:38 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:46:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:46:38 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:46:38 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:46:40 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:46:41 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:46:41 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:46:41 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:46:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:46:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:46:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:46:41 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:46:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:41 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:46:41 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:46:41 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=9047MB free_disk=25.130966186523438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:46:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:46:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:46:42 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:46:42 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:46:42 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:46:42 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing inventories for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 06 07:46:42 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Updating ProviderTree inventory for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 06 07:46:42 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Updating inventory in ProviderTree for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 06 07:46:42 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing aggregate associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, aggregates: None {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 06 07:46:42 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Refreshing trait associations for resource provider 33dec8e2-b735-4a70-a668-4c31a23cece2, traits: HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75021) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 06 07:46:42 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:46:42 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:46:42 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:46:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:46:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:46:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:46:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:46:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:46:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:46:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:46:44 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:46:44 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:46:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:46:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:46:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:46:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:46:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:46:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG nova.objects.instance [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lazy-loading 'flavor' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:46:50 user nova-compute[75021]: INFO nova.compute.manager [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Attaching volume b49916f6-a771-427f-9577-f65902b74a25 to /dev/vdb
Dec 06 07:46:50 user nova-compute[75021]: DEBUG os_brick.utils [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1f90f5-3009-4789-9303-4cabf8773682]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aa3901-8cb3-479a-8beb-14681c70c29d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e00e928-4085-4bba-a512-e2c5229d34e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[af269fe1-1ccd-480c-89c7-4cf28f39b9a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:46:50 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:46:50 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cf6e85-37d8-41ac-80b6-663a12aca719]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG os_brick.utils [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:46:50 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updating existing volume attachment record: 5ce38f1f-1af4-458e-b08a-ff6f412c52d5 {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:46:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:46:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:46:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:46:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:46:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:46:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:46:54 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:46:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsGhuByj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:46:59 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:46:59 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:46:59 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa269821-9dd2-44cf-9f0d-9891b8970a24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:46:59 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[12448669-2f1a-4f08-930b-eab8549f98c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25] added
Dec 06 07:46:59 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[54236d45-7ebb-41c2-8362-bfd2097aa100]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.045s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce80ed1-9876-4ce2-a093-1a6c5a9d8886]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsGhuByj {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsGhuByj" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae18a2b-e85b-4156-8241-f27ee3663827]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fsGhuByj'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[518a1f2a-34a0-4fa1-b045-d5cdfd0782ea]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e773d2e8-f9ff-4081-a92d-944f431f4482]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:46:59 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:46:59 user nova-compute[75021]:  {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:46:59 user nova-compute[75021]: WARNING os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 07:46:59 user nova-compute[75021]: 
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a0fd37-0b62-4d62-a31e-2f8c105528f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25, portal: 172.16.0.220,3260]
Dec 06 07:46:59 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25, portal: 172.16.0.220,3260] successful.
Dec 06 07:46:59 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14c5283-2718-4780-b335-e0bac91d9dca]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[37581d78-c3ec-4f31-989e-ff9b2437d6a2]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 (non-flash)
Dec 06 07:46:59 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 (non-flash)
Dec 06 07:46:59 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6f633f-9482-4cb8-8fb1-a4701e63fd47]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:46:59 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsGhuByj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:47:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:47:00 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26562633764656166', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:47:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562633764656166', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:47:00 user nova-compute[75021]: DEBUG nova.objects.instance [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lazy-loading 'flavor' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:47:00 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:47:00 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:47:00 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:47:00 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:47:00 user nova-compute[75021]:   <serial>b49916f6-a771-427f-9577-f65902b74a25</serial>
Dec 06 07:47:00 user nova-compute[75021]: </disk>
Dec 06 07:47:00 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:47:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:47:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:47:01 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] No VIF found with MAC fa:16:3e:90:60:37, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:47:01 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-4353e4df-7cc6-4168-b085-5dd792eba281 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.965s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:47:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:47:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:47:04 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:47:04 user nova-compute[75021]: INFO nova.compute.manager [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Detaching volume b49916f6-a771-427f-9577-f65902b74a25
Dec 06 07:47:04 user nova-compute[75021]: INFO nova.virt.block_device [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Attempting to driver detach volume b49916f6-a771-427f-9577-f65902b74a25 from mountpoint /dev/vdb
Dec 06 07:47:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Attempting to detach device vdb from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:47:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:47:04 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:47:04 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:47:04 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:47:04 user nova-compute[75021]:   <serial>b49916f6-a771-427f-9577-f65902b74a25</serial>
Dec 06 07:47:04 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:47:04 user nova-compute[75021]: </disk>
Dec 06 07:47:04 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:47:04 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Successfully detached device vdb from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the persistent domain config.
Dec 06 07:47:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:47:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:47:04 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:47:04 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:47:04 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:47:04 user nova-compute[75021]:   <serial>b49916f6-a771-427f-9577-f65902b74a25</serial>
Dec 06 07:47:04 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:47:04 user nova-compute[75021]: </disk>
Dec 06 07:47:04 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:47:04 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:47:04 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:47:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:47:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:47:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:47:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:47:24 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 is timed out.
Dec 06 07:47:24 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Successfully detached device vdb from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the live domain config.
Dec 06 07:47:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsGhuByj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:47:24 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2443a4-3c74-4814-a3b6-79a5cbb7889e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:47:24 user nova-compute[75021]: No targets found.
Dec 06 07:47:24 user nova-compute[75021]: iSNS:
Dec 06 07:47:24 user nova-compute[75021]: No targets found.
Dec 06 07:47:24 user nova-compute[75021]: STATIC:
Dec 06 07:47:24 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25
Dec 06 07:47:24 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:47:24 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:47:24 user nova-compute[75021]: FIRMWARE:
Dec 06 07:47:24 user nova-compute[75021]: No targets found.
Dec 06 07:47:24 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:47:24 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:47:24 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aadb2bd-322d-4e01-b81f-9fdcf0fe0316]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8a69b5-7949-4165-9bf3-652201520bf9]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 (non-flash)
Dec 06 07:47:24 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 (non-flash)
Dec 06 07:47:24 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89d84223b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[493fa207-ce3c-40a8-91b8-2b6b72fd492e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[930ff8ed-6aa4-4bee-a415-fe656e6546b8]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[1309c1cd-edca-47e8-b1b0-470e257ace40]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bed6ee-47da-4369-9ca2-1eb05a3f55d4]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fa5a3b-3788-472b-930e-3a4744a00c03]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[95593e2c-9d7c-4d75-8e63-d3daa431db03]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25, portal: 172.16.0.220,3260]
Dec 06 07:47:24 user nova-compute[75021]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25, portal: 172.16.0.220,3260] successful.
Dec 06 07:47:24 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b49916f6-a771-427f-9577-f65902b74a25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[694e3888-fc7a-4989-876a-59a1906e498e]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] <== disconnect_volume: return (256ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:47:24 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:47:25 user nova-compute[75021]: DEBUG nova.objects.instance [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lazy-loading 'flavor' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:47:25 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-cc54ec9a-7311-4250-9975-e73592950195 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.927s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:47:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:47:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:47:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:47:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:47:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:47:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:47:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:47:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:47:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:47:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:47:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:47:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:47:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:47:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:47:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:47:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:47:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:47:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:47:38 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:47:40 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:47:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:47:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:47:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:47:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:47:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:47:40 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:47:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updating instance_info_cache with network_info: [{"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:47:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:47:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:47:40 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:47:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:47:41 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:47:41 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:47:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:47:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:47:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:47:41 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:47:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:47:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:41 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:47:41 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:47:41 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:47:41 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=9048MB free_disk=25.129989624023438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:47:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:47:41 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:47:42 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:47:42 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:47:42 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:47:42 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:47:42 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:47:42 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:47:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:47:43 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:47:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:47:43 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:47:44 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:47:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:47:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:47:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:47:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:47:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:47:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:47:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:47:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:47:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:47:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:47:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:47:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:47:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG nova.objects.instance [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lazy-loading 'flavor' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:47:57 user nova-compute[75021]: INFO nova.compute.manager [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Attaching volume f1d9edea-c8af-4cce-8037-bfd7f4559b4d to /dev/vdb
Dec 06 07:47:57 user nova-compute[75021]: DEBUG os_brick.utils [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d723e512-fc8d-40c7-b8e0-95625f52f19c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e518dca36488\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab969c47-ad32-4da9-9217-75919da05966]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed16ccc7-eb4e-4525-8f7f-6a8b626842d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec30641-1972-4cd3-9fa3-f5ca4d8acead]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Running cmd (subprocess): nvme version {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] 'nvme version' failed. Not Retrying. {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] nvme not present on system {{(pid=75021) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 06 07:47:57 user nova-compute[75021]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 06 07:47:57 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[755bf82d-5483-4248-ad29-bbcd337f605f]: (4, '') {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75021) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.lightos [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] LIGHTOS: no hostnqn found. {{(pid=75021) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG os_brick.utils [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e518dca36488', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:47:57 user nova-compute[75021]: DEBUG nova.virt.block_device [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updating existing volume attachment record: d90e161f-f087-4b3b-b846-f96b72d56b5c {{(pid=75021) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 06 07:47:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:47:59 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Calling os-brick to attach iSCSI Volume {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcwLHkmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:48:06 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:48:06 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:48:06 user nova-compute[75021]: INFO os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[db581ce3-67fa-4b13-9008-4cbea973e050]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 06 07:48:06 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --interface default --op new {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e84198-5336-44df-9211-d09e246f449d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d] added\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d] added
Dec 06 07:48:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.149s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dca40b-d6d3-4a85-8d71-7dcbad1e96cb]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3574b5-33fb-40b3-af98-988a2158f5e3]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BcwLHkmZ {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BcwLHkmZ" returned: 0 in 0.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[df67e54e-0c07-4e34-84d3-0ad764d90326]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BcwLHkmZ'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.054s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[378cba35-3c2f-4081-b3fd-a7200c0f9805]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[26919145-2c51-40bc-a464-c11aee233559]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:48:06 user nova-compute[75021]:  {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 06 07:48:06 user nova-compute[75021]:  {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:48:06 user nova-compute[75021]: WARNING os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 06 07:48:06 user nova-compute[75021]: 
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --login {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d30d662-6a68-42ec-ba49-e6e1a49c9d5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d, portal: 172.16.0.220,3260]
Dec 06 07:48:06 user nova-compute[75021]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d, portal: 172.16.0.220,3260] successful.
Dec 06 07:48:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd1d2df-eb65-437a-a424-955fed384a22]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f87d5ad-f3b0-42f7-b88f-473e9e73c2f0]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d (non-flash)
Dec 06 07:48:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d (non-flash)
Dec 06 07:48:06 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.444s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Connected to 172.16.0.220:3260 {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75021) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75021) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afd3d94-8142-42cd-9df4-5adea1c0a436]: (4, ('- - 0', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:06 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:48:07 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75021) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 06 07:48:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcwLHkmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75021) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 06 07:48:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.474s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:48:07 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] <== connect_volume: return (1476ms) {'type': 'block', 'scsi_wwn': '23162346430383132', 'path': '/dev/sdb'} {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:48:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162346430383132', 'path': '/dev/sdb'} {{(pid=75021) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 06 07:48:07 user nova-compute[75021]: DEBUG nova.objects.instance [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lazy-loading 'flavor' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:48:07 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] attach device xml: <disk type="block" device="disk">
Dec 06 07:48:07 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:48:07 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:48:07 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:48:07 user nova-compute[75021]:   <serial>f1d9edea-c8af-4cce-8037-bfd7f4559b4d</serial>
Dec 06 07:48:07 user nova-compute[75021]: </disk>
Dec 06 07:48:07 user nova-compute[75021]:  {{(pid=75021) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 06 07:48:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:48:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:48:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:48:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75021) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12095}}
Dec 06 07:48:08 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] No VIF found with MAC fa:16:3e:90:60:37, not building metadata {{(pid=75021) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12071}}
Dec 06 07:48:08 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-40228713-1006-4dff-b802-c922fbcf6a85 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.210s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:48:09 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:48:10 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:48:10 user nova-compute[75021]: INFO nova.compute.manager [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Detaching volume f1d9edea-c8af-4cce-8037-bfd7f4559b4d
Dec 06 07:48:10 user nova-compute[75021]: INFO nova.virt.block_device [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Attempting to driver detach volume f1d9edea-c8af-4cce-8037-bfd7f4559b4d from mountpoint /dev/vdb
Dec 06 07:48:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Attempting to detach device vdb from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the persistent domain config. {{(pid=75021) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 06 07:48:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:48:10 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:48:10 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:48:10 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:48:10 user nova-compute[75021]:   <serial>f1d9edea-c8af-4cce-8037-bfd7f4559b4d</serial>
Dec 06 07:48:10 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:48:10 user nova-compute[75021]: </disk>
Dec 06 07:48:10 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:48:10 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Successfully detached device vdb from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the persistent domain config.
Dec 06 07:48:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the live domain config. {{(pid=75021) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 06 07:48:10 user nova-compute[75021]: DEBUG nova.virt.libvirt.guest [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] detach device xml: <disk type="block" device="disk">
Dec 06 07:48:10 user nova-compute[75021]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 06 07:48:10 user nova-compute[75021]:   <source dev="/dev/sdb"/>
Dec 06 07:48:10 user nova-compute[75021]:   <target dev="vdb" bus="virtio"/>
Dec 06 07:48:10 user nova-compute[75021]:   <serial>f1d9edea-c8af-4cce-8037-bfd7f4559b4d</serial>
Dec 06 07:48:10 user nova-compute[75021]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 06 07:48:10 user nova-compute[75021]: </disk>
Dec 06 07:48:10 user nova-compute[75021]:  {{(pid=75021) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 06 07:48:11 user nova-compute[75021]: DEBUG nova.virt.libvirt.driver [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 06 07:48:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:14 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:48:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:48:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:48:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:48:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:31 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 is timed out.
Dec 06 07:48:31 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Successfully detached device vdb from instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 from the live domain config.
Dec 06 07:48:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] calling os-brick to detach iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f89d85389a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcwLHkmZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 06 07:48:31 user nova-compute[75021]: WARNING os_brick.initiator.connectors.base [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[39420388-9ac2-405a-9613-8809bdf38212]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 06 07:48:31 user nova-compute[75021]: No targets found.
Dec 06 07:48:31 user nova-compute[75021]: iSNS:
Dec 06 07:48:31 user nova-compute[75021]: No targets found.
Dec 06 07:48:31 user nova-compute[75021]: STATIC:
Dec 06 07:48:31 user nova-compute[75021]: Target: iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d
Dec 06 07:48:31 user nova-compute[75021]:         Portal: 172.16.0.220:3260,-1
Dec 06 07:48:31 user nova-compute[75021]:                 Iface Name: default
Dec 06 07:48:31 user nova-compute[75021]: FIRMWARE:
Dec 06 07:48:31 user nova-compute[75021]: No targets found.
Dec 06 07:48:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 06 07:48:31 user nova-compute[75021]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 06 07:48:31 user nova-compute[75021]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75021) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d', 0)] {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0951ed4-189e-490c-b0ec-182f2d252c4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bd9333-4819-4ecf-abc3-051065744550]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d (non-flash)\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d (non-flash)
Dec 06 07:48:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d (non-flash)
Dec 06 07:48:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f89b443d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d'): ({'sdb'}, set())}) {{(pid=75021) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Removing single pathed devices sdb {{(pid=75021) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dea104d-67c7-47cc-a9db-7997db78ab2c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1842f5a-3739-4109-abc8-ab539a94876a]: (4, ('ok\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Flushing IO for device /dev/sdb {{(pid=75021) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[daedb191-e971-4325-8d40-a0c995c07cda]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75021) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0d54f2-50c3-4771-8e81-777cc76a2cf4]: (4, ('1', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.linuxscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] SCSI volumes sdb have been removed. {{(pid=75021) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d')] {{(pid=75021) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f99126-844b-45e0-a935-3d97544fdf24]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --logout {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcebb886-7037-44d9-8284-aa01804756d3]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d, portal: 172.16.0.220,3260]
Dec 06 07:48:31 user nova-compute[75021]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d, portal: 172.16.0.220,3260] successful.
Dec 06 07:48:31 user nova-compute[75021]:  stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --op delete {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1d9edea-c8af-4cce-8037-bfd7f4559b4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG oslo.privsep.daemon [-] privsep: reply[427bee50-f359-4291-87e6-fdb44b4cbe2d]: (4, ('', '')) {{(pid=86148) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75021) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.base [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG os_brick.initiator.connectors.iscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] <== disconnect_volume: return (319ms) None {{(pid=75021) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 06 07:48:31 user nova-compute[75021]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Disconnected iSCSI Volume {{(pid=75021) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 06 07:48:32 user nova-compute[75021]: DEBUG nova.objects.instance [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lazy-loading 'flavor' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:48:32 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-8471ddc3-c27a-4787-b19b-9eebe94b8354 tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.716s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:48:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:48:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:48:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:33 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:38 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:48:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:48:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:48:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:48:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:38 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:48:40 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:48:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:48:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:48:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 06 07:48:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquired lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 06 07:48:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Forcefully refreshing network info cache for instance {{(pid=75021) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 06 07:48:40 user nova-compute[75021]: DEBUG nova.objects.instance [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lazy-loading 'info_cache' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:48:40 user nova-compute[75021]: DEBUG nova.network.neutron [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updating instance_info_cache with network_info: [{"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:48:40 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Releasing lock "refresh_cache-07e2a259-fcdb-4dc2-8148-6c1bfc32c777" {{(pid=75021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 06 07:48:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updated the network info_cache for instance {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 06 07:48:41 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:48:42 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:48:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:48:42 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:48:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:48:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:48:42 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:48:42 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:48:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 06 07:48:42 user nova-compute[75021]: DEBUG oslo_concurrency.processutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 06 07:48:43 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:48:43 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:48:43 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=9055MB free_disk=25.12897491455078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:48:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:48:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:48:43 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75021) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1707}}
Dec 06 07:48:43 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:48:43 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:48:43 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:48:43 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:48:43 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:48:43 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:48:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:48:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:48:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:48:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:43 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:48:44 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:48:44 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:48:46 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:48:46 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:48:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:48:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:48:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:48:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:48 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:48:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:48:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:53 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:48:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:48:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:48:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:48:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:48:58 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:49:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:49:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:49:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:49:03 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:49:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:49:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:49:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:49:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:49:08 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:49:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:49:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:49:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:49:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:13 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:49:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:49:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:49:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:49:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:49:18 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:49:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:49:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:49:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:49:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:49:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:49:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:49:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:49:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:49:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:49:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:49:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:49:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:49:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:49:31 user nova-compute[75021]: INFO nova.compute.manager [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Terminating instance
Dec 06 07:49:31 user nova-compute[75021]: DEBUG nova.compute.manager [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Start destroying the instance on the hypervisor. {{(pid=75021) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 06 07:49:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:31 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-5dcccfdf-6d6a-49ae-b92a-6cdbc358ce80 req-eca56b49-72c9-41da-974e-c027037f1707 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Received event network-vif-unplugged-c47044c9-199c-486a-a396-60db403db30a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:49:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5dcccfdf-6d6a-49ae-b92a-6cdbc358ce80 req-eca56b49-72c9-41da-974e-c027037f1707 service nova] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:49:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5dcccfdf-6d6a-49ae-b92a-6cdbc358ce80 req-eca56b49-72c9-41da-974e-c027037f1707 service nova] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:49:31 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-5dcccfdf-6d6a-49ae-b92a-6cdbc358ce80 req-eca56b49-72c9-41da-974e-c027037f1707 service nova] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:49:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-5dcccfdf-6d6a-49ae-b92a-6cdbc358ce80 req-eca56b49-72c9-41da-974e-c027037f1707 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] No waiting events found dispatching network-vif-unplugged-c47044c9-199c-486a-a396-60db403db30a {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:49:31 user nova-compute[75021]: DEBUG nova.compute.manager [req-5dcccfdf-6d6a-49ae-b92a-6cdbc358ce80 req-eca56b49-72c9-41da-974e-c027037f1707 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Received event network-vif-unplugged-c47044c9-199c-486a-a396-60db403db30a for instance with task_state deleting. {{(pid=75021) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:32 user nova-compute[75021]: INFO nova.virt.libvirt.driver [-] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Instance destroyed successfully.
Dec 06 07:49:32 user nova-compute[75021]: DEBUG nova.objects.instance [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lazy-loading 'resources' on Instance uuid 07e2a259-fcdb-4dc2-8148-6c1bfc32c777 {{(pid=75021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG nova.virt.libvirt.vif [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-06T07:42:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1589166433',display_name='tempest-SnapshotDataIntegrityTests-server-1589166433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1589166433',id=53,image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9AorRxmja/XabFp+ERfp+pG62mjDs33fBT4qCgC3dR27gn8vrBZObTXrD0kG39pdfO0IbySiJDOCMGQsCK0RJNh1CXn56iPtTtNrEhIhMr/wSgBYHuoMZMZlq5E7ZimQ==',key_name='tempest-keypair-1643443829',keypairs=<?>,launch_index=0,launched_at=2023-12-06T07:42:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42266b03404b41c4a2519332b43bdf3a',ramdisk_id='',reservation_id='r-b0tzz03y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0676e02-e61a-446d-aeb1-22dc06cf490d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1889008318',owner_user_name='tempest-SnapshotDataIntegrityTests-1889008318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-06T07:42:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a58d5953e812436f93039c0b07a9ac59',uuid=07e2a259-fcdb-4dc2-8148-6c1bfc32c777,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Converting VIF {"id": "c47044c9-199c-486a-a396-60db403db30a", "address": "fa:16:3e:90:60:37", "network": {"id": "daaf08f4-87da-4ffb-9b18-5787c3a605ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-562494798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42266b03404b41c4a2519332b43bdf3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47044c9-19", "ovs_interfaceid": "c47044c9-199c-486a-a396-60db403db30a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG nova.network.os_vif_util [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:60:37,bridge_name='br-int',has_traffic_filtering=True,id=c47044c9-199c-486a-a396-60db403db30a,network=Network(daaf08f4-87da-4ffb-9b18-5787c3a605ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc47044c9-19') {{(pid=75021) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG os_vif [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:60:37,bridge_name='br-int',has_traffic_filtering=True,id=c47044c9-199c-486a-a396-60db403db30a,network=Network(daaf08f4-87da-4ffb-9b18-5787c3a605ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc47044c9-19') {{(pid=75021) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc47044c9-19, bridge=br-int, if_exists=True) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e746bc85-4912-4eff-ae0c-8543f4bd6d44) {{(pid=75021) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:32 user nova-compute[75021]: INFO os_vif [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:60:37,bridge_name='br-int',has_traffic_filtering=True,id=c47044c9-199c-486a-a396-60db403db30a,network=Network(daaf08f4-87da-4ffb-9b18-5787c3a605ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc47044c9-19')
Dec 06 07:49:32 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Deleting instance files /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777_del
Dec 06 07:49:32 user nova-compute[75021]: INFO nova.virt.libvirt.driver [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Deletion of /opt/stack/data/nova/instances/07e2a259-fcdb-4dc2-8148-6c1bfc32c777_del complete
Dec 06 07:49:32 user nova-compute[75021]: INFO nova.compute.manager [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 06 07:49:32 user nova-compute[75021]: DEBUG oslo.service.loopingcall [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75021) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG nova.compute.manager [-] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Deallocating network for instance {{(pid=75021) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 06 07:49:32 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] deallocate_for_instance() {{(pid=75021) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 06 07:49:33 user nova-compute[75021]: DEBUG nova.network.neutron [-] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Updating instance_info_cache with network_info: [] {{(pid=75021) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 06 07:49:33 user nova-compute[75021]: INFO nova.compute.manager [-] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Took 1.00 seconds to deallocate network for instance.
Dec 06 07:49:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:49:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:49:33 user nova-compute[75021]: DEBUG nova.compute.manager [req-0db06429-988a-45e1-b9a0-443bca24ba81 req-9edc462d-6b5f-4473-92fd-08e6fe9b7f32 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Received event network-vif-deleted-c47044c9-199c-486a-a396-60db403db30a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:49:33 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:49:33 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:49:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:49:33 user nova-compute[75021]: INFO nova.scheduler.client.report [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Deleted allocations for instance 07e2a259-fcdb-4dc2-8148-6c1bfc32c777
Dec 06 07:49:33 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-c6ce01f3-af8e-47fb-bd9e-bda61f58c6bd tempest-SnapshotDataIntegrityTests-1889008318 tempest-SnapshotDataIntegrityTests-1889008318-project-member] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.196s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:49:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-c2c2d520-5311-47cc-8c86-8961335161f7 req-3547d442-7886-478b-b709-74edbcecdd51 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Received event network-vif-plugged-c47044c9-199c-486a-a396-60db403db30a {{(pid=75021) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 06 07:49:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c2c2d520-5311-47cc-8c86-8961335161f7 req-3547d442-7886-478b-b709-74edbcecdd51 service nova] Acquiring lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:49:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c2c2d520-5311-47cc-8c86-8961335161f7 req-3547d442-7886-478b-b709-74edbcecdd51 service nova] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:49:34 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [req-c2c2d520-5311-47cc-8c86-8961335161f7 req-3547d442-7886-478b-b709-74edbcecdd51 service nova] Lock "07e2a259-fcdb-4dc2-8148-6c1bfc32c777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:49:34 user nova-compute[75021]: DEBUG nova.compute.manager [req-c2c2d520-5311-47cc-8c86-8961335161f7 req-3547d442-7886-478b-b709-74edbcecdd51 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] No waiting events found dispatching network-vif-plugged-c47044c9-199c-486a-a396-60db403db30a {{(pid=75021) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 06 07:49:34 user nova-compute[75021]: WARNING nova.compute.manager [req-c2c2d520-5311-47cc-8c86-8961335161f7 req-3547d442-7886-478b-b709-74edbcecdd51 service nova] [instance: 07e2a259-fcdb-4dc2-8148-6c1bfc32c777] Received unexpected event network-vif-plugged-c47044c9-199c-486a-a396-60db403db30a for instance with vm_state deleted and task_state None.
Dec 06 07:49:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:49:38 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:49:40 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:49:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:49:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:49:40 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 07:49:41 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:49:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:49:43 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:49:43 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:49:43 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:49:44 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:49:44 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:49:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:49:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:49:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:49:44 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:49:44 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:49:44 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:49:44 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=9195MB free_disk=25.15605926513672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:49:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:49:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:49:44 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:49:44 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:49:44 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:49:44 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:49:44 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:49:44 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:49:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:49:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:49:48 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:49:52 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:49:57 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:49:59 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:50:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:50:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:50:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:50:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:50:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:50:02 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:50:07 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:50:12 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:50:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:50:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:50:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:50:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:50:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:50:17 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:50:22 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:50:23 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:50:25 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:50:27 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:50:28 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:50:32 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:50:37 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:50:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 06 07:50:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:50:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75021) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 06 07:50:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:50:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75021) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 06 07:50:37 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:50:39 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:50:41 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:50:42 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:50:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Starting heal instance info cache {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 06 07:50:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Rebuilding the list of instances to heal {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 06 07:50:42 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Didn't find any instances for network info cache update. {{(pid=75021) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 06 07:50:42 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:50:44 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:50:44 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:50:44 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:50:44 user nova-compute[75021]: DEBUG nova.compute.manager [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75021) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 06 07:50:45 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:50:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:50:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:50:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:50:45 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Auditing locally available compute resources for user (node: user) {{(pid=75021) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 06 07:50:45 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:50:45 user nova-compute[75021]: WARNING nova.virt.libvirt.driver [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 06 07:50:45 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Hypervisor/Node resource view: name=user free_ram=9310MB free_disk=25.154434204101562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75021) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 06 07:50:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 06 07:50:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 06 07:50:45 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 06 07:50:45 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75021) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 06 07:50:45 user nova-compute[75021]: DEBUG nova.compute.provider_tree [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed in ProviderTree for provider: 33dec8e2-b735-4a70-a668-4c31a23cece2 {{(pid=75021) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 06 07:50:45 user nova-compute[75021]: DEBUG nova.scheduler.client.report [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Inventory has not changed for provider 33dec8e2-b735-4a70-a668-4c31a23cece2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75021) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 06 07:50:45 user nova-compute[75021]: DEBUG nova.compute.resource_tracker [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Compute_service record updated for user:user {{(pid=75021) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 06 07:50:45 user nova-compute[75021]: DEBUG oslo_concurrency.lockutils [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=75021) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 06 07:50:47 user nova-compute[75021]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75021) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 06 07:50:47 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 06 07:50:50 user nova-compute[75021]: DEBUG oslo_service.periodic_task [None req-27e66b4c-1370-431c-8344-a71082f80734 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75021) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}